Evaluating Coreset Methods to enhance Hyperparameter Tuning Efficiency

The pipeline introduced in this paper takes in a coreset method, a dataset a model and a hyperparameter algorithm, which selects a coreset to be used in the selection process. The resulting hyperparameter sets are used to train the model. This results in up to 70% in time savings while the performance of the model does deteriorate only marginal, compared to when using the full dataset for the hyperparameter optimization. These results were obtained using two datasets within the topic of computer vision: cifar10, a classification benchmark, and potsdam, a geo semantic segmnetation task. The coreset method ”Herding” generated the best performing subsets relevant to hyperparameter tuning.