Efficient Benchmarking of Algorithm Configuration Procedures via Model-Based Surrogates

Preprint, Article OPEN
Eggensperger, Katharina; Lindauer, Marius; Hoos, Holger H.; Hutter, Frank; Leyton-Brown, Kevin;
(2017)
  • Subject: algorithm configuration | performance prediction | Statistics - Machine Learning | Computer Science - Artificial Intelligence | MIP | supervised learning | SAT | AI | hyperparameter optimisation | empirical algorithmics

The optimization of algorithm (hyper-)parameters is crucial for achieving peak performance across a wide range of domains, ranging from deep neural networks to solvers for hard combinatorial problems. The resulting algorithm configuration (AC) problem has attracted much... View more
  • References (111)
    111 references, page 1 of 12

    Ahmadizadeh K, Dilkina B, Gomes C, Sabharwal A (2010) An empirical study of optimization for maximizing di usion in networks. In: Cohen D (ed) Proceedings of the International Conference on Principles and Practice of Constraint Programming (CP'10), Springer-Verlag, Lecture Notes in Computer Science, vol 6308, pp 514{521

    Ansel J, Kamil S, Veeramachaneni K, Ragan-Kelley J, Bosboom J, O'Reilly U, Amarasinghe S (2014) Opentuner: an extensible framework for program autotuning. In: Amaral J, Torrellas J (eds) International Conference on Parallel Architectures and Compilation, ACM, pp 303{316

    Ansotegui C, Sellmann M, Tierney K (2009) A gender-based genetic algorithm for the automatic con guration of algorithms. In: Gent I (ed) Proceedings of the Fifteenth International Conference on Principles and Practice of Constraint Programming (CP'09), Springer-Verlag, Lecture Notes in Computer Science, vol 5732, pp 142{157

    Ansotegui C, Malitsky Y, Sellmann M, Tierney K (2015) Model-based genetic algorithms for algorithm con guration. In: Yang and Wooldridge (2015), pp 733{739

    Arbelaez A, Truchet C, O'Sullivan B (2016) Learning sequential and parallel runtime distributions for randomized algorithms. In: Proceedings of the international conference on tools with arti cial intelligence (ICTAI)

    Bach F, Blei D (eds) (2015) Proceedings of the 32nd International Conference on Machine Learning (ICML'15), vol 37, Omnipress

    Balint A, Schoning U (2012) Choosing probability distributions for stochastic local search and the role of make versus break. In: Cimatti and Sebastiani (2012), pp 16{29

    Bardenet R, Brendel M, Kegl B, Sebag M (2014) Collaborative hyperparameter tuning. In: Dasgupta and McAllester (2014), pp 199{207

    Bartlett P, Pereira F, Burges C, Bottou L, Weinberger K (eds) (2012) Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems (NIPS'12)

    Belov A, Diepold D, Heule M, Jarvisalo M (eds) (2014) Proceedings of SAT Competition 2014: Solver and Benchmark Descriptions, Department of Computer Science Series of Publications B, vol B-2014-2, University of Helsinki

  • Related Research Results (2)
  • Metrics
Share - Bookmark