Auto-WEKA 2.0: Automatic model selection and hyperparameter optimization in WEKA

Journal of Machine Learning Research

Volumn 18, Issue , 2017, Pages 1-5

  Kotthoff, Lars ^a   Thornton, Chris ^a   Hoos, Holger H ^a   Hutter, Frank ^a   Leyton Brown, Kevin ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Feature Selection; Hyperparameter Optimization; Model Selection

Indexed keywords

FEATURE EXTRACTION; LEARNING SYSTEMS; OPTIMIZATION;

AUTOMATIC MODEL SELECTION; BAYESIAN OPTIMIZATION; HYPER-PARAMETER; HYPER-PARAMETER OPTIMIZATIONS; INTUITIVE INTERFACES; MODEL SELECTION; OPEN SOURCES; STATE OF THE ART;

LEARNING ALGORITHMS;

EID: 85020694807     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (11)

1. J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl. Algorithms for hyper-parameter optimization. In Advances in Neural Information Processing Systems 24 (NIPS’11), pages 2546–2554, 2011.
2. E. Brochu, V. Cora, and N. de Freitas. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. Computing Research Repository (arXiv), abs/1012.2599, 2010.
3. K. Eggensperger, M. Feurer, F. Hutter, J. Bergstra, J. Snoek, H. Hoos, and K. Leyton-Brown. Towards an empirical foundation for assessing Bayesian optimization of hyperparameters. In NIPS Workshop on Bayesian Optimization (BayesOpt’13), 2013.
4. M. Feurer, A. Klein, K. Eggensperger, J. Springenberg, M. Blum, and F. Hutter. Efficient and Robust Automated Machine Learning. In Advances in Neural Information Processing Systems 28 (NIPS’15), pages 2944–2952, 2015.
5. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The WEKA Data Mining Software: An Update. SIGKDD Explor. Newsl., 11(1): 10–18, Nov. 2009. ISSN 1931-0145.
6. F. Hutter and M. Osborne. A Kernel for Hierarchical Parameter Spaces. Computing Research Repository (arXiv), abs/1310.5738, Oct. 2013.
7. F. Hutter, H. H. Hoos, and K. Leyton-Brown. Sequential Model-Based Optimization for General Algorithm Configuration. In Learning and Intelligent OptimizatioN Conference (LION 5), pages 507–523, 2011.
8. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12: 2825–2830, 2011.
9. J. Snoek, H. Larochelle, and R. P. Adams. Practical Bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems 25 (NIPS’12), pages 2951–2959, 2012.
10. K. Swersky, D. Duvenaud, J. Snoek, F. Hutter, and M. Osborne. Raiders of the lost architecture: Kernels for Bayesian optimization in conditional parameter spaces. In NIPS Workshop on Bayesian Optimization (BayesOpt’13), 2013.
11. C. Thornton, F. Hutter, H. H. Hoos, and K. Leyton-Brown. Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms. In 19th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD’13), 2013.