FLASH: Fast Bayesian optimization for data analytic pipelines

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn 13-17-August-2016, Issue , 2016, Pages 2065-2074

  Zhang, Yuyu ^a   Bahadori, Mohammad Taha ^a   Su, Hang ^a   Sun, Jimeng ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Automated hyperparameter tuning; Bayesian optimization; Data analytic pipeline; Health analytics

Indexed keywords

ALGORITHMS; BUDGET CONTROL; DATA MINING; PIPELINES;

BAYESIAN OPTIMIZATION; COMPUTATIONAL EFFORT; HYPER-PARAMETER; NON-PARAMETRIC MODEL; PIPELINE OPTIMIZATION; PREDICTIVE MODELING; STATE-OF-THE-ART METHODS; STATE-OF-THE-ART PERFORMANCE;

OPTIMIZATION;

EID: 84985000572     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2939672.2939829     Document Type: Conference Paper

References (48)

1. A. Atkinson and A. Donev. Optimum experimental designs. 1992.
2. T. Back. Evolutionary algorithms in theory and practice. 1996.
3. J. Bergstra and Y. Bengio. Random search for hyperparameter optimization. JMLR, 13 (1), 2012.
4. J. Bergstra, D. Yamins, and D. Cox. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. In ICML, 2013.
5. J. S. Bergstra, R. Bardenet, Y. Bengio, and B. Kegl. Algorithms for hyper-parameter optimization. In NIPS, 2011.
6. S. Boyd and L. Vandenberghe. Convex optimization. Cambridge university press, 2004.
7. E. Brochu, V. M. Cora, and N. De Freitas. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv preprint arXiv: 1012. 2599, 2010.
8. G. Calinescu, C. Chekuri, M. Pal, and J. Vondrak. Maximizing a monotone submodular function subject to a matroid constraint. SIAM Journal on Computing, 40 (6), 2011.
9. R. Chen, H. Su, Y. Zhen, M. Khalilia, D. Hirsch, M. Thompson, T. Davis, Y. Peng, S. Lin, J. Tejedor-Sojo, E. Searles, and J. Sun. Cloud-based predictive modeling system and its application to asthma readmission prediction. In AMIA. AMIA, 2015.
10. S. J. Coakes and L. Steed. SPSS: Analysis without anguish using SPSS version 14. 0 for Windows. John Wiley & Sons, Inc., 2009.
11. D. Donoho. 50 years of Data Science. Technical report, University of California Berkeley, 2015.
12. K. Eggensperger, M. Feurer, F. Hutter, J. Bergstra, J. Snoek, H. Hoos, and K. Leyton-Brown. Towards an empirical foundation for assessing Bayesian optimization of hyperparameters. In NIPS workshop on Bayesian Optimization in Theory and Practice, 2013.
13. M. Feurer, A. Klein, K. Eggensperger, J. Springenberg, M. Blum, and F. Hutter. Efficient and robust automated machine learning. In NIPS, 2015.
14. M. Feurer, T. Springenberg, and F. Hutter. Initializing Bayesian hyperparameter optimization via meta-learning. In AAAI, 2015.
15. P. Flaherty, A. Arkin, and M. I. Jordan. Robust design of biological experiments. In NIPS, 2005.
16. C. J. Flynn, C. M. Hurvich, and J. S. Simonoff. Efficiency for regularization parameter selection in penalized likelihood estimation of misspecified models. JASA, 108 (503), 2013.
17. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The weka data mining software: an update. ACM SIGKDD explorations newsletter, 11 (1), 2009.
18. X. He. Laplacian regularized d-optimal design for active learning and its application to image retrieval. Image Processing, IEEE Transactions on, 19 (1), 2010.
19. J. C. Ho, J. Ghosh, and J. Sun. Marble: high-throughput phenotyping from electronic health records via sparse nonnegative tensor factorization. In KDD, 2014.
20. M. D. Hoffman, E. Brochu, and N. de Freitas. Portfolio allocation for Bayesian optimization. In UAI. Citeseer, 2011.
21. M. D. Hoffman, B. Shahriari, and N. de Freitas. On correlation and budget constraints in model-based bandit optimization with application to automatic machine learning. In AISTATS, 2014.
22. F. Hutter, H. H. Hoos, and K. Leyton-Brown. Sequential model-based optimization for general algorithm configuration. In Learning and Intelligent Optimization. Springer, 2011.
23. M. Jaggi. Revisiting frank-wolfe: Projection-free sparse convex optimization. In ICML, 2013.
24. B. Komer, J. Bergstra, and C. Eliasmith. Hyperoptsklearn: Automatic hyperparameter configuration for scikitlearn. In ICML workshop on AutoML, 2014.
25. A. Krause and C. Guestrin. Submodularity and its applications in optimized information gathering. TIST, 2 (4), 2011.
26. A. Kumar, R. McCann, J. Naughton, and J. M. Patel. Model selection management systems: The next frontier of advanced analytics. ACM SIGMOD Record, 2015.
27. D. J. Lizotte. Practical Bayesian optimization. University of Alberta, 2008.
28. J. Lv and J. S. Liu. Model selection principles in misspecified models. JRSS-B, 76 (1), 2014.
29. K. Malhotra, T. Hobson, S. Valkova, L. Pullum, and A. Ramanathan. Sequential pattern mining of electronic healthcare reimbursement claims: Experiences and challenges in uncovering how patients are treated by physicians. In Big Data, Oct 2015.
30. X. Meng, J. Bradley, E. Sparks, and S. Venkataraman. Ml pipelines: a new high-level api for mllib, 2015.
31. I. Mierswa, M. Wurst, R. Klinkenberg, M. Scholz, and T. Euler. Yale: Rapid prototyping for complex data mining tasks. In KDD, 2006.
32. J. Mockus, V. Tiesis, and A. Zilinskas. The application of Bayesian methods for seeking the extremum. Towards Global Optimization, 2 (117-129), 1978.
33. R. Munos. Optimistic optimization of deterministic functions without the knowledge of its smoothness. In Advances in neural information processing systems, 2011.
34. Y. Nesterov. Gradient methods for minimizing composite objective function, 2007.
35. K. Ng, A. Ghoting, S. R. Steinhubl, W. F. Stewart, B. Malin, and J. Sun. Paramo: A parallel predictive modeling platform for healthcare analytic research using electronic health records. Journal of biomedical informatics, 48, 2014.
36. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, et al. Scikit-learn: Machine learning in python. JMLR, 12, 2011.
37. T. Robertazzi and S. Schwartz. An accelerated sequential algorithm for producing d-optimal designs. SIAM Journal on Scientific and Statistical Computing, 10 (2), 1989.
38. B. Settles. Active Learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 6 (1), jun 2012.
39. B. Shahriari, K. Swersky, Z. Wang, R. P. Adams, and N. de Freitas. Taking the human out of the loop: A review of Bayesian optimization. Proceedings of the IEEE, 104 (1): 148-175, 2016.
40. M. Shamaiah, S. Banerjee, and H. Vikalo. Greedy sensor selection: Leveraging submodularity. In CDC, 2010.
41. J. Snoek, H. Larochelle, and R. P. Adams. Practical Bayesian optimization of machine learning algorithms. In NIPS, 2012.
42. J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sundaram, M. Patwary, M. Ali, R. P. Adams, et al. Scalable Bayesian optimization using deep neural networks. arXiv preprint arXiv: 1502. 05700, 2015.
43. N. Srinivas, A. Krause, S. M. Kakade, and M. Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. arXiv preprint arXiv: 0912. 3995, 2009.
44. C. Thornton, F. Hutter, H. H. Hoos, and K. Leyton-Brown. Auto-weka: Combined selection and hyperparameter optimization of classification algorithms. In KDD, 2013.
45. J. Villemonteix, E. Vazquez, and E. Walter. An informational approach to the global optimization of expensive-toevaluate functions. Journal of Global Optimization, 44 (4), 2009.
46. Z. Wang, M. Zoghi, F. Hutter, D. Matheson, and N. De Freitas. Bayesian optimization in high dimensions via random embeddings. In IJCAI. Citeseer, 2013.
47. L. Wasserman. All of nonparametric statistics. Springer Science & Business Media, 2006.
48. H. White. Maximum likelihood estimation of misspecified models. Econometrica, 1982.