Automating model search for large scale machine learning

ACM SoCC 2015 - Proceedings of the 6th ACM Symposium on Cloud Computing

Volumn , Issue , 2015, Pages 368-380

  Sparks, Evan R ^a   Talwalkar, Ameet ^b   Haas, Daniel ^a   Franklin, Michael J ^a   Jordan, Michael I ^a   Kraska, Tim ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of California   (United States)

^c Brown Univerity   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLOUD COMPUTING; CLUSTER COMPUTING; RESOURCE ALLOCATION;

AUTOMATIC MACHINES; LARGE-SCALE DATASETS; LARGE-SCALE MACHINE LEARNING; MASSIVE DATA SETS; NOVEL APPLICATIONS; OPTIMAL RESOURCE ALLOCATION; PREDICTIVE MODELING; PRODUCT RECOMMENDATION;

LEARNING SYSTEMS;

EID: 84958951297     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2806777.2806945     Document Type: Conference Paper

References (48)

1. Anaconda python distribution. http://docs.continuum.io/anaconda/.
2. Apache Mahout. http://mahout.apache.org/.
3. Cluster parallel learning. [With Vowpal Wabbit]. https://github.com/JohnLangford/vowpal-wabbit/wiki/Cluster-parallel.pdf.
4. GraphLab Create Documentation: model parameter search.
5. WEKA. http://www.cs.waikato.ac.nz/ml/weka/.
6. A. Agarwal, J. Duchi, and P. Bartlett. Oracle inequalities for computationally adaptive model selection. arXiv.org, Aug. 2012.
7. S. Agarwal, H. Milner, A. Kleiner, A. Talwalkar, M. Jordan, S. Madden, B. Mozafari, and I. Stoica. Knowing when you're wrong: Building fast and reliable approximate query processing systems. SIGMOD, 2014.
8. A. Alexandrov et al. The Stratosphere Platform for Big Data Analytics. VLDB, 2014.
9. G. M. Amdahl. Validity of the single processor approach to achieving large scale computing capabilities. In Proceedings of the April 18-20, 1967, spring joint computer conference, 1967.
10. K. Bache and M. Lichman. UCI Machine Learning Repository, 2013.
11. Y. Benjamini and Y. Hochberg. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. JRSS B, 1995.
12. A. Berg, J. Deng, and F.-F. Li. ImageNet Large Scale Visual Recognition Challenge 2010 (ILSVRC2010), 2010.
13. J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl. Algorithms for Hyper-Parameter Optimization. NIPS, 2011.
14. J. Bergstra and Y. Bengio. Random search for hyper-parameter optimization. JMLR, 2012.
15. V. R. Borkar et al. Hyracks: A Flexible and Extensible Foundation for Data-Intensive Computing. In ICDE, 2011.
16. S. Bubeck and N. Cesa-Bianchi. Regret analysis of stochastic and nonstochastic multi-armed bandit problems. Foundations and Trends in Machine Learning, 2012.
17. J. Canny and H. Zhao. Big data analytics with small footprint: squaring the cloud. In KDD, 2013.
18. J. Deng, J. Krause, A. C. Berg, and L. Fei-Fei. Hedging your bets: Optimizing accuracy-specificity trade-offs in large scale visual recognition. CVPR, 2012.
19. E. Even-Dar, S. Mannor, and Y. Mansour. Action Elimination and Stopping Conditions for the Multi-Armed Bandit and Reinforcement Learning Problems. JMLR, 2006.
20. J. Garofolo, L. Lamel, W. Fisher, J. Fiscus, D. Pallett, N. Dahlgren, and V. Zue. TIMIT Acoustic-Phonetic Continuous Speech Corpus. 1993.
21. A. Ghoting et al. SystemML: Declarative machine learning on MapReduce. In ICDE, 2011.
22. J. E. Gonzalez, Y. Low, H. Gu, D. Bickson, and C. Guestrin. Power-Graph: Distributed Graph-Parallel Computation on Natural Graphs. In OSDI, 2012.
23. H. Herodotou and S. Babu. Profiling, what-if analysis, and cost-based optimization of mapreduce programs. VLDB, 2011.
24. G. Hinton et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Processing Magazine, IEEE, 2012.
25. P.-S. Huang, H. Avron, T. N. Sainath, V. Sindhwani, and B. Ramabhadran. Kernel methods match deep neural networks on TIMIT. IEEE, 2014.
26. F. Hutter, H. H. Hoos, and K. Leyton-Brown. Sequential Model-Based Optimization for General Algorithm Configuration. pages 507-523, 2011.
27. K. Jamieson and A. Talwalkar. Non-stochastic Best Arm Identification and Hyperparameter Optimization. CoRR, 2015.
28. B. Komer et al. Hyperopt-sklearn: Automatic hyperparameter configuration for scikit-learn. In ICML workshop on AutoML, 2014.
29. T. Kraska, A. Talwalkar, J. Duchi, R. Griffith, M. Franklin, and M. Jordan. MLbase: A Distributed Machine-learning System. In CIDR, 2013.
30. A. Krizhevsky et al. Imagenet classification with deep convolutional neural networks. NIPS, 2012.
31. M. Kuhn et al. caret: Classification and Regression Training, 2015. R package version 6.0-41.
32. A. Kumar, P. Konda, and C. Ré. Feature Selection in Enterprise Analytics: A Demonstration using an R-based Data Analytics System. VLDB Demo, 2013.
33. C. L. Lawson, R. J. Hanson, D. R. Kincaid, and F. T. Krogh. Basic Linear Algebra Subprograms for Fortran Usage. ACM Trans. Math. Softw., 1979.
34. J. D. McCalpin. STREAM: Sustainable Memory Bandwidth in High Performance Computers. Technical report, University of Virginia, 1991-2007.
35. J. D. McCalpin. Memory Bandwidth and Machine Balance in Current High Performance Computers. TCCA Newsletter, 1995.
36. X. Meng et al. MLlib: Machine Learning in Apache Spark. CoRR, 2015.
37. J. A. Nelder and R. Mead. A Simplex Method for Function Minimization. The computer journal, 1965.
38. B. Panda, J. S. Herbach, S. Basu, and R. J. Bayardo. Planet: Massively Parallel Learning of Tree Ensembles with MapReduce. VLDB, 2009.
39. F. Pedregosa et al. Scikit-learn: Machine learning in Python. JMLR, 2011.
40. M. J. Powell. An Efficient Method for Finding the Minimum of a Function of Several Variables Without Calculating Derivatives. The computer journal, 1964.
41. A. Rahimi and B. Recht. Random Features for Large-Scale Kernel Machines. In NIPS, 2007.
42. T. N. Sainath, B. Ramabhadran, M. Picheny, D. Nahamoo, and D. Kanevsky. Exemplar-based sparse representation features: From timit to lvcsr. IEEE Transactions on Audio, Speech, and Language Processing, 2011.
43. J. Snoek, H. Larochelle, and R. P. Adams. Practical Bayesian Optimization of Machine Learning Algorithms. arXiv.org, June 2012.
44. E. R. Sparks, A. Talwalkar, et al. MLI: An API for Distributed Machine Learning. In ICDM, 2013.
45. C. Thornton, F. Hutter, H. H. Hoos, and K. Leyton-Brown. Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms. In KDD, 2013.
46. R. C. Whaley and J. J. Dongarra. Automatically Tuned Linear Algebra Software. In ACM/IEEE conference on Supercomputing, 1998.
47. S. Williams, A. Waterman, and D. Patterson. Roofline: An Insightful Visual Performance Model for Multicore Architectures. CACM, 2009.
48. M. Zaharia et al. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In NSDI, 2012.