Model selection for Big Data: Algorithmic stability and Bag of Little Bootstraps on GPUs

23rd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2015 - Proceedings

Volumn , Issue , 2015, Pages 261-266

  Oneto, Luca ^a   Pilarz, Bernardo ^a   Ghio, Alessandro ^b   Anguita, Davide ^b  

^a UNIVERSITY OF GENOA   (Italy)

^b UNIVERSITY OF GENOA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; NEURAL NETWORKS; PROGRAM PROCESSORS; SUPPORT VECTOR MACHINES;

ALGORITHMIC STABILITY; BIG DATA APPLICATIONS; COMPUTATIONAL RESOURCES; DATA FRAMEWORK; GRAPHICAL PROCESSING UNITS; LEAST SQUARES SUPPORT VECTOR MACHINES; MODEL SELECTION; OPTIMAL MODEL;

BIG DATA;

EID: 84961806564     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. V. Mayer-Schönberger and K. Cukier. Big data: A revolution that will transform how we live, work, and think. Houghton Miffin Harcourt, 2013.
2. O. Bousquet and L. Bottou. The tradeoffs of large scale learning. In Neural Information Processing Systems, 2008.
3. A. Ghio and L. Oneto. Byte the bullet: Learning on real-world computing architectures. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, 2014.
4. M. I. Jordan. On the computational and statistical interface and big data. In Conference on Learning Theory, 2014.
5. L. Oneto, A. Ghio, S. Ridella, J. L. Reyes-Ortiz, and D. Anguita. Out-of-sample error estimation: the blessing of high dimensionality. In IEEE International Conference on Data Mining, International Workshop on High Dimensional Data Mining, 2014.
6. D. Anguita, A. Ghio, L. Oneto, and S. Ridella. In-sample and out-of-sample model selection and error estimation for support vector machines. IEEE Transactions on Neural Networks and Learning Systems, 23(9):1390-1406, 2012.
7. A. Kleiner, A. Talwalkar, P. Sarkar, and M. I. Jordan. The big data bootstrap. In International conference on Machine learning, 2012.
8. A. Kleiner, A. Talwalkar, P. Sarkar, and M. I. Jordan. A scalable bootstrap for massive data. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76(4):795-816, 2014.
9. L. Oneto, A. Ghio, S. Ridella, and D. Anguita. Fully empirical and data-dependent stability-based bounds. IEEE Transactions on Cybernetics, 10.1109/TCYB.2014.2361857:in-press, 2014.
10. O. Bousquet and A. Elisseeff. Stability and generalization. The Journal of Machine Learning Research, 2:499-526, 2002.
11. T. Poggio, R. Rifkin, S. Mukherjee, and P. Niyogi. General conditions for predictivity in learning theory. Nature, 428(6981):419-422, 2004.
12. T.N. Do, V.H. Nguyen, and F. Poulet. Speed up svm algorithm for massive classification tasks. In Advanced Data Mining and Applications, 2008.
13. M. Heeswijk, Y. Miche, E. Oja, and A. Lendasse. Gpu-accelerated and parallelized elm ensembles for large-scale regression. Neurocomputing, 74(16):2430-2437, 2011.
14. J. D. Owens, M. Houston, D. Luebke, S. Green, J. E. Stone, and J. C. Phillips. Gpu computing. Proceedings of the IEEE, 96(5):879-899, 2008.
15. B. Catanzaro, N. Sundaram, and K. Keutzer. Fast support vector machine training and classification on graphics processors. In International conference on Machine learning, 2008.
16. A. Gieseke, K. L. Polsterer, C. E. Oancea, and C. Igel. Speedy greedy feature selection: Better redshift estimation via massive parallelism. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, 2014.
17. J. A. K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle. Least squares support vector machines. World Scientific, 2002.
18. B. Efron. The jackknife, the bootstrap and other resampling plans. SIAM, 1982.
19. T.N. do and F. Poulet. Classifying one billion data with a new distributed svm algorithm. In IEEE International Conference on Computer Science, Research, Innovation and Vision for the Future, 2006.
20. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. Liblinear: A library for large linear classification. The Journal of Machine Learning Research, 9:1871-1874, 2008.
21. P. J. Green and B. W. Silverman. Nonparametric regression and generalized linear models: a roughness penalty approach. CRC Press, 1993.
22. C. Bottou, L.and Cortes, J. S. Denker, H. Drucker, I. Guyon, L. D. Jackel, Y. LeCun, U. A. Muller, E. Sackinger, and P. Simard. Comparison of classifier methods: a case study in handwritten digit recognition. In International Conference on Pattern Recognition, Conference B: Computer Vision & Image Processing, 1994.
23. B. Yaroslav. Notmnist dataset. Technical report, Google (Books/OCR), 2011.