MetaStream: A meta-learning based method for periodic algorithm selection in time-changing data

Neurocomputing

Volumn 127, Issue , 2014, Pages 52-64

  Rossi, André Luis Debiaso ^a   de Carvalho, André Carlos Ponce de Leon Ferreira ^a   Soares, Carlos ^b   de Souza, Bruno Feres ^a  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b UNIVERSITY OF PORTO   (Portugal)

Author keywords

Algorithm selection; Data streams; Meta learning

Indexed keywords

ALGORITHM SELECTION; APPROPRIATE MODELS; DATA STREAM; MACHINE LEARNING COMMUNITIES; METALEARNING; PERIODIC ALGORITHM; REGRESSION MODEL; REGRESSION PROBLEM;

LEARNING SYSTEMS; REGRESSION ANALYSIS;

LEARNING ALGORITHMS;

ARTICLE; CLASSIFIER; COMPUTER PREDICTION; DATA EXTRACTION; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL COMPUTING; META LEARNING; PERIODIC ALGORITHM SELECTION; PRIORITY JOURNAL; REGRESSION ANALYSIS;

EID: 84888400212     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.05.048     Document Type: Article

References (56)

1. Domingos P. A few useful things to know about machine learning. Communications of the ACM 2012, 55(10):78-87. 10.1145/2347736.2347755.
2. Gama J. Knowledge Discovery from Data Streams 2010, Chapman & Hall/CRC. 1st edition.
3. Gama J., Medas P., Castillo G., Rodrigues P.P. Learning with drift detection. Proceedings of the 17th Brazilian Symposium on Artificial Intelligence 2004, vol. 3171:286-295. Springer, São Luis, Maranhão.
4. Alberg D., Last M., Kandel A. Knowledge discovery in data streams with regression tree methods. WIREs. Data Mining and Knowledge Discovery 2012, 2(1):69-78. 10.1002/widm.51.
5. Kolter J.Z., Maloof M.A. Dynamic weighted majority. an ensemble method for drifting concepts. Journal of Machine Learning Research 2007, 8:2755-2790.
6. D. Kifer, S. Ben-David, J. Gehrke, Detecting change in data streams, in: Proceedings of the 13th International Conference on Very Large Data Bases, VLDB Endowment, 2004, pp. 180-191.
7. Dasu T., Krishnan S., Pomann G. Robustness of change detection algorithms. Advances in Intelligent Data Analysis, Lecture Notes in Computer Science 2011, 125-137. Springer, Berlin, Heidelberg. J.A. Gama, E. Bradley, J. Hollmén (Eds.).
8. H. Wang, W. Fan, P.S. Yu, J. Han, Mining concept-drifting data streams using ensemble classifiers, in: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, NY, USA, 2003, pp. 226-235.doi:10.1145/956750.956778.
9. A. Bifet, G. Holmes, B. Pfahringer, R. Kirkby, R. Gavaldà, New ensemble methods for evolving data streams, in: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, NY, USA, 2009, pp. 139-148. doi:10.1145/1557019.1557041.
10. Džeroski S., Panov P., Ženko B. Ensemble methods in machine learning. Encyclopedia of Complexity and Systems Science 2009, 5317-5325. Springer, New York. R.A. Meyers (Ed.).
11. T.G. Dietterich, Ensemble methods in machine learning, in: Proceedings of the First International Workshop on Multiple Classifier Systems, Springer-Verlag, London, UK, 2000, pp. 1-15.
12. J. Rodríguez, L. Kuncheva, Combining online classification approaches for changing environments, in: International Workshop on Structural, Syntactic, and Statistical Pattern Recognition, Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, 2008, pp. 520-529.
13. Bauer E., Kohavi R. An empirical comparison of voting classification algorithms. bagging, boosting, and variants. Machine Learning 1999, 36(1-2):105-139. 10.1023/A:1007515423169.
14. García-Pedrajas N., Hervás-Martínez C., Ortiz-Boyer D. Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Transactions on Evolutionary Computation 2005, 9(3):271-302. 10.1109/TEVC.2005.844158.
15. Hibon M., Evgeniou T. To combine or not to combine. selecting among forecasts and their combinations. International Journal of Forecasting 2005, 21(1):15-24. 10.1016/j.ijforecast.2004.05.002.
16. Saso D., Ženko B. Is combining classifiers with stacking better than selecting the best one?. Machine Learning 2004, 54:255-273. 10.1023/B:MACH.0000015881.36452.6e.
17. Smith-Miles K.A. Cross-disciplinary perspectives on meta-learning for algorithm selection. ACM Computing Surveys 2008, 41(1):1-25. http://dx.doi.acm.org/10.1145/1456650.1456656.
18. Brazdil P., Giraud-Carrier C., Soares C., Vilalta R. Metalearning. Applications to Data Mining 2009, Springer Verlag.
19. A.L.D. Rossi, A.C.P.L.F. de Carvalho, C. Soares, Meta-learning for periodic algorithms selection in time-changing data, in: Proceedings of the Brazilian Symposium on Neural Networks, IEEE Computer Society, 2012, pp. 7-12. doi:10.1109/SBRN.2012.50.
20. Wolpert D., Macready W.G. No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation 1997, 1(1):67-82.
21. Giraud-Carrier C., Vilalta R., Brazdil P. Introduction to the special issue on meta-learning. Machine Learning 2004, 54(3):187-193. http://dx.doi.org/10.1023/B:MACH.0000015878.60765.42.
22. Vilalta R., Drissi Y. A perspective view and survey of meta-learning. Artificial Intelligent Review 2002, 18(2):77-95. http://dx.doi.org/10.1023/A:1019956318069.
23. R. Klinkenberg, Meta-learning, model selection, and example selection in machine learning domains with concept drift, in: J. Furnkranz, G. Grieser (Eds.), Proceedings of the Annual Workshop of the Special Interest Group on Machine Learning, Knowledge Discovery, and Data Mining (FGML-2005) of the German Computer Science Society Learning - Knowledge Discovery - Adaptivity (LWA-2005), 2005, pp. 164-171.
24. Last M. Online classification of nonstationary data streams. Intelligent Data Analysis 2002, 6(2):129-147.
25. Widmer G. Tracking context changes through meta-learning. Machine Learning 1997, 27(3):259-286. http://dx.doi.org/10.1023/A:1007365809034.
26. Harries M.B., Sammut C. Extracting hidden context. Machine Learning 1998, 32:101-126.
27. J. Gama, P. Kosina, Learning about the learning process, in: Proceedings of the 10th International Conference on Advances in Intelligent Data Analysis, Springer-Verlag, Berlin, Heidelberg, 2011, pp. 162-172.
28. J.B. Gomes, E. Menasalvas, P.A.C. Sousa, Learning recurring concepts from data streams with a context-aware ensemble, in: Proceedings of the ACM Symposium on Applied Computing, ACM, New York, NY, USA, 2011, pp. 994-999. doi:10.1145/1982185.1982403.
29. Žliobaite I., Bifet A., Gaber M., Gabrys B., Gama J., Minku L., Musial K. Next challenges for adaptive learning systems. SIGKDD Explorations 2012, 14(1):48-55. 10.1145/2408736.2408746.
30. Potts D., Sammut C. Incremental learning of linear model trees. Machine Learning 2005, 61:5-48. http://dx.doi.org/10.1007/s10994-005-1121-8.
31. Ikonomovska E., Gama J., Džeroski S. Learning model trees from evolving data streams. Data Mining and Knowledge Discovery 2011, 23(1):128-168. 10.1007/s10618-010-0201-y.
32. Fidalgo-Merino R., Nunez M. Self-adaptive induction of regression trees. IEEE Transactions on Pattern Analysis and Machine Intelligence 2011, 33:1659-1672. http://dx.doi.ieeecomputersociety.org/10.1109/TPAMI.2011.19.
33. J. Gama, R. Sebastião, P.P. Rodrigues, Issues in evaluation of stream learning algorithms, in: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, NY, USA, 2009, pp. 329-338. doi:10.1145/1557019.1557060.
34. C. Soares, Learning Rankings of Learning Algorithms: Recommendation of Algorithms with Meta-learning, Ph.D. Thesis, Faculdade de Ciências da Universidade do Porto, Porto, Portugal, 2004.
35. Prudêncio R.B.C., Ludermir T.B. Meta-learning approaches to selecting time series models. Neurocomputing 2004, 61:121-137.
36. Soares C., Brazdil P.B., Kuba P. A meta-learning method to select the kernel width in support vector regression. Machine Learning 2004, 54:195-209. 10.1023/B:MACH.0000015879.28004.9b.
37. Madjarov G., Kocev D., Gjorgjevikj D., Deroski S. An extensive experimental comparison of methods for multi-label learning. Pattern Recognition 2012, 45(9):3084-3104. 10.1016/j.patcog.2012.03.004.
38. J.P.C.L.M. Moreira, Travel Time Prediction for the Planning of Mass Transit Companies: A Machine Learning Approach, Ph.D. Thesis, Faculty of Engineering of University of Porto, 2008.
39. M. Harries, Splice-2 Comparative Evaluation: Electricity Pricing, Technical Report 9905, School of Computer Science and Engineering, University of New South Wales, 1999.
40. S. Bajwa, E. Chung, M. Kuwahara, Performance evaluation of an adaptive travel time prediction model, in: Intelligent Transportation Systems, 2005. Proceedings. 2005 IEEE, 2005, pp. 1000-1005. doi:10.1109/ITSC.2005.1520187.
41. Bin Y., Zhongzhen Y., Baozhen Y. Bus arrival time prediction using support vector machines. Journal of Intelligent Transportation Systems 2006, 10(4):151-158. 10.1080/15472450600981009.
42. Breiman L. Random forests. Machine Learning 2001, 45(1):5-32.
43. Cristianini N., Shawe-Taylor J. An Introduction to Support Vector Machines. And Other Kernel-based Learning Methods 2000, Cambridge University Press, New York, NY, USA.
44. Breiman L., Friedman J., Olshen R., Stone C. Classification and Regression Trees 1984, Chapman & Hall (Wadsworth, Inc.).
45. Friedman J.H., Stuetzle W. Projection pursuit regression. Journal of the American Statistical Association 1981, 76(376):817-823.
46. Friedman J.H. Multivariate adaptive regression splines. Annals of Statistics 1991, 19(1):1-67.
47. R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2013. URL 〈〉. http://www.R-project.org/.
48. R. Caruana, A. Niculescu-Mizil, An empirical comparison of supervised learning algorithms, in: Proceedings of the 23rd International Conference on Machine Learning, ACM, New York, NY, USA, 2006, pp. 161-168. doi:10.1145/1143844.1143865.
49. N. Musliu, M. Schwengerer, Algorithm selection for the graph coloring problem, in: Proceedings of the Learning and Intelligent Optimization Conference, Springer, to appear.
50. Gomes T.A., Prudêncio R.B., Soares C., Rossi A.L., Carvalho A. Combining meta-learning and search techniques to select parameters for support vector machines. Neurocomputing 2012, 75(1):3-13. 10.1016/j.neucom.2011.07.005.
51. Witten I., Frank E. Data Mining. Practical Machine Learning Tools and Techniques with Java Implementations 2000, Morgan Kaufmann, San Francisco.
52. Batista G.E.A.P.A., Prati R.C., Monard M.C. A study of the behavior of several methods for balancing machine learning training data. SIGKDD Explorations Newsletter 2004, 6(1):20-29. 10.1145/1007730.1007735.
53. Adya M., Collopy F., Armstrong J.S., Kennedy M. Automatic identification of time series features for rule-based forecasting. International Journal of Forecasting 2001, 17(2):143-157. 10.1016/S0169-2070(01)00079-6.
54. Wang X., Smith-Miles K., Hyndman R. Rule induction for forecasting method selection. meta-learning the characteristics of univariate time series. Neurocomputing 2009, 72(10-12):2581-2594. http://dx.doi.org/10.1016/j.neucom.2008.10.017.
55. Lemke C., Gabrys B. Meta-learning for time series forecasting and forecast combination. Neurocomputing 2010, 73(10-12):2006-2016. 10.1016/j.neucom.2009.09.020.
56. Mendes-Moreira J., Soares C., Jorge A.M., Sousa J.F.D. Ensemble approaches for regression. a survey. ACM Computing Surveys 2012, 45(1). 10:1-10:40. 10.1145/2379776.2379786.