Ensemble deep learning for regression and time series forecasting

IEEE SSCI 2014 - 2014 IEEE Symposium Series on Computational Intelligence - CIEL 2014: 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning, Proceedings

Volumn , Issue , 2014, Pages

  Qiu, Xueheng ^a   Zhang, Le ^a   Ren, Ye ^a   Suganthan, P ^a   Amaratunga, Gehan ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Deep learning; Ensemble method; Load demand forecasting; Neural Networks; Regression; Support Vector Regression; Time series forecasting

Indexed keywords

ARTIFICIAL INTELLIGENCE; FORECASTING; NEURAL NETWORKS; TIME SERIES;

DEEP LEARNING; ENSEMBLE METHODS; LOAD DEMAND; REGRESSION; SUPPORT VECTOR REGRESSION (SVR); TIME SERIES FORECASTING;

REGRESSION ANALYSIS;

EID: 84946688846     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIEL.2014.7015739     Document Type: Conference Paper

References (29)

1. W.-C. Hong, Y. Dong, L.-Y. Chen, and S.-Y. Wei, "Seasonal support vector regression with chaotic genetic algorithm in electric load forecasting," in Proceedings of the 2012 Sixth International Conference on Genetic and Evolutionary Computing. IEEE Computer Society, 2012, pp. 124-127.
2. J. C. Sousa, H. M. Jorge, and L. P. Neves, "Short-term load forecasting based on support vector regression and load profiling," International Journal of Energy Research, vol. 38, no. 3, pp. 350-362, 2014.
3. G. E. Box, G. M. Jenkins, and G. C. Reinsel, Time series analysis: forecasting and control. John Wiley & Sons, 2013.
4. Z. Aung, M. Toukhy, J. R. Williams, A. Sanchez, and S. Herrero, "Towards accurate electricity load forecasting in smart grids," in The Fourth International Conference on Advances in Databases, Knowledge, and Data Applications (DBKDA2012), 2012, pp. 51-57.
5. H. A. Al-Jamimi and L. Ghouti, "Efficient prediction of software fault proneness modules using support vector machines and probabilistic neural networks," in 5th Malaysian Conference in Software Engineering (MySEC2011), 2011, pp. 251-255.
6. G. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural computation, vol. 18, no. 7, pp. 1527-1554, 2006.
7. T. Kuremoto, S. Kimura, K. Kobayashi, and M. Obayashi, "Time series forecasting using restricted boltzmann machine," in Emerging Intelligent Computing Technology and Applications. Springer, 2012, pp. 17-22.
8. E. Busseti, I. Osband, and S. Wong, "Deep learning for time series modeling," Technical report, Stanford University, Tech. Rep. , 2012.
9. L. Breiman, "Bias, variance, and arcing classifiers," 1996.
10. S. Chatterjee, A. Dash, and S. Bandopadhyay, "Ensemble support vector machine algorithm for reliability estimation of a mining machine," Quality and Reliability Engineering International, 2014.
11. F. Galton, "Kinship and correlation (reprinted 1989)," in Statistical Science, 1989, vol. 4, no. 2, pp. 80-86.
12. L. Breiman, "Bagging predictors," in Machine Learning. Kluwer Academic Publishers, 1996, vol. 24, no. 3, pp. 123-140.
13. -, "Random forests," Machine learning, vol. 45, no. 1, pp. 5-32, 2001.
14. P. Geurts, D. Ernst, and L. Wehenkel, "Extremely randomized trees," Machine learning, vol. 63, no. 1, pp. 3-42, 2006.
15. C. Cortes and V. Vapnik, "Support-vector networks," Machine learning, vol. 20, no. 3, pp. 273-297, 1995.
16. H. Drucker, C. J. Burges, L. Kaufman, A. Smola, and V. Vapnik, "Support vector regression machines," Advances in neural information processing systems, vol. 9, pp. 155-161, 1997.
17. A. Graves, M. Liwicki, S. Fernández, R. Bertolami, H. Bunke, and J. Schmidhuber, "A novel connectionist system for unconstrained handwriting recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 5, pp. 855-868, 2009.
18. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion," The Journal of Machine Learning Research, vol. 11, pp. 3371-3408, 2010.
19. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
20. T. G. Dietterich, "Ensemble methods in machine learning," in Multiple classifier systems. Springer, 2000, pp. 1-15.
21. J. Xie, B. Xu, and Z. Chuang, "Horizontal and vertical ensemble with deep representation for classification," arXiv preprint arXiv:1306. 2759, 2013.
22. (2013, Dec. ) Australian energy market operator. [Online]. Available: http://www. aemo. com. au/
23. L. Breiman, J. H. Freidman, R. A. Olshen, and C. J. Stone, "Classification and regression trees. " Wadsworth, 1984.
24. L. Torgo. (2014) Regression datasets. [Online]. Available: http: //www. dcc. fc. up. pt/-ltorgo/Regression/DataSets. html
25. J. FRIEDMAN, "Multivariate adaptative regression splines," in Annals of Statistics, 1991, vol. 19, no. 1, pp. 1-141.
26. R. K. Pace and R. Barry, "Sparse spatial autoregressions," in Statistics and Probability Letters. StatLib repository, 1997, vol. 33, pp. 291-297.
27. C.-C. Chang and C.-J. Lin, "Libsvm: a library for support vector machines," ACM Transactions on Intelligent Systems and Technology (TIST), vol. 2, no. 3, p. 27, 2011.
28. R. B. Palm, "Prediction as a candidate for learning deep hierarchical models of data," Master's thesis, 2012.
29. E. Romero and D. Toppo, "Comparing support vector machines and feedforward neural networks with similar hidden-layer weights," IEEE Transactions on Neural Networks, vol. 18, no. 3, pp. 959-963, 2007.