Deep forest: Towards an alternative to deep neural networks

IJCAI International Joint Conference on Artificial Intelligence

Volumn 0, Issue , 2017, Pages 3553-3559

  Zhou, Zhi Hua ^a   Feng, Ji ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION TREES;

COMPUTATIONAL RESOURCES; DIFFERENT DOMAINS; HYPER-PARAMETER; PARALLEL IMPLEMENTATIONS; TRAINING COSTS; TRAINING DATA; TRAINING PROCESS; TREE ENSEMBLES;

DEEP NEURAL NETWORKS;

EID: 85031907349     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.24963/ijcai.2017/497     Document Type: Conference Paper

References (32)

1. [Breiman, 1996] L. Breiman. Stacked regressions. Machine Learning, 24(1):49-64, 1996.
2. [Breiman, 2000] L. Breiman. Randomizing outputs to increase prediction accuracy. Machine Learning, 40(3):113-120, 2000.
3. [Breiman, 2001] L. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001.
4. [Cho et al., 2014] K. Cho, B. van Meriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Ben-gio. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In EMNLP, pages 1724-1734, 2014.
5. [Dietterich et al., 1997] T. G. Dietterich, R. H. Lathrop, and T. Lozano-Pérez. Solving the multiple-instance problem with axis-parallel rectangles. Artificial Intelligence, 89(1-2):31-71, 1997.
6. [Freund and Schapire, 1997] Y. Freund and R. E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1):119-139, 1997.
7. [Gers et al., 2001] F. A. Gers, D. Eck, and J. Schmidhuber. Applying LSTM to time series predictable through time-window approaches. In ICANN, pages 669-676, 2001.
8. [Goodfellow et al., 2016] I. Goodfellow, Y. Bengio, and A. Courville. Deep Learning. MIT Press, Cambridge, MA, 2016.
9. [Graves et al., 2013] A. Graves, A. R. Mohamed, and G. Hinton. Speech recognition with deep recurrent neural networks. In ICASSP, pages 6645-6649, 2013.
10. [Hinton et al., 2006] G. E. Hinton, S. Osindero, and Y.-W. Simon. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527-1554, 2006.
11. [Hinton et al., 2012] G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingbury. Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine, 29(6):82-97, 2012.
12. [Kim, 2014] Y. Kim. Convolutional neural networks for sentence classification. arXiv:1408.5882, 2014.
13. [Kontschieder et al., 2015] P. Kontschieder, M. Fiterau, A. Criminisi, and S. R. Bulo. Deep neural decision forests. In ICCV, pages 1467-1475, 2015.
14. [Krizhenvsky et al., 2012] A. Krizhenvsky, I. Sutskever, and G. Hinton. ImageNet classification with deep convolu-tional neural networks. In NIPS, pages 1097-1105. 2012.
15. [Kuncheva and Whitaker, 2003] L. I. Kuncheva and C. J. Whitaker. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning, 51(2):181-207, 2003.
16. [LeCun et al., 1998] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
17. [Lichman, 2013] M. Lichman. UCI machine learning repository, 2013.
18. [Liu et al., 2008] F. T. Liu, K. M. Ting, Y. Yu, and Z.-H. Zhou. Spectrum of variable-random trees. Journal of Artificial Intelligence Research, 32:355-384, 2008.
19. [Maas et al., 2011] A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Y. Ng, and C. Potts. Learning word vectors for sentiment analysis. In ACL, pages 142-150, 2011.
20. [Mallat, 1999] S. Mallat. A Wavelet Tour of Signal Processing. Academic Press, London, UK, 2nd edition, 1999.
21. [Maron and Lozano-Pérez, 1998] O. Maron and T. Lozano-Pérez. A framework for multiple-instance learning. In NIPS, pages 570-576. 1998.
22. [Mhaskar et al., 2017] H. Mhaskar, Q. Liao, and T. A. Pog-gio. When and why are deep networks better than shallow ones? In AAAI, pages 2343-2349, 2017.
23. [Samaria and Harter, 1994] F. Samaria and A. C. Harter. Pa-rameterisation of a stochastic model for human face identification. In 2nd IEEE Workshop on Applications of Computer Vision, pages 138-142, 1994.
24. [Sapsanis et al., 2013] C. Sapsanis, G. Georgoulas, A. Tzes, and D. Lymberopoulos. Improving EMG based classification of basic hand movements using EMD. In 35th Annual International Conference on the IEEE Engineering in Medicine and Biology Society, pages 5754-5757, 2013.
25. [Simonyan and Zisserman, 2014] K. Simonyan and A. Zis-serman. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556, 2014.
26. [Ting and Witten, 1999] K. M. Ting and I. H. Witten. Issues in stacked generalization. Journal of Artificial Intelligence Research, 10:271-289, 1999.
27. [Tzanetakis and Cook, 2002] G. Tzanetakis and P. R. Cook. Musical genre classification of audio signals. IEEE Trans. Speech and Audio Processing, 10(5):293-302, 2002.
28. [Viola and Jones, 2001] P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In CVPR, pages 511-518, 2001.
29. [Webb, 2000] G. I. Webb. MultiBoosting: A technique for combining boosting and wagging. Machine Learning, 40(2):159-196, 2000.
30. [Wei and Zhou, 2016] X.-S. Wei and Z.-H. Zhou. An empirical study on image bag generators for multi-instance learning. Machine Learning, 105(2):155-198, 2016.
31. [Wolpert, 1992] D. H. Wolpert. Stacked generalization. Neural Networks, 5(2):241-260, 1992.
32. [Zhou, 2012] Z.-H. Zhou. Ensemble Methods: Foundations and Algorithms. CRC, Boca Raton, FL, 2012.