Bagging.LMS: A bagging-based linear fusion with least-mean-square error update for regression

IEEE Region 10 Annual International Conference, Proceedings/TENCON

Volumn , Issue , 2006, Pages

  Wu, Yunfeng ^a   Wang, Cong ^a   Ng, S C ^b  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b OPEN UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ERROR ANALYSIS; LEAST SQUARES APPROXIMATIONS; REGRESSION ANALYSIS;

ADAPTIVE MIXTURE; BAGGING ENSEMBLE SYSTEMS; ENSEMBLE METHODS;

LEARNING SYSTEMS;

EID: 34547591932     PISSN: 21593442     EISSN: 21593450     Source Type: Conference Proceeding    
DOI: 10.1109/TENCON.2006.343982     Document Type: Conference Paper

References (22)

1. L.K. Hansen, P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 10, pp. 993-1001, 1990.
2. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239, Mar 1998.
3. Y.F. Wu, J. He, Y. Man, and J.I. Arribas, "Neural network fusion strategies for identifying breast masses," in Proc. 2004 Int'l Joint Conf. Neural Networks (IJCNN'04), Budapest, Hungary, 2004, vol. 3, pp. 2437-2442.
4. Y. Freund and R.E. Schapire, "Experiment with a new boosting algorithm," Proc. 13th Int'l Conf. on Machine Learning (ICML'96), Bari, Italy, 1996, pp. 148-156.
5. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
6. D. Opitz and R. Maclin, "Popular ensemble methods: AP empirical study," Journal of Artificial Intelligence Research, vol. 11, pp. 169-198, 1999.
7. R.E. Schapire, "The strength of weak learnability," Machine Learning, vol. 5, no. 2, pp. 197-227, 1990.
8. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed, Englewood Cliffs, NJ: Prentice Hall PTR, 1998.
9. Y. Freund and R.E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55, pp. 119-139, 1997.
10. G. Ridgeway, "The state of boosting," Computing Science and Statistics, vol. 31, pp. 172-181, 1999.
11. B. Efron and R. Tibshirahi, An Introduction to the Bootstrap, New York, NY: Chapman and Hall, 1993.
12. K. Tumer and J. Ghosh, "Analysis of decision boundaries in linearly combined neural classifiers," Pattern Recognition, vol. 29, no. 2, pp. 341-348, 1996.
13. L.I. Kuncheva, "A theoretical study on six classifer fusion strategies," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 281-286, 2002.
14. Y.F. Wu, J.M. Zhang, C. Wang, and S.C. Ng, "Linear decision fusions in multilayer perceptrons for breast cancer diagnosis," in Proc. 17th IEEE Int'l Conf. Toots with Artificial Intelligence (ICTAI'05), Hong Kong, 2005, pp. 699-700.
15. L. Breiman, "Random forests," Machine Learning, vol. 45, no. 1, pp. 5-32, 2001.
16. F. Roli, G. Fumera, and J. Kittler, "Fixed and trained combiners for fusion of unbalanced pattern classifiers," in Proc. 5th Int'l Conf. Information Fusion. (IF'02), Annapolis, MD, USA, 2002, vol. 1, pp. 278-284.
17. Y.F. Wu and J.I, Arribas, "Fusing output information in neural networks: Ensemble performs better," in Proc. 25th IEEE EMBS Annu. Int'l Conf. (EMBC'03), Cancun, Mexico, 2003, vol. 3, pp. 2265-2268.
18. G. Fumera and F. Roli, "A theoretical and experimental analysis of linear combiners for multiple classifier systems," IEEE Trans. Pattern Analysis and Machine Intelligenee, vol. 27, no. 6, pp. 942-956, 2005.
19. R.A. Jacobs, M.I. Jordan, S.J. Nowlan, and G.E. Hinton, "Adaptive mixtures of local experts," Neural Computation, vol. 3, no, 11, pp. 79-87, 1991.
20. M.O. Stitson, J.A.E. Weston, A. Gammerman, V. Vovk, and V. Vapnik, "Experiments with support vector machines," Royal Holloway College, University of London, London, UK, Technical Report: CSD-TR-96-19, 1996.
21. M.T., Hagan and M. Menhaj, "Training feedforward networks with the Marquardt algorithm," IEEE Trans. Neural Networks, vol. 5, no. 6, pp. 989-993, 1994.
22. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation learning: The RPROP algorithm," in Proc. 1993 IEEE Int'l Conf Neural Networks (ICNN'93), San Francisco, CA, USA, 1993, vol. 1, pp. 586-591.