An em-based ensemble learning algorithm on piecewise surface regression problem

International Journal of Applied Mathematics and Statistics

Volumn 28, Issue 4, 2012, Pages 59-74

  Luo, Juan ^a   Brodsky, Alexander ^a   Li, Yuan ^a  

^a GEORGE MASON UNIVERSITY   (United States)

Author keywords

Cluster index reassignment; EM based; Ensemble learning; Piecewise surface regression

Indexed keywords

BENCHMARK DATA; CLUSTER INDEX REASSIGNMENT; CLUSTERING QUALITY; CONSUMER BEHAVIOR PATTERNS; DATA POINTS; EM-BASED; ENSEMBLE LEARNING; ENSEMBLE LEARNING ALGORITHM; EXPECTATION MAXIMIZATION; FEATURE VECTORS; ITERATION PROCESS; LEARNING OUTCOME; LEARNING PACKAGES; LEARNING PHASE; LOCAL REGRESSION; MAJORITY VOTING; MARKET SEGMENTATION; METEOROLOGICAL RESEARCH; MULTI-STEP; PIECE-WISE; PREDICTIVE ERROR; ROOT MEAN SQUARED ERRORS; SUBMODELS; SURFACE REGRESSION; TRAINING DATA SETS; TYPICAL APPLICATION; WEATHER PATTERNS;

ITERATIVE METHODS; LEARNING ALGORITHMS; REGRESSION ANALYSIS;

CLASSIFICATION (OF INFORMATION);

EID: 84866771105     PISSN: 09731377     EISSN: 09737545     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. Alpaydin 2004. Introduction to Machine Learning, MIT Press.
2. Arumugam, M. and Scott, S. 2004. Emprr: A high-dimensional em-based piecewise regression algorithm, The 2004 International Conference on Machine Learning and Applications, pp. 264-271.
3. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. 1984. Classification and Regression Trees, Statistics/Probability Series, Wadsworth Publishing Company, Belmont, California, U.S.A.
4. Calinski, R. and Harabasz, J. 1974. A dendrite method for cluster analysis, Communications in Statistics - Theory and Methods 3(1): 1-27.
5. Chang, C.-C. and Lin, C.-J. 2001. LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/{ogonek}cjlin/libsvm.
6. Cherkassky, L.-N. 1991. Constrained topological mapping from non-parametric regression analysis, Neural Networks 4: 27-40.
7. Davies, D. L. and Bouldin, D. W. 1979. A cluster separation measure, IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-1(2): 224-227.
8. Dempster, A. P., Laird, N. M. and Rubin, D. B. 1977. Maximum likelihood from incomplete data via the em algorithm, JOURNAL OF THE ROYAL STATISTICAL SOCIETY, SERIES B 39(1): 1-38.
9. Draper, N. and Smith, H. 1998. Applied Regression Analysis Wiley Series in Probability and Statistics. Dunn, J. C. 1974. Well separated clusters and optimal fuzzy-partitions, Journal of Cybernetics 4: 95-104.
10. Ferrari-Trecate, G. and Muselli, M. 2002. A new learning method for piecewise linear regression, Artificial Neural Networks ICANN 2002, Vol. 2415 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, pp. 135-135.
11. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. and Witten, I. H. 2009. The weka data mining software: An update, SIGKDD Explorations 11.
12. Hathaway, R. and Bezdek, J. 1993. Switching regression models and fuzzy clustering, Fuzzy Systems, IEEE Transactions on 1(3): 195-204.
13. Hill, T. and Lewicki, P. 2007. STATISTICS Methods and Applications, StatSoft.
14. Huber, P. and Ronchetti, E. 1981. Robust statistics, Wiley series in probability and mathematical statistics, Wiley, New York, NY, U.S.A.
15. Jain, A. K., Duin, R. P. W. and Mao, J. 2000. Statistical pattern recognition: A review, IEEE Transactions on Pattern Analysis and Machine Intelligence 22: 4-37.
16. Levenberg, K. 1944. A method for the solution of certain non-linear problems in least squares, Quarterly Journal of Applied Mathmatics II(2): 164-168.
17. LIACC 2006. Data Set. Website at http://www.liacc.up.pt/~ltorgo/Regression/.
18. Luo, J. and Brodsky, A. 2010. An optimal regression algorithm for piecewise functions expressed as object-oriented programs, Machine Learning and Applications, 2010. ICMLA '10. Ninth International Conference on, pp. 937-942.
19. Luo, J. and Brodsky, A. 2011. A heaviside-based regression of piecewise functions expressed as object-oriented programs, Machine Learning and Computing, 2011. ICMLC '11. Third International Conference on, Vol. 1, pp. 296-301.
20. MacKay, D. 2003. An example inference task: Clustering, Information Theory, Inference and Learning Algorithms (284).
21. Marquardt, D. W. 1963. An algorithm for least-squares estimation of nonlinear parameters, Journal of the Society for Industrial and Applied Mathematics 11(2): 431-441.
22. MATLAB 2010. version 7.10.0 (R2010a), The MathWorks Inc., Natick, Massachusetts.
23. McGee, C. 1963. Piecewise regression, Journal of the Society for Industrial and Applied Mathematics 11(2): 431-441.
24. Nusser, S., Otte, C. and Hauptmann, W. 2008. An em-based piecewise linear regression algorithm, Proceedings of the 3rd international workshop on Hybrid Artificial Intelligence Systems, pp. 466-474.
25. Quinlan 1992. Learning with continuous classes, Proceedings of the Second Australian Conference on Aritificial Intelligance, pp. 343-348.
26. Ritter 1991. Learning with the self-organizing map, Artificial Neural Networks pp. 379-384.
27. Rousseeuw, P. 1987. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis, J. Comput. Appl. Math. 20: 53-65.
28. Wang, Y. and Witten, I. H. 1997. Inducing model trees for continuous classes, In Proc. of the 9th European Conf. on Machine Learning Poster Papers, pp. 128-137.