Projection-based ensemble learning for ordinal regression

IEEE Transactions on Cybernetics

Volumn 44, Issue 5, 2014, Pages 681-694

  Pérez Ortíria, María ^a   Gutiérrez, Pedro Antonio ^a   Hervás Martínez, César ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

Author keywords

Discriminant analysis; ensemble; logistic regression; ordinal classification; ordinal decomposition; ordinal regression; support vector machines; threshold models

Indexed keywords

DISCRIMINANT ANALYSIS; SUPPORT VECTOR MACHINES;

ENSEMBLE; LOGISTIC REGRESSIONS; ORDINAL CLASSIFICATION; ORDINAL REGRESSION; THRESHOLD MODEL;

REGRESSION ANALYSIS;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; DISCRIMINANT ANALYSIS; PROCEDURES; STATISTICAL MODEL; SUPPORT VECTOR MACHINE;

ALGORITHMS; DISCRIMINANT ANALYSIS; LOGISTIC MODELS; PATTERN RECOGNITION, AUTOMATED; SUPPORT VECTOR MACHINES;

EID: 84899578727     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2266336     Document Type: Article

References (41)

1. M. Pérez-Ortiz, P. A. Gutiérrez, C. Hervás- Martínez, J. Briceño, and M. de la Mata, "An ensemble approach for ordinal threshold models applied to liver transplantation," in Proc. IJCNN, 2012, pp. 2795-2802.
2. P. McCullagh, "Regression models for ordinal data," J. Royal Stat. Soc., vol. 42, no. 2, pp. 109-142, 1980.
3. E. Frank and M. Hall, "A simple approach to ordinal classification," in Proc. 12th Eur. Conf. Mach. Learning, 2001, pp. 145-156. (Pubitemid 33331065)
4. B.-Y. Sun, J. Li, D. D. Wu, X.-M. Zhang, and W.-B. Li, "Kernel discriminant learning for ordinal regression," IEEE Trans. Knowl. Data Eng., vol. 22, no. 6, pp. 906-910, Jun. 2010.
5. S. Kramer, G. Widmer, B. Pfahringer, and M. de Groeve, "Prediction of ordinal classes using regression trees," in Proc. 12th ISMIS, LNCS 1932/2010. Oct. 2000, pp. 665-674.
6. S. B. Kotsiantis and P. E. Pintelas, "A cost sensitive technique for ordinal classification problems," in Proc. 3rd Hellenic Conf. Artif. Intell. (SETN), LNCS 3025. May 2004, pp. 220-229. (Pubitemid 38717053)
7. W. Waegeman and L. Boullart, "An ensemble of weighted support vector machines for ordinal regression," Int. J. Comput. Syst. Sci. Eng., vol. 3, no. 1, pp. 1-7, 2009.
8. L. Li and H.-T. Lin, "Ordinal regression by extended binary classification," in Advances in Neural Information Processing Systems, vol. 19, B. Schölkopf, J. Platt, and T. Hoffman, Eds. 2007, pp. 865-872.
9. J. S. Cardoso and J. F. P. da Costa, "Learning to classify ordinal data: The data replication method," J. Mach. Learning Res., vol. 8, pp. 1393-1429, Jan. 2007. (Pubitemid 47210277)
10. A. Shashua and A. Levin, "Ranking with large margin principle: Two approaches," in Advances in Neural Information Processing Systems (NIPS). Cambridge, MA, USA: MIT Press, 2003, pp. 937-944.
11. P. McCullagh and J. A. Nelder, Generalized Linear Models, 2nd ed., Monographs on Statistics and Applied Probability. London, U.K.: Chapman & Hall/CRC, 1989.
12. W. Chu and Z. Ghahramani, "Gaussian processes for ordinal regression," J. Mach. Learning Res., vol. 6, no. 1, pp. 1019-1041, 2005.
13. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. New York, NY, USA: Wiley-Interscience, 2004.
14. L. Rokach, "Ensemble-based classifiers," Artificial Intelligence Review, vol. 33, nos. 1-2, pp. 1-39, 2009.
15. S. Mika, "Fisher discriminant analysis with kernels," Ph.D. dissertation, Univ. Technology, Berlin, Germany, Dec. 2002.
16. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, 1st ed. Cambridge, U.K.: Cambridge University, 2000.
17. W. Chu and S. S. Keerthi, "Support vector ordinal regression," Neural Comput., vol. 19, no. 3, pp. 792-815, Mar. 2007.
18. P. A. Gutiérrez, M. Pérez-Ortiz, F. Fernandez-Navarro, J. Sánchez- Monedero, and C. Hervás-Martínez, "An experimental study of different ordinal regression methods and measures," in Proc. 7th Int. Conf. HAIS, LNCS 7209. 2012, pp. 296-307.
19. J. Sánchez-Monedero, P. A. Gutiérrez, P. Tino, and C. Hervás-Martínez, "Exploitation of pairwise class distances for ordinal classification," Neural Comput., vol. 25, pp. 1-36, 2013.
20. S. Menard. (2009). Logistic Regression: From Introductory to Advanced Concepts and Applications, New York, NY, USA: Sage Publications [Online]. Available: http://books.google.es/books?id=KuRWdnoe4WUC
21. B. Fang, Y. Y. Tang, Z. Shang, and B. Xu, "Generalized discriminant analysis: A matrix exponential approach," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 40, no. 1, pp. 186-197, Feb. 2010.
22. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learning, vol. 20, no. 3, pp. 273-297, 1995.
23. R. Herbrich, T. Graepel, and K. Obermayer, "Support vector learning for ordinal regression," in Proc. Int. Conf. Artif. Neural Netw., 1999, pp. 97-102. (Pubitemid 30519921)
24. A. Shashua and A. Levin, "Advances in neural information processing systems," in Ranking with Large Margin Principle: Two Approaches, vol. 15, Cambridge, MA, USA: MIT Press, 2003, pp. 937-944.
25. R. Anand, K. Mehrotra, C. Mohan, and S. Ranka, "Efficient classification for multiclass problems using modular neural networks," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 117-124, Jan. 1995.
26. J. C. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," in Advances in Large Margin Classifiers. Cambrdige, MA, USA: MIT Press, 1999, pp. 61-74.
27. V. Franc, A. Zien, and B. Schölkopf, "Support vector machines as probabilistic models," in Proc. ICML, 2011, pp. 665-672.
28. D. J. Miller and L. Yan, "Ensemble classification by criticdriven combining," in Proc. IEEE ICASSP-Volume 02, Mar. 1999, pp. 1029-1032.
29. J. Kittler, M. Hatef, R. P. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998. (Pubitemid 128741312)
30. A. Asuncion and D. Newman. (2007). UCI machine learning repository [Online]. Available: http://www.ics.uci.edu/mlearn/MLRepository.html
31. PASCAL (2011). Pascal (pattern analysis, statistical modelling and computational learning) machine learning benchmarks repository [Online]. Available: http://mldata.org/
32. D. S. Sonnenburg. (2011). Machine Learning Data Set Repository [Online]. Available: http://mldata.org/
33. W.-Y. Deng, Q.-H. Zheng, S. Lian, L. Chen, and X. Wang, "Ordinal extreme learning machine," Neurocomputation, vol. 74, nos. 1-3, pp. 447-456, Dec. 2010.
34. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
35. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multi-class support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002. (Pubitemid 34475042)
36. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The weka data mining software: An update," ACM SIGKDD Explor. Newsletter, vol. 11, no. 1, pp. 10-18, 2009.
37. S. Baccianella, A. Esuli, and F. Sebastiani, "Evaluation measures for ordinal regression," in Proc. 9th Int. Conf. ISDA, Nov.-Dec. 2009, pp. 283-287.
38. M. Cruz-Ramírez, C. Hervás-Martínez, J. Sánchez-Monedero, and P. A. Gutiérrez, "A preliminary study of ordinal metrics to guide a multiobjective evolutionary algorithm," in Proc. 11th Int. Conf. ISDA, Nov. 2011, pp. 743-747.
39. J. Demsar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learning Res., vol. 7, no. 1, pp. 1-30, 2006. (Pubitemid 43022939)
40. M. Pérez-Ortiz, R. Colmenarejo, J. Fernández, and C. Hervás-Martínez, "Can machine learning techniques help to improve the common fisheries policy?" in Proceedings of the International Work Conference on Artificial Neural Networks (Lecture Notes in Computer Science), I. Rojas, G. Joya, and J. Cabestany, Eds. Springer, 2013, pp. 278-286.
41. S. Wang and X. Yao, "Multiclass imbalance problems: Analysis and potential solutions," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 42, no. 4, pp. 1119-1130, Aug. 2012.