On nonparametric ordinal classification with monotonicity constraints

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 11, 2013, Pages 2576-2589

  Kotlowski, Wojciech ^a   Slowinski, Roman ^a,b  

^a POZNAN UNIVERSITY OF TECHNOLOGY   (Poland)

^b SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

isotonic classification; isotonic regression; Machine learning; monotone functions; monotonicity constraints; nonparametric methods; ordinal classification; ordinal regression; preference learning

Indexed keywords

ISOTONIC REGRESSION; MONOTONE FUNCTIONS; MONOTONICITY CONSTRAINT; NONPARAMETRIC METHODS; ORDINAL CLASSIFICATION; ORDINAL REGRESSION; PREFERENCE LEARNING;

LEARNING SYSTEMS;

RISK PERCEPTION;

EID: 84884742522     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.204     Document Type: Article

References (47)

1. S. Greco, B. Matarazzo, and R. Sowi-nski, "Rough Sets Theory for Multicriteria Decision Analysis," European J. Operational Research, vol. 129, pp. 1-47, 2001. (Pubitemid 32071221)
2. S. Greco, B. Matarazzo, and R. Sowinski, "Dominance-Based Rough Set Approach to Decision under Uncertainty and Time Preference," Annals of Operations Research, vol. 176, pp. 41-75, 2010.
3. Preference Learning, J. Fürnkranz and E. Hü llermeier, eds. Springer, 2010.
4. S. Greco, B. Matarazzo, and R. Sowinski, "Rough Set Approach to Customer Satisfaction Analysis," Proc. Fifth Int'l Conf. Rough Sets and Current Trends in Computing, pp. 284-295, 2006. (Pubitemid 44860557)
5. R. Potharst and A.J. Feelders, "Classification Trees for Problems with Monotonicity Constraints," SIGKDD Explorations, vol. 4, no. 1, pp. 1-10, 2002.
6. S. Greco, B. Matarazzo, and R. Sowinski, "A New Rough Set Approach to Evaluation of Bankruptcy Risk," Operational Tools in the Management of Financial Risks, C. Zopounidis, ed., pp. 121-136, Kluwer Academic Publishers, 1998.
7. D. Gamarnik, "Efficient Learning of Monotone Concepts via Quadratic Optimization," Proc. Conf. Computational Learning Theory, pp. 134-143. 1998
8. J. Sill and Abu-Mostafa, "Monotonicity Hints," Advances in Neural Information Processing Systems, vol. 9, pp. 634-640, MIT Press, 1997.
9. Y.U. Ryu, R. Chandrasekaran, and V. Jacob, "Data Classification Using the Isotonic Seeparation Technique: Application to Breast Cancer Prediction," European J. Operational Research, vol. 181, no. 2, pp. 842-854, 2007. (Pubitemid 46420746)
10. A. Feelders and M. Pardoel, "Pruning for Monotone Classification Trees," Proc. Fifth Int'l Symp. Advances in Intelligent Data Analysis V, 2003.
11. K. Cao-Van and B. De Baets, "An Instance-Based Algorithm for Learning Rankings," Proc. Benelearn, pp. 15-21, 2004.
12. R. Sowinski, S. Greco, and B. Matarazzo, "Rough Sets in Decision Making," Encyclopedia of Complexity and Systems Science, R. Meyers, ed., pp. 7753-7786, Springer-Verlag, 2009.
13. K. Dembczy-nski, W. Kotowski, and R. Sowinski, "Ensemble of Decision Rules for Ordinal Classification with Monotonicity Constraints," Proc. Third Int'l Conf. Rough Sets and Knowledge Technology, pp. 260-267, 2008. (Pubitemid 351776035)
14. J. Baszczynski, R. Sowinski, and M. Szelag, "Sequential Covering Rule Induction Algorithm for Variable Consistency Rough Set Approaches," Information Sciences, vol. 181, pp. 987-1002, 2011.
15. R. Sowinski and D. Vanderpooten, "A Generalized Definition of Rough Approximations Based on Similarity," IEEE Trans. Knowledge and Data Eng., vol. 12, no. 2, pp. 331-336, Mar./Apr. 2000.
16. W. Kotowski and R. Sowinski, "Rule Learning with Monotonicity Constraints," Proc. 26th Int'l Conf. Machine Learning (ICML '09), pp. 537-544, 2009.
17. A. Ben-David, "Monotonicity Maintenance in Information-Theoretic Machine Learning Algorithms," Machine Learning, vol. 19, no. 1, pp. 29-43, 1995.
18. S. Giove, S. Greco, B. Matarazzo, and R. Sowinski, "Variable Consistency Monotonic Decision Trees," Proc. Third Int'l Conf. Rough Sets and Current Trends in Computing, pp. 247-254, 2002.
19. K. Cao-Van and B. De Baets, "Growing Decision Trees in an Ordinal Setting," Int'l J. Intelligent Systems, vol. 18, pp. 733-750, 2003.
20. J. Sill, "Monotonic Networks," Advances in Neural Information Processing Systems, vol. 10, pp. 661-667, MIT Press, 1998.
21. A. BenDavid, L. Sterling, and Y.-H. Pao, "Learning and Classification of Monotonic Ordinal Concepts," Computational Intelligence, vol. 5, no. 1, pp. 45-49, 1989.
22. W. Duivesteijn and A. Feelders, "Nearest Neighbour Classification with Monotonicity Constraints," Proc. European Conf. Machine Learning and Knowledge Discovery in Databases (ECML PKDD '08), pp. 301-316, 2008.
23. R. Chandrasekaran, Y.U. Ryu, V.S. Jacob, and S. Hong, "Isotonic Separation," INFORMS J. Computing, vol. 17, no. 4, pp. 462-474, 2005. (Pubitemid 41673347)
24. R. Herbrich, T. Graepel, and K. Obermayer, "Regression Models for Ordinal Data: A Machine Learning Approach," technical report, Technical Univ. of Berlin, 1999.
25. H.-T. Lin and L. Li, "Ordinal Regression by Extended Binary Classifications," Proc. Advances in Neural Information Processing Systems, vol. 19, pp. 865-872, 2007.
26. W. Kotowski and R. Sowinski, "Statistical Approach to Ordinal Classification with Monotonicity Constraints," Proc. Preference Learning ECML/PKDD '08 Workshop, 2008.
27. N. Barile and A. Feelders, "Nonparametric Monotone Classification with MOCA," Proc. IEEE Eighth Int'l Conf. Data Mining (ICDM '08), pp. 731-736, 2008.
28. H.D. Brunk, "Maximum Likelihood Estimates of Monotone Parameters," Annals of Math. Statistics, vol. 26, no. 4, pp. 607-616, 1955.
29. M. Ayer, H.D. Brunk, G.M. Ewing, W.T. Reid, and E. Silverman, "An Empirical Distribution Function for Sampling with Incomplete Information," Annals of Math. Statistics, vol. 26, no. 4, pp. 641-647, 1955.
30. T. Robertson, F.T. Wright, and R.L. Dykstra, Order Restricted Statistical Inference. John Wiley & Sons, 1998.
31. L. Devroye, L. Gyö rfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, first ed. Springer, 1996.
32. H. Levy, Stochastic Dominance. Kluwer Academic Publishers, 1998.
33. K. Cao-Van, "Supervised Ranking, from Semantics to Algorithms," PhD dissertation, Ghent Univ., 2003.
34. J.O. Berger, Statistical Decision Theory and Bayesian Analysis. Springer, 1993.
35. K. Dembczynski, S. Greco, W. Kotowski, and R. Sowinski, "Statistical Model for Rough Set Approach to Multicriteria Classification," Proc. European Conf. Machine Learning and Knowledge Discovery in Databases (ECML PKDD '07), pp. 164-175, 2007.
36. W. Kotowski, K. Dembczynski, S. Greco, and R. Sowinski, "Stochastic Dominance-Based Rough Set Model for Ordinal Classification," Information Sciences, vol. 178, no. 21, pp. 3989-4204, 2008.
37. A. Feelders, "A New Parameter Learning Method for Bayesian Networks with Qualitative Influences," Proc. 23rd Conf. Uncertainty in Artificial Intelligence (UAI '07), pp. 117-124, 2007.
38. O. Burdakov, O. Sysoev, A. Grimvall, and M. Hussian, "An on2 Algorithm for Isotonic Regression," Large-Scale Nonlinear Optimization, series Nonconvex Optimization and Its Applications, vol. 83, pp. 25-33, Springer, 2006.
39. W.L. Maxwell and J.A. Muchstadt, "Establishing Consistent and Realistic Reorder Intervals in Production-Distribution Systems," Operations Research, vol. 33, pp. 1316-1341, 1985.
40. R. Dykstra, J. Hewett, and T. Robertson, "Nonparametric, Isotonic Discriminant Procedures," Biometrica, vol. 86, no. 2, pp. 429-438, 1999. (Pubitemid 129767161)
41. C. Papadimitriou and K. Steiglitz, Combinatorial Optimization. Dover, 1998.
42. J.R. Quinlan, C4.5: Programs for Machine Learning. Morgan Kaufmann, 1993.
43. Y. Freund and R.E. Schapire, "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting," J. Computer and System Sciences, vol. 55, no. 1, pp. 119-139, 1997. (Pubitemid 127433398)
44. Y. Freund, R. Iyer, R.E. Schapire, and Y. Singer, "An Efficient Boosting Algorithm for Combining Preferences," J. Machine Learning Research, vol. 4, pp. 933-969, 2003.
45. H.-T. Lin and L. Li, "Large-Margin Thresholded Ensembles for Ordinal Regression: Theory and Practice," Proc. 17th Int'l Conf. Algorithmic Learning Theory, pp. 319-333, 2006. (Pubitemid 44705637)
46. A. Asuncion and D. Newman, "UCI Machine Learning Repository," http://www.ics.uci.edu/mlearn/MLRepository.html, 2007.
47. B.E. Boser, I. Guyon, and V. Vapnik, "A Training Algorithm for Optimal Margin Classifiers," Proc. Fifth Ann. Workshop Computational Learning Theory (COLT), pp. 144-152, 1992. (Pubitemid 23615470)