Label ranking by learning pairwise preferences

Artificial Intelligence

Volumn 172, Issue 16-17, 2008, Pages 1897-1916

  Hüllermeier, Eyke ^a   Fürnkranz, Johannes ^b   Cheng, Weiwei ^a   Brinker, Klaus ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

^b DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Constraint classification; Pairwise classification; Preference learning; Ranking

Indexed keywords

CONFORMAL MAPPING; EDUCATION; LABELS; LEARNING SYSTEMS; OCCUPATIONAL RISKS; PARTICLE SPECTROMETERS;

CONSTRAINT CLASSIFICATION; FINITE NUMBERS; LOSS FUNCTIONS; NATURAL EXTENSION; PAIRWISE CLASSIFICATION; PREFERENCE LEARNING; PREFERENCE RELATIONS; RANKING; RANKING BY PAIRWISE COMPARISON; RANKING METHODS; SPEARMAN RANK CORRELATION; TRAINING DATA; VOTING STRATEGIES;

LABELING;

EID: 52949143827     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2008.08.002     Document Type: Article

References (62)

1. Aiolli F. A preference model for structured supervised learning tasks. Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM-05) (2005), IEEE Computer Society 557-560
2. Allwein E.L., Schapire R.E., and Singer Y. Reducing multiclass to binary: A unifying approach for margin classifiers. Journal of Machine Learning Research 1 (2000) 113-141
3. Noga Alon, Ranking tournaments, SIAM Journal on Discrete Mathematics 20 (1), pp. 137-142
4. Balasubramaniyan R., Hüllermeier E., Weskamp N., and Kämper J. Clustering of gene expression data using a local shape-based similarity measure. Bioinformatics 21 7 (2005) 1069-1077
5. Bartholdi III J.J., Tovey C.A., and Trick M.A. Voting schemes for which it can be difficult to tell who won the election. Social Choice and Welfare 6 2 (1989) 157-165
6. Catherine L. Blake, Christopher J. Merz, UCI repository of machine learning databases, 1998; Data available at http://www.ics.uci.edu/~mlearn/MLRepository.html
7. Boutilier C., Brafman R., Domshlak C., Hoos H., and Poole D. CP-nets: A tool for representing and reasoning with conditional ceteris paribus preference statements. Journal of Artificial Intelligence Research 21 (2004) 135-191
8. Bradley R.A., and Terry M.E. The rank analysis of incomplete block designs-I. The method of paired comparisons. Biometrika 39 (1952) 324-345
9. Brams S.J., and Fishburn P.C. Voting procedures. In: Arrow K.J., Sen A.K., and Suzumura K. (Eds). Handbook of Social Choice and Welfare (vol. 1) (2002), Elsevier Chapter 4
10. Brazdil P.B., Soares C., and da Costa J.P. Ranking learning algorithms: Using IBL and meta-learning on accuracy and time results. Machine Learning 50 3 (March 2003) 251-277
11. Klaus Brinker, Johannes Fürnkranz, Eyke Hüllermeier, A unified model for multilabel classification and ranking, in: Proceedings of the 17th European Conference on Artificial Intelligence (ECAI-06), 2006, pp. 489-493
12. Klaus Brinker, Johannes Fürnkranz, Eyke Hüllermeier, Label ranking by learning pairwise preferences, Technical Report TUD-KE-2007-01, Knowledge Engineering Group, TU Darmstadt, 2007
13. Cohen W.W., Schapire R.E., and Singer Y. Learning to order things. Journal of Artificial Intelligence Research 10 (1999) 243-270
14. Don Coppersmith, Lisa Fleischer, and Atri Rudra, Ordering by weighted number of wins gives a good ranking for weighted tournaments, in: Proceedings of the ACM-SIAM Symposium on Discrete Algorithms (SODA), 2006, pp. 776-782
15. Crammer K., and Singer Y. Ultraconservative online algorithms for multiclass problems. Journal of Machine Learning Research 3 (2003) 951-991
16. Crammer K., and Singer Y. A family of additive online algorithms for category ranking. Journal of Machine Learning Research 3 (2003) 1025-1058
17. Dekel O., Manning C.D., and Singer Y. Log-linear models for label ranking. In: Thrun S., Saul L.K., and Schölkopf B. (Eds). Advances in Neural Information Processing Systems 16 (NIPS-2003) (2004), MIT Press
18. Dietterich T.G., and Bakiri G. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 2 (1995) 263-286
19. Doyle J. Prospects for preferences. Computational Intelligence 20 2 (2004) 111-136
20. Fodor J., and Roubens M. Fuzzy Preference Modelling and Multicriteria Decision Support (1994), Kluwer Academic Publishers
21. Jerome H. Friedman, Another approach to polychotomous classification. Technical report, Department of Statistics, Stanford University, Stanford, CA, 1996
22. Fürnkranz J. Round robin classification. Journal of Machine Learning Research 2 (2002) 721-747
23. Fürnkranz J. Round robin ensembles. Intelligent Data Analysis 7 5 (2003) 385-404
24. Fürnkranz J., and Hüllermeier E. Pairwise preference learning and ranking. In: Lavrač N., Gamberger D., Blockeel H., and Todorovski L. (Eds). Proceedings of the 14th European Conference on Machine Learning (ECML-03). Cavtat, Croatia. Lecture Notes in Artificial Intelligence vol. 2837 (2003), Springer-Verlag
25. Fürnkranz J., and Hüllermeier E. Preference learning. Künstliche Intelligenz 19 1 (2005) 60-61
26. Ha V., and Haddawy P. Similarity of personal preferences: Theoretical foundations and empirical analysis. Artificial Intelligence 146 (2003) 149-173
27. Haddawy P., Ha V., Restificar A., Geisler B., and Miyamoto J. Preference elicitation via theory refinement. Journal of Machine Learning Research 4 (2003) 317-337
28. Har-Peled S., Roth D., and Zimak D. Constraint classification: A new approach to multiclass classification. In: Cesa-Bianchi N., Numao M., and Reischuk R. (Eds). Proceedings of the 13th International Conference on Algorithmic Learning Theory (ALT-02). Lübeck, Germany (2002), Springer 365-379
29. Sariel Har-Peled, Dan Roth, Dav Zimak, Constraint classification for multiclass classification and ranking, in: Suzanna Becker, Sebastian Thrun, Klaus Obermayer (Eds.), Advances in Neural Information Processing Systems 15 (NIPS-02), 2003, pp. 785-792
30. Hastie T., and Tibshirani R. Classification by pairwise coupling. In: Jordan M.I., Kearns M.J., and Solla S.A. (Eds). Advances in Neural Information Processing Systems 10 (NIPS-97) (1998), MIT Press 507-513
31. Ralf Herbrich, Thore Graepel, Peter Bollmann-Sdorra, Klaus Obermayer, Supervised learning of preference relations, in: Proceedings des Fachgruppentreffens Maschinelles Lernen (FGML-98), 1998, pp. 43-47
32. Hsu C.-W., and Lin C.-J. A comparison of methods for multi-class support vector machines. IEEE Transactions on Neural Networks 13 2 (March 2002) 415-425
33. Eyke Hüllermeier, Johannes Fürnkranz, Ranking by pairwise comparison: A note on risk minimization, in: Proceedings of the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-04), Budapest, Hungary, 2004
34. Eyke Hüllermeier, Johannes Fürnkranz, Comparison of ranking procedures in pairwise preference learning, in: Proceedings of the 10th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU-04), Perugia, Italy, 2004
35. Joachims T. Optimizing search engines using clickthrough data. Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-02) (2002), ACM Press 133-142
36. Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, Geri Gay, Accurately interpreting clickthrough data as implicit feedback, in: Proceedings of the 28th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR-05), 2005
37. Khardon R., and Wachman G. Noise tolerant variants of the perceptron algorithm. The Journal of Machine Learning Research 8 (2007) 227-248
38. Kendall M.G. Rank Correlation Methods (1955), Charles Griffin, London
39. Klement E.-P., Mesiar R., and Pap E. Triangular Norms (2002), Kluwer Academic Publishers
40. Knerr S., Personnaz L., and Dreyfus G. Single-layer learning revisited: A stepwise procedure for building and training a neural network. In: Fogelman Soulié F., and Hérault J. (Eds). Neurocomputing: Algorithms, Architectures and Applications. NATO ASI Series vol. F68 (1990), Springer-Verlag 41-50
41. Knerr S., Personnaz L., and Dreyfus G. Handwritten digit recognition by neural networks with single-layer training. IEEE Transactions on Neural Networks 3 6 (1992) 962-968
42. Kreßel U.H.-G. Pairwise classification and support vector machines. In: Schölkopf B., Burges C.J.C., and Smola A.J. (Eds). Advances in Kernel Methods: Support Vector Learning (1999), MIT Press, Cambridge, MA 255-268 Chapter 15
43. Lehmann E.L., and D'Abrera H.J.M. Nonparametrics: Statistical Methods Based on Ranks. rev. ed. (1998), Prentice-Hall, Englewood Cliffs, NJ
44. Lu B.-L., and Ito M. Task decomposition and module combination based on class relations: A modular neural network for pattern classification. IEEE Transactions on Neural Networks 10 5 (September 1999) 1244-1256
45. Marden J.I. Analyzing and Modeling Rank data (1995), Chapman & Hall, London
46. Michie D., Spiegelhalter D.J., and Taylor C.C. Machine Learning, Neural and Statistical Classification (1994), Ellis Horwood. ftp://ftp.ncc.up.pt/pub/statlog/ Data available at
47. Naessens H., De Meyer H., and De Baets B. Algorithms for the computation of T-transitive closures. IEEE Trans. Fuzzy Syst. 10 (2002) 541-551
48. Park S.-H., and Fürnkranz J. Efficient Pairwise Classification. Proceedings of the 17th European Conference on Machine Learning (ECML-07). Warsaw, Poland (September 2007), Springer-Verlag 658-665
49. Edgar Pimenta, João Gama, André Carvalho, Pursuing the best ECOC dimension for multiclass problems, in: Proceedings of the 20th International Florida Artificial Intelligence Research Society Conference (FLAIRS-07), 2007, pp. 622-627
50. Platt J. Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In: Smola A.J., Bartlett P., Schoelkopf B., and Schuurmans D. (Eds). Advances in Large Margin Classifiers. Cambridge, MA (1999), MIT Press 61-74
51. Price D., Knerr S., Personnaz L., and Dreyfus G. Pairwise neural network classifiers with probabilistic outputs. In: Tesauro G., Touretzky D., and Leen T. (Eds). Advances in Neural Information Processing Systems 7 (NIPS-94) (1995), MIT Press 1109-1116
52. Filip Radlinski, Thorsten Joachims, Learning to rank from implicit feedback, in: Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD-05), 2005
53. Rifkin R., and Klautau A. In defense of one-vs-all classification. Journal of Machine Learning Research 5 (2004) 101-141
54. Michael S. Schmidt, Herbert Gish, Speaker identification via support vector classifiers, in: Proceedings of the 21st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-96), Atlanta, GA, 1996, pp. 105-108
55. Schweizer B., and Sklar A. Probabilistic Metric Spaces (1983), North-Holland, New York
56. Shalev-Shwartz S., and Singer Y. Efficient learning of label ranking by soft projections onto polyhedra. Journal of Machine Learning Research 7 (2006) 1567-1599
57. Spearman C. The proof and measurement of association between two things. American Journal of Psychology 15 (1904) 72-101
58. Tesauro G. Connectionist learning of expert preferences by comparison training. In: Touretzky D. (Ed). Advances in Neural Information Processing Systems 1 (NIPS-88) (1989), Morgan Kaufmann 99-106
59. Usunier N., Amini M.-R., and Gallinari P. Generalization error bounds for classifiers trained with interdependent data. In: Weiss Y., Schölkopf B., and Platt J. (Eds). Advances in Neural Information Processing Systems 18 (NIPS 2005) (2006), MIT Press 1369-1376
60. Wang J. Artificial neural networks versus natural neural networks: A connectionist paradigm for preference assessment. Decision Support Systems 11 (1994) 415-429
61. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools with Java Implementations (2000), Morgan Kaufmann, San Francisco
62. Wu T.-F., Lin C.-J., and Weng R.C. Probability estimates for multi-class classification by pairwise coupling. Journal of Machine Learning Research 5 Aug (2004) 975-1005