A kernel-based framework for learning graded relations from data

IEEE Transactions on Fuzzy Systems

Volumn 20, Issue 6, 2012, Pages 1090-1101

  Waegeman, Willem ^a   Pahikkala, Tapio ^b   Airola, Antti ^b   Salakoski, Tapio ^b   Stock, Michiel ^a   De Baets, Bernard ^a  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITY OF TURKU   (Finland)

Author keywords

Fuzzy relations; graded relations; kernel methods; learning in graphs; machine learning; reciprocal relations; transitivity

Indexed keywords

FUZZY RELATIONS; GRADED RELATIONS; KERNEL METHODS; LEARNING IN GRAPHS; RECIPROCAL RELATIONS; TRANSITIVITY;

BIOINFORMATICS; FUZZY SET THEORY; LEARNING SYSTEMS; SOCIAL NETWORKING (ONLINE);

DIGITAL STORAGE;

EID: 84870545544     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2012.2194151     Document Type: Article

References (68)

1. M. Bowling, J. F̈urnkranz, T. Graepel, and R. Musick, "Machine learning and games," Mach. Learn., vol. 63, no. 3, pp. 211-215, 2006.
2. Y. Yamanishi, J. Vert, and M. Kanehisa, "Protein network inference from multiple genomic data: A supervised approach," Bioinformat., vol. 20, pp. 1363-1370, 2004.
3. Y. Yang, N. Bansal, W. Dakka, P. Ipeirotis, N. Koudas, and D. Papadias, "Query by document," in Proc. 2nd ACM Int. Conf. Web Search Data Mining, Barcelona, Spain, 2009, pp. 34-43.
4. B. Taskar, M. Wong, P. Abbeel, and D. Koller, "Link prediction in relational data," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2004, pp. 659-666.
5. L. De Raedt, Logical and Relational Learning. New York: Springer-Verlag, 2009.
6. J.-P. Vert and Y. Yamanishi, "Supervised graph inference," in Proc. Adv. Neural Inf. Process. Syst. Conf., vol. 17, 2005.
7. E. Xing, A. Ng,M. Jordan, and S. Russell, "Distance metric learning with application to clustering with side information," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2002, vol. 16, pp. 521-528.
8. E. Ḧullermeier and J. F̈urnkranz, Preference Learning. NewYork: Springer-Verlag, 2010.
9. P. Geurts, N. Touleimat, M. Dutreix, and F. d'Alch́e-Buc, "Inferring biological networks with output kernel trees," BMC Bioinformat., vol. 8, no. 2, 2007.
10. J. Doignon, B. Monjardet, M. Roubens, and P. Vincke, "Biorder families, valued relations and preference modelling," J. Math. Psychol., vol. 30, pp. 435-480, 1986.
11. Z. Switalski, "Transitivity of fuzzy preference relations: An empirical study," Fuzzy Sets Syst., vol. 118, pp. 503-508, 2000.
12. B. De Baets and H. De Meyer, "Transitivity frameworks for reciprocal relations: Cycle-transitivity versus FG-transitivity," Fuzzy Sets Syst., vol. 152, pp. 249-270, 2005.
13. B. De Baets, H. DeMeyer, B. De Schuymer, and S. Jenei, "Cyclic evaluation of transitivity of reciprocal relations," Social ChoiceWelfare, vol. 26, pp. 217-238, 2006.
14. S. Diaz, S. Montes, and B. De Baets, "Transitivity bounds in additive fuzzy preference structures," IEEE Trans. Fuzzy Syst., vol. 15, no. 2, pp. 275-286, Apr. 2007.
15. R. Luce and P. Suppes, "Preference, utility and subjective probability," in Handbook of Mathematical Psychology. New York: Wiley, 1965, pp. 249-410.
16. U. Bodenhofer, B. De Baets, and J. Fodor, "A compendium of fuzzy weak orders," Fuzzy Sets Syst., vol. 158, pp. 811-829, 2007.
17. B. Scḧolkopf and A. Smola, Learning with Kernels, Support Vector Machines, Regularisation, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.
18. A. Ben-Hur andW. Noble, "Kernel methods for predicting protein-protein interactions," Bioinformat., vol. 21 (Suppl. 1), pp. 38-46, 2005.
19. I. Steinwart, "On the influence of the kernel on the consistency of support vector machines," J. Mach. Learn. Res., vol. 2, pp. 67-93, 2002.
20. W. Rudin, Functional Analysis, ser. International Series in Pure and Applied Mathematics, 2nd ed. ed. New York: McGraw-Hill, 1991, pp. 121-123.
21. H. Kashima, S. Oyama, Y. Yamanishi, and K. Tsuda, "On pairwise kernels: An efficient alternative and generalization analysis," in Proc. 13th Pacific-Asia Conf. Adv. Knowl. Discovery, Data Mining, 2009, pp. 1030-1037.
22. T. Pahikkala, W. Waegeman, E. Tsivtsivadze, T. Salakoski, and B. De Baets, "Learning intransitive reciprocal relations with kernel methods," Eur. J. Oper. Res., vol. 206, pp. 676-685, 2010.
23. M. Hue and J. Vert, "On learning with kernels for unordered pairs," in Proc. 27th Int. Conf. Mach. Learn., 2010, pp. 463-470.
24. B. De Schuymer, H. De Meyer, B. De Baets, and S. Jenei, "On the cycletransitivity of the dice model," Theory Decis., vol. 54, pp. 261-285, 2003.
25. L. Fisher, Rock, Paper, Scissors: Game Theory in Everyday Life. New York: Basic, 2008.
26. B. Kerr, M. Riley, M. Feldman, and B. Bohannan, "Local dispersal promotes biodiversity in a real-life game of rock paper scissors," Nature, vol. 418, pp. 171-174, 2002.
27. T. Czaran, R. Hoekstra, and L. Pagie, "Chemical warfare between microbes promotes biodiversity," Proc. Nat. Acad. Sci., vol. 99, no. 2, pp. 786-790, 2002.
28. M. Nowak, "Biodiversity: Bacterial game dynamics," Nature, vol. 418, pp. 138-139, 2002.
29. B. Kirkup and M. Riley, "Antibiotic-mediated antagonism leads to a bacterial game of rock-paper-scissors in vivo," Nature, vol. 428, pp. 412-414, 2004.
30. G. Karolyi, Z. Neufeld, and I. Scheuring, "Rock-scissors-paper game in a chaotic flow: The effect of dispersion on the cyclic competition of microorganisms," J. Theor. Biol., vol. 236, no. 1, pp. 12-20, 2005.
31. T. Reichenbach, M. Mobilia, and E. Frey, "Mobility promotes and jeopardizes biodiversity in rock-paper-scissors games," Nature, vol. 448, pp. 1046-1049, 2007.
32. L. Boddy, "Interspecific combative interactions between wood-decaying basidiomycetes," FEMS Microbiol. Ecol., vol. 31, pp. 185-194, 2000.
33. S. Sinervo and C. Lively, "The rock-paper-scissors game and the evolution of alternative mate strategies," Nature, vol. 340, pp. 240-246, 1996.
34. T. Waite, "Intransitive preferences in hoarding gray jays (perisoreus canadensis)," J. Behav. Ecol. Sociobiol., vol. 50, pp. 116-121, 2001.
35. P. Fishburn, "Nontransitive preferences in decision theory," J. Risk Uncertainty, vol. 4, pp. 113-134, 1991.
36. A. Tversky, in Preference, Belief and Similarity, E. Shafir, Ed. Cambridge, MA: MIT Press, 1998.
37. J. Gower and P. Legendre, "Metric and Euclidean properties of dissimilarity coefficients," J. Classificat., vol. 3, pp. 5-48, 1986.
38. F. J̈akel, B. Scḧolkopf, and F. Wichmann, "Similarity, kernels, and the triangle inequality," J. Math. Psychol., vol. 52, no. 2, pp. 297-303, 2008.
39. Z. Switalski, "General transitivity conditions for fuzzy reciprocal preference matrices," Fuzzy Sets Syst., vol. 137, pp. 85-100, 2003.
40. B. De Baets and R. Mesiar, "Metrics and T-equalities," J. Math. Anal. Appl., vol. 267, pp. 531-547, 2002.
41. B. Moser, "On representing and generating kernels by fuzzy equivalence relations," J. Mach. Learn. Res., vol. 7, pp. 2603-2620, 2006.
42. A. Billot, "An existence theorem for fuzzy utility functions: A new elementary proof," Fuzzy Sets Syst., vol. 74, pp. 271-276, 1995.
43. M. Koppen, "Random utility representation of binary choice probabilities: Critical graphs yielding critical necessary conditions," J. Math. Psychol., vol. 39, pp. 21-39, 1995.
44. L. Fono and N. Andjiga, "Utility function of fuzzy preferences on a countable set under max-*-transitivity," Soc. Choice Welfare, vol. 28, pp. 667-683, 2007.
45. R. Herbrich, T. Graepel, and K. Obermayer, "Large margin rank boundaries for ordinal regression," in Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Scḧolkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 2000, pp. 115-132.
46. T. Pahikkala, E. Tsivtsivadze, A. Airola, J. J̈arvinen, and J. Boberg, "An efficient algorithm for learning to rank from preference graphs," Mach. Learn., vol. 75, no. 1, pp. 129-165, 2009.
47. Z. Zhang, "Learning metrics via discriminant kernels and multidimensional scaling: Toward expected Euclidean representation," in Proc. 20th Int. Conf. Mach. Learn., Washington, DC, 2003, pp. 872-879.
48. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, 2006.
49. J. Vert, J. Qiu, and W. S. Noble, "A new pairwise kernel for biological network inference with support vector machines," BMC Bioinformat., vol. 8 (Suppl. 10), p. S8, 2007.
50. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
51. L. Jacob and J. Vert, "Protein-ligand interaction prediction: An improved chemogenomics approach," Bioinformat., vol. 241, pp. 2149-2156, 2008.
52. S. Vishwanathan, N. Schraudolph, R. Kondor, and K. Borgwardt, "Graph kernels," J. Mach. Learn. Res., vol. 11, pp. 1201-1242, 2010.
53. C. Saunders, A. Gammerman, and V. Vovk, "Ridge regression learning algorithm in dual variables," in Proc. Int. Conf. Mach. Learn., 1998, pp. 515-521.
54. A. Menon and C. Elkan, "Predicting labels for dyadic data," Data Mining Knowl. Discov., vol. 21, pp. 327-343, 2010.
55. N. Srebro, J. Rennie, and T. Jaakkola, "Maximum margin matrix factorization," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2005, vol. 17, pp. 1329-1336.
56. K. Miller, T. Griffiths, andM. Jordan, "Nonparametric latent feature models for link prediction," in Proc. Adv. Neural Process. Syst. Conf., 2009, vol. 22, pp. 1276-1284.
57. N. Lawrence and R. Urtasan, "Nonlinear matrix factorization with gaussian processes," in Proc. Int. Conf. Mach. Learn., 2009, pp. 601-608.
58. Y. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and independent output variables," J.Mach. Learn. Res., vol. 6, pp. 1453-1484, 2005.
59. J. Weston, B. Scḧolkopf, O. Bousquet, T. Mann, and W. Noble, "Joint kernel maps," in Predicting Structured Data. Cambridge, MA: MIT Press, 2007, pp. 67-83.
60. J. Weston, A. Eliseeff, D. Zhou, C. Leslie, and W. S. Noble, "Protein ranking: From local to global structure in the protein similarity networks," Proc. Nat. Acad. Sci., vol. 101, pp. 6559-6563, 2004.
61. B. De Baets, H. De Meyer, and H. Naessens, "A class of rational cardinality-based similarity measures," J. Comput. Appl. Math., vol. 132, pp. 51-69, 2001.
62. P. Jaccard, "Nouvelle recherches sur la distribution florale," Bull. de la Socíet́ee Vaudoise de Sciences Naturelles, vol. 44, pp. 223-270, 1908.
63. R. Sokal and C. Michener, "A statistical method for evaluating systematic relationships," Univ. Kansas Sci. Bull., vol. 38, pp. 1409-1438, 1958.
64. L. Dice, "Measures of the amount of ecologic associations between species," Ecology, vol. 26, pp. 297-302, 1945.
65. R. Sokal and P. Sneath, Principles of Numerical Taxonomy. San Francisco, CA: Freeman, 1963.
66. T. Pahikkala, W. Waegeman, A. Airola, T. Salakoski, and B. De Baets, "Conditional ranking on relational data," in Proc. Eur. Conf.Mach. Learning, 2010, pp. 499-514.
67. S. Allesina and J. M. Levine, "A competitive network theory of species diversity," Proc. Nat. Acad. Sci., vol. 108, pp. 5638-5642, 2011.
68. G. E. Hutchinson, "The paradox of the plankton," Amer. Naturalist, vol. 95, no. 882, pp. 137-145, 1961.