A tutorial on kernel methods for categorization

Journal of Mathematical Psychology

Volumn 51, Issue 6, 2007, Pages 343-358

  Jäkel, Frank ^a,b,c   Schölkopf, Bernhard ^a   Wichmann, Felix A ^a,b,c  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^c BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

Author keywords

Categorization; Generalization; Kernel; Machine learning; Similarity

Indexed keywords

EID: 36148995502     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2007.06.002     Document Type: Review

References (43)

1. Aizerman M.A., Braverman E.M., and Rozonoer L.I. Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control 25 6 (1964) 821-837
2. Ashby F.G., and Alfonso-Reese L.A. Categorization as probability density estimation. Journal of Mathematical Psychology 39 (1995) 216-233
3. Ashby F.G., and Gott R.E. Decision rules in the perception and categorization of multidimensional stimuli. Journal of Experimental Psychology: Learning, Memory and Cognition 14 1 (1988) 33-53
4. Ashby F.G., and Maddox W.T. Relations between prototype, exemplar, and decision bound models of categorization. Journal of Mathematical Psychology 37 (1993) 372-400
5. Beals R., Krantz D.H., and Tversky A. Foundations of multidimensional scaling. Psychological Review 75 (1968) 127-142
6. Bishop C.M. Neural networks for pattern recognition (1995), Oxford University Press, Oxford
7. Christianini N., and Shawe-Taylor J. An introduction to support vector machines and other kernel-based learning methods (2000), Cambridge University Press, Cambridge
8. Drösler J. Color similarity represented as a metric of color space. In: Fischer G.H., and Laming D. (Eds). Contributions to mathematical psychology, psychometrics, and methodology (1994), Springer, Berlin 19-37
9. Edelman S. Representation is representation of similarities. Behavioral and Brain Sciences 21 (1998) 449-498
10. Fried L.S., and Holyoak K.J. Induction of category distributions: A framework for classification learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 10 (1984) 234-257
11. Gluck M.A., and Bower G.H. Evaluating an adaptive network model of human learning. Journal of Memory and Language 27 2 (1988) 166-195
12. Graf A.B.A., Wichmann F.A., Bülthoff H.H., and Schölkopf B. Classification of faces in man and machine. Neural Computation 18 (2006) 143-165
13. Hornik K., Stinchcombe M., and White H. Multilayer feedforward networks are universal approximators. Neural Networks 2 (1989) 359-366
14. Jäkel, F., Schölkopf, B., & Wichmann, F. A. (2007a). Generalization and similarity in exemplar models of categorization: Insights from machine learning. Psychonomic Bulletin & Review, in press.
15. Jäkel, F., Schölkopf, B., & Wichmann, F. A. (2007b). Similarity, kernels and the triangle inequality. Journal of Mathematical Psychology, in review.
16. Kruschke J.K. ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review 99 1 (1992) 22-44
17. Medin D.L., and Schwanenflugel P.J. Linear separability in classification learning. Journal of Experimental Psychology: Human Learning and Memory 1 (1981) 355-368
18. Minsky, M., & Papert, S. (1967). Linearly unrecognizable patterns. AIM 140, MIT.
19. Nilsson N.J. Learning machines (1965), McGraw-Hill, New York
20. Nosofsky R.M. Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General 115 (1986) 39-57
21. Nosofsky R.M. Relations between exemplar-similarity and likelihood models of classification. Journal of Mathematical Psychology 34 (1990) 393-418
22. Pitt M.A., Myung I.J., and Zhang S. Toward a method of selecting among computational models of cognition. Psychological Review 109 3 (2002) 472-491
23. Poggio, T. (1990). A theory of how the brain might work. Cold Spring Harbor symposia on quantitative biology LV (pp. 899-910).
24. Poggio T., and Bizzi E. Generalization in vision and motor control. Nature 431 7010 (2004) 768-774
25. Poggio, T., & Girosi, F. (1989). A theory of networks for approximation and learning. Technical Report A. I. Memo No. 1140, MIT AI LAB and Center for Biological Information Processing Whitaker College, Cambridge, MA.
26. Poggio T., and Smale S. The mathematics of learning: Dealing with data. Notices of the American Mathematical Society 50 5 (2003) 537-544
27. Posner M.I., and Keele S.W. On the genesis of abstract ideas. Journal of Experimental Psychology 77 (1968) 353-363
28. Ramsay J.O., and Silverman B.W. Functional data analysis (1997), Springer, New York
29. Reed S.K. Pattern recognition and categorization. Cognitive Psychology 3 (1972) 382-407
30. Rosenblatt F. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review 65 (1958) 386-408
31. Rumelhart D.E., Hinton G.E., and Williams R.J. Learning internal representations by error propagation (1986), MIT Press, Cambridge, MA pp. 318-362
32. Schoenberg I.J. Metric spaces and positive definite functions. Transactions of the American Mathematical Society 44 3 (1938) 522-536
33. Schölkopf B., Herbrich R., and Smola A.J. A generalized representer theorem. In: Helmbold D., and Williamson R. (Eds). Computational learning theory vol. 2111 (2001), Springer, Berlin 416-426
34. Schölkopf B., and Smola A. Learning with kernels (2002), MIT Press, Cambridge, MA
35. Schölkopf B., Smola A.J., and Müller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10 5 (1998) 1299-1319
36. Shepard R.N., Hovland C.I., and Jenkins H.M. Learning and memorization of classifications. Psychological Monographs 75 13 (1961) 1-42
37. Smith J.D., Murray M.J., and Minda J.P. Straight talk about linear separability. Journal of Experimental Psychology: Learning, Memory, and Cognition 23 3 (1997) 659-680
38. Strang G. Linear algebra and its applications. 3rd ed. (1988), Harcourt Brace & Company, Orlando, FL
39. Townsend J.T., Solomon B., and Smith J.S. The perfect Gestalt: Infinite dimensional Riemannian face space and other aspects of face perception. In: Wenger M.J., and Townsend J.T. (Eds). Computational, geometric, and process perspectives of facial cognition: Contexts and challenges (2001), Lawrence Erlbaum Associates, Mahwah, NJ 39-82
40. Tversky A. Features of similarity. Psychological Review 84 4 (1977) 327-352
41. Tversky A., and Gati I. Similarity, separability, and the triangle inequality. Psychological Review 89 2 (1982) 123-154
42. Wichmann F.A., Graf A.B.A., Simoncelli E.P., Bülthoff H.H., and Schölkopf B. Machine learning applied to perception: Decision-images for classification. In: Saul L.K., Weiss Y., and Bottou L. (Eds). Advances in neural information processing systems Vol. 17 (2005), MIT Press, Cambridge, MA 1489-1496
43. Zhang J. Referential duality and representational duality in the scaling of multidimensional and infinite-dimensional stimulus space. In: Colonius H., and Dzhafarov E.N. (Eds). Measurement and representation of sensations (2006), Lawrence Erlbaum Associates, Mahwah, NJ 131-156