Generalization and similarity in exemplar models of categorization: Insights from machine learning

Psychonomic Bulletin and Review

Volumn 15, Issue 2, 2008, Pages 256-271

  Jäkel, Frank ^a,b   Schölkopf, Bernhard ^c   Wichmann, Felix A ^a,b  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

^c MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; HUMAN; LEARNING; STATISTICAL MODEL;

ARTIFICIAL INTELLIGENCE; GENERALIZATION (PSYCHOLOGY); HUMANS; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER);

EID: 48049105122     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/PBR.15.2.256     Document Type: Review

References (92)

1. AIZERMAN, M. A., BRAVERMAN, E. M., & ROZONOER, L. I. (1964). The probability problem of pattern recognition learning and the method of potential functions. Automation & Remote Control, 25, 1175-1190.
2. ALFONSO-REESE, L. A., ASHBY, F. G., & BRAINARD, D. H. (2002). What makes a categorization task difficult? Perception & Psychophysics, 64, 570-583.
3. ASHBY, F. G., & ALFONSO-REESE, L. A. (1995). Categorization as probability density estimation. Journal of Mathematical Psychology, 39, 216-233.
4. ASHBY, F. G., & GOTT, R. E. (1988). Decision rules in the perception and categorization of multidimensional stimuli. Journal of Experimental Psychology: Learning, Memory, & Cognition, 14, 33-53.
5. ASHBY, F. G., & MADDOX, W. T. (1992). Complex decision rules in categorization: Contrasting novice and experienced performance. Journal of Experimental Psychology: Human Perception & Performance, 18, 50-71.
6. ASHBY, F. G., & MADDOX, W. T. (1993). Relations between prototype, exemplar, and decision bound models of categorization. Journal of Mathematical Psychology, 37, 372-400.
7. ASHBY, F. G., WALDRON, E. M., LEE, W. W., & BERKMAN, A. (2001). Suboptimality in human categorization and identification. Journal of Experimental Psychology: General, 130, 77-96.
8. BEALS, R., KRANTZ, D. H., & TVERSKY, A. (1968). Foundations of multidimensional scaling. Psychological Review, 75, 127-142.
9. BISHOP, C. M. (1995). Neural networks for pattern recognition. Oxford: Oxford University Press, Clarendon Press.
10. BOUSQUET, O., & ELISSEEFF, A. (2002). Stability and generalization. Journal of Machine Learning Research, 2, 499-526.
11. BRADLEY, R. A. (1976). Science, statistics, and paired comparisons. Biometrics, 32, 213-239.
12. BRISCOE, E., & FELDMAN, J. (2006). Conceptual complexity and the bias-variance tradeoff. In R. Sun, N. Miyake, & C. Schunn (Eds.), Proceedings of the 28th Annual Conference of the Cognitive Science Society (pp. 1038-1043). Mahwah, NJ: Erlbaum.
13. BROWN, J. S. (1965). Generalization and discrimination. In D. I. Mostofsky (Ed.), Stimulus generalization (pp. 7-23). Stanford: Stanford University Press.
14. BÜLTHOFF, H. H., & EDELMAN, S. (1992). Psychophysical support for a two-dimensional view interpolation theory of object recognition. Proceedings of the National Academy of Sciences, 89, 60-64.
15. BUSH, R. R., & MOSTELLER, F. (1951). A model for stimulus generalization and discrimination. Psychological Review, 58, 413-423.
16. CHATER, N., & VITÁNYI, P. M. B. (2003). The generalized universal law of generalization. Journal of Mathematical Psychology, 47, 346-369.
17. CRISTIANINI, N., & SCHÖLKOPF, B. (2002). Support vector machines and kernel methods: The new generation of learning machines. AI Magazine, 23(3), 31-42.
18. DAVID, H. A. (1988). The method of paired comparisons (2nd ed.). London: Griffin.
19. FASS, D., & FELDMAN, J. (2003). Categorization under complexity: A unified MDL account of human learning of regular and irregular categories. In S. Becker, S. Thrun, & K. Obermayer (Eds.), Advances in neural information processing systems 15 (pp. 35-42). Cambridge, MA: MIT Press.
20. FELDMAN, J. (2000). Minimization of Boolean complexity in human concept learning. Nature, 407, 630-633.
21. FRIED, L. S., & HOLYOAK, K. J. (1984). Induction of category distributions: A framework for classification learning. Journal of Experimental Psychology: Learning, Memory, & Cognition, 10, 234-257.
22. GARNER, W. R. (1974). The processing of information and structure. Potomac, MD: Erlbaum.
23. GHIRLANDA, S., & ENQUIST, M. (2003). A century of generalization. Animal Behaviour, 66, 15-36.
24. GRAF, A. B. A., & WICHMANN, F. A. (2004). Insights from machine learning applied to human visual classification. In S. Thrun, L. K. Saul, & B. Schölkopf (Eds.), Advances in neural information processing systems 16 (pp. 905-912). Cambridge, MA: MIT Press.
25. GRAF, A. B. A., WICHMANN, F. A., BÜ LTHOFF, H. H., & SCHÖLKOPF, B. (2006). Classification of faces in man and machine. Neural Computation, 18, 143-165.
26. HASTIE, T., TIBSHIRANI, R., & FRIEDMAN, J. (2001). The elements of statistical learning: Data mining, inference, and prediction. New York: Springer.
27. JÄKEL, F., SCHÖLKOPF, B., & WICHMANN, F. A. (2007). A tutorial on kernel methods for categorization. Journal of Mathematical Psychology, 51, 343-358.
28. JÄKEL, F., SCHÖLKOPF, B., & WICHMANN, F. A. (2008). Similarity, kernels, and the triangle inequality. Manuscript submitted for publication.
29. KRUSCHKE, J. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review, 99, 22-44.
30. LAMBERTS, K. (1994). Flexible tuning of similarity in exemplar-based categorization. Journal of Experimental Psychology: Learning, Memory, & Cognition, 20, 1003-1021.
31. LOGOTHETIS, N. K., PAULS, J., BÜLTHOFF, H. H., & POGGIO, T. (1994). View-dependent object recognition by monkeys. Current Biology, 4, 401-414.
32. LOGOTHETIS, N. K., PAULS, J., & POGGIO, T. (1995). Shape representation in the inferior temporal cortex of monkeys. Current Biology, 5, 552-563.
33. LOVE, B. C., MEDIN, D. L., & GURECKIS, T. M. (2004). SUSTAIN: A network model of category learning. Psychological Review, 111, 309-332.
34. LUCE, R. D. (1959). Individual choice behavior: A theoretical analysis. New York: Wiley.
35. LUCE, R. D. (1963). Detection and recognition. In R. D. Luce, R. R. Bush, & E. Galanter (Eds.), Handbook of mathematical psychology (Vol. I, pp. 103-189). New York: Wiley.
36. LUCE, R. D. (1977). The choice axiom after twenty years. Journal of Mathematical Psychology, 15, 215-233.
37. MCKINLEY, S. C., & NOSOFSKY, R. M. (1995). Investigations of exemplar and decision bound models in large, ill-defined category structures. Journal of Experimental Psychology: Human Perception & Performance, 21, 128-148.
38. MCKINLEY, S. C., & NOSOFSKY, R. M. (1996). Selective attention and the formation of linear decision boundaries. Journal of Experimental Psychology: Human Perception & Performance, 22, 294-317.
39. MEDIN, D. L., GOLDSTONE, R. L., & GENTNER, D. (1993). Respects for similarity. Psychological Review, 100, 254-278.
40. MEDIN, D. L., & SCHAFFER, M. M. (1978). Context theory of classification learning. Psychological Review, 85, 207-238.
41. MOSTOFSKY, D. I. (Ed.) (1965). Stimulus generalization. Stanford: Stanford University Press.
42. NAVARRO, D. J. (2002). Representing stimulus similarity. Unpublished doctoral dissertation, University of Adelaide, Adelaide, Australia.
43. NAVARRO, D. J. (2007). On the interaction between exemplar-based concepts and a response scaling process. Journal of Mathematical Psychology, 51, 85-98.
44. NOSOFSKY, R. M. (1986). Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General, 115, 39-57.
45. NOSOFSKY, R. M. (1987). Attention and learning processes in the identification and categorization of integral stimuli. Journal of Experimental Psychology: Learning, Memory, & Cognition, 13, 87-108.
46. NOSOFSKY, R. M. (1990). Relations between exemplar-similarity and likelihood models of classification. Journal of Mathematical Psychology, 34, 393-418.
47. NOSOFSKY, R. M. (1991a). Tests of an exemplar model for relating perceptual classification and recognition memory. Journal of Experimental Psychology: Human Perception & Performance, 17, 3-27.
48. NOSOFSKY, R. M. (1991b). Typicality in logically defined categories: Exemplar-similarity versus rule instantiation. Memory & Cognition, 19, 131-150.
49. NOSOFSKY, R. M. (1992). Exemplar-based approach to relating categorization, identification, and recognition. In F. G. Ashby (Ed.), Multidimensional models of perception and cognition (pp. 363-393). Hillsdale, NJ: Erlbaum.
50. NOSOFSKY, R. M., & ZAKI, S. R. (2002). Exemplar and prototype models revisited: Response strategies, selective attention, and stimulus generalization. Journal of Experimental Psychology: Learning, Memory, & Cognition, 28, 924-940.
51. OHL, F. W, SCHEICH, H., & FREEMAN, W. J. (2001). Change in the pattern of ongoing cortical activity with auditory category learning. Nature, 412, 733-736.
52. OP DE BEECK, H., WAGEMANS, J., & VOGELS, R. (2001). Inferotemporal neurons represent low-dimensional configurations of parameterized shapes. Nature Neuroscience, 4, 1244-1252.
53. OP DE BEECK, H., WAGEMANS, J.,& VOGELS, R. (2004). A diverse stimulus representation underlies shape categorization by primates (Abstract). Journal of Vision, 4(8), 518a.
54. ORR, G. B., & MÜLLER, K.-R. (Eds.) (1998). Neural networks: Tricks of the trade. Berlin: Springer.
55. PALMERI, T. J., & GAUTHIER, I. (2004). Visual object understanding. Nature Reviews Neuroscience, 5, 291-303.
56. PITT, M. A., MYUNG, I. J., & ZHANG, S. (2002). Toward a method of selecting among computational models of cognition. Psychological Review, 109, 472-491.
57. POGGIO, T. (1990). A theory of how the brain might work. Cold Spring Harbor Symposia on Quantitative Biology, 55, 899-910.
58. POGGIO, T., & BIZZI, E. (2004). Generalization in vision and motor control. Nature, 431, 768-774.
59. POGGIO, T., & EDELMAN, S. (1990). A network that learns to recognize three-dimensional objects. Nature, 343, 263-266.
60. POGGIO, T., & GIROSI, F. (1989). A theory of networks for approximation and learning (Tech. Rep. No. A. I. Memo No. 1140). Cambridge, MA: MIT AI LAB & Center for Biological Information Processing Whitaker College.
61. POGGIO, T., RIFKIN, R., MUKHERJEE, S., & NIYOGI, P. (2004). General conditions for predictivity in learning theory. Nature, 428, 419-422.
62. POGGIO, T., & SMALE, S. (2003). The mathematics of learning: Dealing with data. Notices of the American Mathematical Society, 50, 537-544.
63. POSNER, M. I., & KEELE, S. W. (1968). On the genesis of abstract ideas. Journal of Experimental Psychology, 77, 353-363.
64. REED, S. K. (1972). Pattern recognition and categorization. Cognitive Psychology, 3, 382-407.
65. RIESENHUBER, M., & POGGIO, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2, 1019-1025.
66. ROSCH, E., & MERVIS, C. B. (1975). Family resemblances: Studies in the internal structure of categories. Cognitive Psychology, 7, 573-605.
67. ROSCH, E., MERVIS, C. B., GRAY, W. D., JOHNSON, D. M., & BOYES-BRAEM, P. (1976). Basic objects in natural categories. Cognitive Psychology, 8, 382-439.
68. ROSENBLATT, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65, 386-408.
69. ROSSEEL, Y. (2002). Mixture models of categorization. Journal of Mathematical Psychology, 46, 178-210.
70. RUMELHART, D. E., HINTON, G. E., & WILLIAMS, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart, J. L. McClelland, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press, Bradford Books.
71. SCHOENBERG, I. J. (1938). Metric spaces and positive definite functions. Transactions of the American Mathematical Society, 44, 522-536.
72. SCHÖLKOPF, B., & SMOLA, A. J. (2002). Learning with kernels: Support vector machines, regularization, optimization, and beyond. Cambridge, MA: MIT Press.
73. SHEPARD, R. N. (1957). Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space. Psychometrika, 22, 325-345.
74. SHEPARD, R. N. (1958). Stimulus and response generalization: Deduction of the generalization gradient from a trace model. Psychological Review, 65, 242-256.
75. SHEPARD, R. N. (1962). The analysis of proximities: Multidimensional scaling with an unknown distance function. Part I. Psychometrika, 27, 125-140.
76. SHEPARD, R. N. (1964). Attention and the metric structure of the stimulus space. Journal of Mathematical Psychology, 1, 54-87.
77. SHEPARD, R. N. (1965). Approximation to uniform gradients of generalization by monotone transformations of scale. In D. I. Mostofsky (Ed.), Stimulus generalization (pp. 94-110). Stanford: Stanford University Press.
78. SHEPARD, R. N. (1987). Toward a universal law of generalization for psychological science. Science, 237, 1317-1323.
79. SHEPARD, R. N., & CHANG, J.-J. (1963). Stimulus generalization in the learning of classifications. Journal of Experimental Psychology, 65, 94-102.
80. SHEPARD, R. N., HOVLAND, C. I., & JENKINS, H. M. (1961). Learning and memorization of classifications. Psychological Monographs, 75(13, Whole No. 517), 1-42.
81. SIGALA, N., GABBIANI, F., & LOGOTHETIS, N. K. (2002). Visual categorization and object representation in monkeys and humans. Journal of Cognitive Neuroscience, 14, 187-198.
82. SIGALA, N., & LOGOTHETIS, N. K. (2002). Visual categorization shapes feature selectivity in the primate temporal cortex. Nature, 415, 318-320.
83. SMITH, J. D., & MINDA, J. P. (1998). Prototypes in the mist: The early epochs of category learning. Journal of Experimental Psychology: Learning, Memory, & Cognition, 24, 1411-1436.
84. SMITH, J. D., & MINDA, J. P. (2000). Thirty categorization results in search of a model. Journal of Experimental Psychology' Learning, Memory, & Cognition, 26, 3-27.
85. SPENCE, K. W. (1937). The differential response in animals to stimuli varying within a single dimension. Psychological Review, 44, 430-444.
86. TENENBAUM, J. B., & GRIFFITHS, T. L. (2001). Generalization, similarity and Bayesian inference. Behavioral & Brain Sciences, 24, 629-640.
87. TRAIN, K. E. (2003). Discrete choice methods with simulation. Cambridge: Cambridge University Press.
88. TVERSKY, A. (1977). Features of similarity. Psychological Review, 84, 327-352.
89. TVERSKY, A., & GATI, I. (1982). Similarity, separability, and the triangle inequality. Psychological Review, 89, 123-154.
90. VAPNIK, V. N. (2000). The nature of statistical learning theory (2nd ed.). New York: Springer.
91. VERGUTS, T., AMEEL, E., & STORMS, G. (2004). Measures of similarity in models of categorization. Memory & Cognition, 32, 379-389.
92. WICHMANN, F. A., GRAF, A. B. A., SIMONCELLI, E. P., BÜLTHOFF, H. H., & SCHÖLKOPF, B. (2005). Machine learning applied to perception: Decision images for gender classification. In L. K. Saul, Y. Weiss, & L. Bottou (Eds.), Advances in neural information processing systems 17 (pp. 1489-1496). Cambridge, MA: MIT Press.