Conceptual complexity and the bias/variance tradeoff

Cognition

Volumn 118, Issue 1, 2011, Pages 2-16

  Briscoe, Erica ^a   Feldman, Jacob ^b  

^a GEORGIA TECH RESEARCH INSTITUTE   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Bias variance; Complexity; Concept learning

Indexed keywords

ARTICLE; BIAS; CONCEPT ANALYSIS; CONCEPT FORMATION; CONCEPT LEARNING; EXPERIMENTAL STUDY; HUMAN; HUMAN EXPERIMENT; LEARNING; MATHEMATICAL MODEL; NORMAL HUMAN; PRIORITY JOURNAL; STATISTICAL CONCEPTS; STATISTICAL MODEL; THEORETICAL MODEL; VARIANCE;

CONCEPT FORMATION; HUMANS; LEARNING; MODELS, THEORETICAL;

EID: 79952797057     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2010.10.004     Document Type: Article

References (65)

1. D. Aha, & R.L. Goldstone (1992). Concept learning and flexible weighting. In Proceedings of the fourteenth annual conference of cognitive science society (pp. 534-539).
2. Aitkin, C.D. & Feldman, J. (2006). Subjective complexity of categories defined over three-valued features. In Proceedings of the 28th conference of the cognitive science society (pp. 961-966).
3. Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control 1974, 19(6):716-723.
4. Anderson J.R. The adaptive nature of human categorization. Psychological Review 1991, 98(3):409-429.
5. Anderson J.R. Rules of the mind 1993, Hillsdale, New Jersey.
6. Anderson J.R., Betz J. A hybrid model of categorization. Psychonomic Bulletin and Review 2001, 8:629-647.
7. Ashby F.G., Alfonso-Reese L.A. Categorization as probability density estimation. Journal of Mathematical Psychology 1995, 39:216-233.
8. Ashby F.G., Alfonso-Reese L.A., Turken U., Waldron E.M. A neuropsychological theory of multiple systems in category learning. Psychological Review 1998, 105(3):442-481.
9. Ashby F.G., Maddox W.T. Integrating information from separable psychological dimensions. Journal of Experimental Psychology: Human Perception and Performance 1990, 16:598-612.
10. Blair M., Homa D. As easy to memorize as they are to classify: The 5-4 categories and the category advantage. Memory & Cognition 2003, 31(8):1293-1301.
11. Burnham K.P., Anderson D.R. Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research 2004, 33(2):261-304.
12. Chater N. Simplicity and the mind. Psychologist 1997, 10(11):495-498.
13. Duda R.O., Hart P.E., Stork D.G. Pattern classification 2000, Wiley, New York.
14. Erickson M., Kruschke J.K. Rules and exemplars in category learning. Journal of Experimental Psychology: General 1998, 127:107-140.
15. Fass D., Feldman J. Categorization under complexity: A unified MDL account of human learning of regular and irregular categories. Advances in neural information processing 2002, Vol. 15. MIT Press, Cambridge.
16. Feldman J. Minimization of Boolean complexity in human concept learning. Nature 2000, 407:630-633.
17. Feldman J. The simplicity principle in human concept learning. Current Directions in Psychological Science 2003, 12(6):227-232.
18. Feldman J. An algebra of human concept learning. Journal of Mathematical Psychology 2006, 50:339-368.
19. Fodor J. The pet fish and the red herring: Why concepts aren't prototypes. Cognition 1996, 58:243-276.
20. Geman S., Bienenstock E., Doursat R. Neural networks and the bias/variance dilemma. Neural computation 1992, 4:1-58.
21. Gentner D., Medina J. Similarity and the development of rules. Cognition 1998, 65(2/3):263-297.
22. Goodman N.D., Tenenbaum J.B., Feldman J., Griffiths T.L. A rational analysis of rule-based concept learning. Cognitive Science 2008, 32(1):108-154.
23. Griffiths T.L., Sanborn A.N., Canini K.R., Navarro D.J. Categorization as nonparametric bayesian density estimation. The probabilistic mind: Prospects for rational models of cognition 2008, Oxford University Press, Oxford. M. Oaksford, N. Chater (Eds.).
24. Hahn U., Chater N. Similarity and rules: Distinct? exhaustive? empirically distinguishable?. Cognition 1998, 65:197-230.
25. Hastie T., Tibshirani R., Friedman J. The elements of statistical learning: Data mining, inference, and prediction 2001, Springer, New York.
26. Jäkel F., Schölkopf B., Wichmann F.A. A tutorial on kernel methods for categorization. Journal of Mathematical Psychology 2007, 51(6):343-358.
27. Jones M.C., McKay I.J., Hu T.-C. Variable location and scale kernel density estimation. Annunal of the Institute of Statistical Estimation 1994, 46(3):521-535.
28. Kamp H., Partee B. Prototype theory and compositionality. Cognition 1995, 57(2):129-191.
29. Keil F. Constraints on knowledge and cognitive development. Psychological Review 1981, 88(3):197-227.
30. Kruschke J.K. ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review 1992, 99(1):22-44.
31. Lamberts K. Process models of categorization. Knowledge, concepts and categories 1997, 371-403. MIT Press, Cambridge. K. Lamberts, D. Shanks (Eds.).
32. Love B., Medin D.L., Gureckis T. SUSTAIN: A network model of category learning. Psychological Review 2004, 111(2):309-332.
33. Luce R.D. Detection and recognition. Handbook of mathematical psychology 1963, Wiley, New York. R.D. Luce, R.R. Bush, E. Galanter (Eds.).
34. Marr D. Vision: A computational investigation into the human representation and processing of visual information 1982, Freeman, San Francisco.
35. McKinley S.C., Nosofsky R.M. Investigations of exemplar and decision bound models in large, ill-defined category structures. Journal Experimental Psychology: Human perception and performance 1995, 21(1):128-148.
36. McLachlan G.J., Basford K.E. Mixture models: Inference and applications to clustering 1988, Marcel Dekker, New York.
37. Medin D.L., Schaffer M.M. Context model of classification learning. Psychological Review 1978, 85:207-238.
38. Minda J.P., Smith J.D. Prototypes in category learning: The effects of category size, category structure, and stimulus complexity. Journal of Experimental Psychology 2001, 27(3):775-799.
39. Navarro, D.J. (2008). From natural kinds to complex categories. In Proceedings of the conference of the cognitive science society (pp. 621-626).
40. Nosofsky R.M. Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General 1986, 115:38-57.
41. Nosofsky R.M. Attention and learning processes in the identification and categorization of integral stimuli. Journal of Experimental Psychology: Learning, Memory, and Cognition 1987, 13:87-108.
42. Nosofsky R.M. Relation between the rational model and the context model of categorization. Psychological Science 1991, 2(6):417-421.
43. Nosofsky R.M., Johansen M. Exemplar-based accounts of mulitple-system phenomena in perceptual categorization. Psychonomic Bulletin and Review 2000, 7:375-402.
44. Nosofsky R.M., Palmeri T., McKinley S. Rule-plus-exception model of classification learning. Psychonomic Bulletin and Review 1994, 101:53-79.
45. Nosofsky R.M., Palmeri T.J. An exemplar-based random walk model of speeded classification. Psychological Review 1997, 104:266-300.
46. Op de Beeck H.P., Wagemans J., Vogels R. The representation of perceived shape similarity and its role for category learning in monkeys: A modeling study. Vision Research 2008, 48(4):598-610.
47. Posner M.I., Goldsmith R., Welton K.E. Perceived distance and the classification of distorted patterns. Journal of Experimental Psychology 1967, 73(1):28-38.
48. Posner M.I., Keele S.W. On the genesis of abstract ideas. Journal of Experimental Psychology 1968, 77(3):353-363.
49. Pothos E.M., Chater N. A simplicity principle in unsupervised human categorization. Cognitive Science 2002, 26:303-343.
50. Rosch E. Principles of categorization. Cognition and categorization 1978, Lawrence Erlbaum Associates, New York. E. Rosch, B. Lloyd (Eds.).
51. Rosch E., Mervis C. Family resemblances: Studies in the internal structures of categories. Cognitive Psychology 1975, 7:573-605.
52. Rosseel Y. Mixture models of categorization. Journal of Mathematical Psychology 2002, 46:178-210.
53. Roy, D.M., Kemp, C., Mansinghka, V.K., & Tenenbaum, J.B. (2006). Bayesian modeling of human concept learning. In Advances in neural information processing systems.
54. Schölkopf B., Smola A.J. Learning with kernels: Support vector machines, regularization, optimization, and beyond 2002, MIT Press, Cambridge, MA, USA.
55. Shepard R.N. Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space. Psychometrika 1957, 22(4):325-345.
56. Shepard R.N. Toward a universal law of generalization for psychological science. Science 1987, 237:1317-1323.
57. Smith E.E., Medin D. Categories and concepts 1981, Harvard University Press, Cambridge, MA.
58. Smith E.E., Osherson D.N. Conceptual combination with prototype concepts. Cognitive Science 1984, 8(4):337-361.
59. Smith E.E., Patalano A.L., Jonides J. Alternative strategies of categorization. Cognition 1998, 65:167-196.
60. Smith J.D. Wanted: A new psychology of exemplars. Canadian Journal of Experimental Psychology 2005, 59:47-53.
61. Smith J.D., Minda J.P. Prototypes in the mist: The early epochs of category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 1998, 24:1411-1436.
62. Vanpaemel W., Storms G. In search of abstraction: The varying abstraction model of categorization. Psychonomic Bulletin & Review 2008, 15:732-749.
63. Vanpaemel W., Storms G., Ons B. A varying abstraction model for categorization. Proceedings of the 27th annual conference of the cognitive science society 2005, Lawrence Erlbaum Associates, Hillsdale, NJ. L.B.B. Bara, M. Bucciarelli (Eds.).
64. Verbeemen, T., Storms, G., & Verguts, T. (2003). Varying abstraction in categorization: A k-means approach. In Proceedings of the 27th annual conference of cognitive science society.
65. Verguts T., Storms G. Assessing the informational value of parameter estimates in cognitive models. Behavior Research Methods, Instruments, & Computers 2004.