A rational model of the effects of distributional information on feature learning

Cognitive Psychology

Volumn 63, Issue 4, 2011, Pages 173-209

  Austerweil, Joseph L ^a   Griffiths, Thomas L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayesian modeling; Features; Nonparametric Bayesian statistics; Rational analysis; Representational change

Indexed keywords

ADULT; ARTICLE; BAYES THEOREM; HUMAN; LEARNING; ORIENTATION; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL THEORY;

ADULT; BAYES THEOREM; HUMANS; LEARNING; MODELS, PSYCHOLOGICAL; ORIENTATION; PSYCHOLOGICAL THEORY;

EID: 80052852204     PISSN: 00100285     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cogpsych.2011.08.002     Document Type: Article

References (83)

1. Abdi H., Valentin D., Edelman B.G. Eigenfeatures as intermediate-level representations: The case for PCA models. Brain and Behavioral Sciences 1998, 21:17-18.
2. Anderson J.R. The adaptive character of thought 1990, Erlbaum, Hillsdale, NJ.
3. Aslin R.N., Saffran J.R., Newport E.L. Computation of conditional probability statistics by 8-month-old infants. Psychological Science 1998, 9:321-324.
4. Austerweil J.L., Griffiths T.L. Analyzing human feature learning as nonparametric Bayesian inference. Advances in neural information processing systems 2009, Vol. 21. MIT Press, Cambridge, MA.
5. Austerweil, J. L., & Griffiths, T. L. (2010). Learning invariant features using the transformed indian buffet process. In Lafferty, J., Williams, C. K. I., Shawe-Taylor, J., Zemel, R., & Culotta A. (Eds.), Advances in neural information processing systems (Vol. 23, pp. 82-90).
6. Batchelder E.O. Bootstrapping the lexicon: A computational model of infant speech segmentation. Cognition 2002, 83:167-206.
7. Bell A., Sejnowski T. An information-maximization approach to blind separation and blind deconvolution. Neural Computation 1995, 7(6):1129-1159.
8. Biederman I., Cooper E.E. Priming contour-deleted images: Evidence for intermediate representations in visual object recognition. Cognitive Psychology 1991, 23:393-419.
9. Bishop C.M. Pattern recognition and machine learning 2006, Springer, New York.
10. Braunstein M.L., Hoffman D., Saidpour A. Parts of visual objects: An experimental test of the minima rule. Perception 1989, 18:817-826.
11. Brent M.R. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning 1999, 34:71-105.
12. Chater N. The search for simplicity: A fundamental cognitive principle?. Quarterly Journal of Experimental Psychology 1999, 52A:273-302.
13. Chater N., Vitanyi P. Simplicity: A unifying principle in cognitive science. Trends in Cognitive Science 2003, 7:19-22.
14. Cheng P. From covariation to causation: A causal power theory. Psychological Review 1997, 104:367-405.
15. Doshi-Velez, F., Miller, K. T., Van Gael, J., & Teh, Y. W. (2009). Variational inference for the Indian buffet process. In Proceedings of the 12th international conference on artificial intelligence and statistics, Journal of Machine Learning Research (pp. 137-144). Clearwater Beach, FL.
16. Ernst M.O., Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 2002, 415:429-433.
17. Fiser J., Aslin R.N. Unsupervised statistical learning of higher-order spatial structures from visual scenes. Psychological Science 2001, 12:499-504.
18. Garner W.R. The processing of information and structure 1974, Erlbaum, Maryland.
19. Geman S., Geman D. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 1984, 6:721-741.
20. Goldmeier E. Similarity in visually perceived forms. Psychological Issues 1936/1972, 8:1-136.
21. Goldstone R.L. The role of similarity in categorization: Providing a groundwork. Cognition 1994, 52(2):125-157.
22. Goldstone R.L. Perceptual learning. Annual Review of Psychology 1998, 49:585-612.
23. Goldstone R.L. Unitization during category learning. Journal of Experimental Psychology: Human Perception and Performance 2000, 26:86-112.
24. Goldstone R.L. Learning to perceive while perceiving to learn. Perceptual organization in vision: Behavioral and neural perspectives 2003, 233-278. Lawerence Erlbaum Associates, Mahwah, NJ.
25. Goldwater S., Griffiths T.L., Johnson M. A Bayesian framework for word segmentation: Exploring the effects of context. Cognition 2009, 112:21-54.
26. Goodman N. Seven strictures on similarity. Problems and projects 1972, 35-41. The Bobbs-Merrill Co, New York. N. Goodman (Ed.).
27. Green P., Richardson S. Modelling heterogeneity with and without the Dirichlet process. Scandinavian Journal of Statistics 2001, 28:355-377.
28. Griffiths T.L., Ghahramani Z. Infinite latent feature models and the Indian buffet process. Advances in neural information processing systems 2006, Vol. 18. MIT Press, Cambridge, MA.
29. Griffiths T.L., Kemp C., Tenenbaum J.B. Bayesian models of cognition. Cambridge handbook of computational cognitive modeling 2008, 59-100. Cambridge University Press, Cambridge. R. Sun (Ed.).
30. Griffiths T.L., Tenenbaum J.B. Structure and strength in causal induction. Cognitive Psychology 2005, 51:354-384.
31. Hall G. Perceptual and associative learning 1991, Clarendon, Oxford.
32. Hansen L.K., Ahrendt P., Larsen J. Towards cognitive component analysis. International and interdisciplinary conference on adaptive knowledge representation and reasoning 2005, 148-153. Pattern Recognition Society of Finland, Finnish Artificial Intelligence Society, Finnish Cognitive Linguistics Society.
33. Hochberg J., McAlister E. A quantitative approach to figural "goodness" Journal of Experimental Psychology 1953, 46(5):361-364.
34. Hoffman D.D., Richards W.A. Parts in recognition. Cognition 1985, 18:65-96.
35. Hyvarinen A. Fast and robust fixed-point algorithm for independent component analysis. IEEE Transactions on Neural Networks 1999, 10(3):626-634.
36. Hyvarinen A., Karhunen J., Oja E. Independent component analysis 2001, Wiley, New York.
37. Jordan M. An introduction to linear algebra in parallel distributed processing. Foundations 1986, Vol. 1:365-421. MIT Press, Cambridge, MA. D.E. Rumelhart, J.L. McClelland (Eds.).
38. Kirkham N.Z., Slemmer J.A., Johnson S.P. Visual statistical learning in infancy: Evidence of a domain general learning mechanism. Cognition 2002, 83:B35-B42.
39. Koerding K.P., Wolpert D.M. Bayesian integration in sensorimotor learning. Nature 2004, 427:244-248.
40. Kruschke J.K. Alcove: An exemplar-based connectionist model of category learning. Psychological Review 1992, 99:22-44.
41. Leeuwenberg E. Quantification of certain visual pattern properties: Salience, transparency, similarity. Formal theories of visual perception 1978, 277-297. Wiley, New York.
42. Levy, R., Reali, F., & Griffiths, T. L. (2009). Modeling the effects of memory on human online sentence processing with particle filters. In Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (Eds.), Advances in neural information processing systems (Vol. 21, pp. 937-944).
43. Lin E.L., Murphy G.L. Effects of background knowledge on object categorization and part detection. Journal of Experimental Psychology: Human Perception and Performance 1997, 23(4):1153-1169.
44. Lombrozo T. Simplicity and probability in causal explanation. Cognitive Psychology 2007, 55:232-257.
45. Luce R.D. Individual choice behavior 1959, John Wiley, New York.
46. Marr D. Vision 1982, W. H. Freeman, San Francisco, CA.
47. Medin D.L., Altom M.W., Edelson S.M., Freko D. Correlated symptoms and simulated medical classification. Journal of Experimental Psychology: Learning, Memory, and Cognition 1982, 8(1):37-50.
48. Medin D.L., Goldstone R., Gentner D. Respects for similarity. Psychological Review 1993, 100:254-278.
49. Miller K.T., Griffiths T.L., Jordan M.I. The phylogenetic Indian buffet process: A non-exchangeable nonparameteric prior for latent features. Proceedings of the twenty-fourth conference on uncertainity in artificial intelligence 2008, 403-410. AUAI Press, Corvallis, Oregon. D. McAllester, P. Myllymaki (Eds.).
50. Minka T. Automatic choice of dimensionality for PCA. Advances in neural information processing systems 2001, Vol. 13. MIT Press, Cambridge, MA, pp. 598-604.
51. Murphy G.L., Medin D.L. The role of theories in conceptual coherence. Psychological Review 1985, 92:289-316.
52. Nosofsky R.M. Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General 1986, 115:39-57.
53. Rational models of cognition 1998, Oxford University Press, Oxford. M. Oaksford, N. Chater (Eds.).
54. Olshausen B., Field D. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 1996, 381:607-609.
55. Orban G., Fiser J., Aslin R.N., Lengyel M. Bayesian learning of visual chunks by human observers. Proceedings of the National Academy of Sciences 2008, 105(7):2745-2750.
56. Palmer S.E. Hierarchical structure in perceptual representation. Cognitive Psychology 1977, 9:441-474.
57. Palmer S.E. Goodness, Gestalt, groups, and Garner: Local symmetry subgroups as a theory of figural goodness. The perception of structure: Essays in honor of Wendell R. Garner 1991, 23-39. American Psychological Association, Washington, DC. G.R. Lockhead, J.R. Pomerantz (Eds.).
58. Palmer S.E. Vision science: Photons to phenomenology 1999, MIT Press, Cambridge, Massachusetts.
59. Palmer S.E. Perceptual organization and grouping. Perceptual organization in vision: Behavioral and neural perspectives 2003, 3-43. Lawerence Erlbaum Associates, Mahwah, NJ.
60. Perruchet P., Vinter A. PARSER: A model for word segmentation. Journal of Memory and Language 1998, 39:246-263.
61. Pevtzow R., Goldstone R.L. Categorization and the parsing of objects. Proceedings of the sixteenth annual conference of the cognitive science society 1994, 712-722. Lawrence Erlbaum Associates, Hillsdale, NJ.
62. Rasmussen C.E., Ghahramani Z. Occam's razor. Advances in neural information processing systems 2001, Vol. 13:294-300. MIT Press, Cambridge, MA.
63. Reed S.K. Pattern recognition and categorization. Cognitive Psychology 1972, 3:393-407.
64. Saffran J.R., Aslin R.N., Newport E.L. Statistical learning by 8-month old infants. Science 1996, 274:1926-1928.
65. Sanborn A.N., Griffiths T.L., Navarro D.J. A more rational model of categorization. Proceedings of the 28th annual conference of the cognitive science society 2006, 726-731. Erlbaum, Mahwah, NJ. R. Sun, N. Miyake (Eds.).
66. Schyns P.G., Murphy G.L. The ontogeny of part representation in object concepts. The psychology of learning and motivation 1994, Vol. 31:5-354. Academic Press, San Diego.
67. Schyns P.G., Rodet L. Categorization creates functional features. Journal of Experimental Psychology: Learning, Memory, and Cognition 1997, 23:681-696.
68. Shepard R.N. Towards a universal law of generalization for psychological science. Science 1987, 237:1317-1323.
69. Shiffrin R.M., Lightfoot N. Perceptual learning of alphanumeric-like characters. The psychology of learning and motivation 1997, Vol. 36:45-82. Academic Press, San Diego.
70. Solan Z., Horn D., Ruppin E., Edelman S. Unsupervised learning of natural languages. Proceedings of the National Academy of Sciences 2005, 102(33):11629-11634.
71. Spelke E.S. Principles of object perception. Cognitive Science 1990, 14:29-56.
72. Spratling M.W. Learning image components for object recognition. Journal of Machine Learning Research 2006, 7:793-815.
73. Thibaux R., Jordan M.I. Hierarchical beta processes and the Indian buffet process. Eleventh international conference on artificial intelligence and statistics (AISTATS 2007) 2007, 564-571. Omnipress, San Juan, Puerto Rico. M. Meila, X. Shen (Eds.).
74. Tversky A. Features of similarity. Psychological Review 1977, 84:327-352.
75. Ullman S. Object recognition and segmentation by a fragment-based hierarchy. Trends in Cognitive Sciences 2007, 11(2):58-64.
76. van der Helm P.A., Leeuwenberg E.L.J. Goodness of visual regularities: A nontransformational approach. Psychological Review 1996, 103(3):429-456.
77. Van Gael J., Teh Y.W., Ghahramani Z. The infinite factorial hidden Markov model. Advances in neural information systems 2009, Vol. 21:1697-1704. MIT Press, Cambridge, MA.
78. Venkataraman A. A statistical model for word discovery in transcribed speech. Computational Linguistics 2001, 27:352-372.
79. Weiss Y., Simoncelli E.P., Adelson E.H. Motion illusions as optimal percepts. Nature Neuroscience 2002, 5:598-604.
80. Wertheimer M. Laws of organization in perceptual forms. A source book of Gestalt psychology 1938, 71-88. Routledge and Kegan Paul, London.
81. Wood F., Griffiths T.L. Particle filtering for nonparametric Bayesian matrix factorization. Advances in neural information processing systems 2007, Vol. 19:1513-1520. MIT Press, Cambridge, MA.
82. Wood F., Griffiths T.L., Ghahramani Z. A non-parametric Bayesian method for inferring hidden causes. Proceeding of the 22nd conference on uncertainty in artificial intelligence 2006, 536-543. AUAI Press, Cambridge, MA.
83. Zhu S.-C. Embedding Gestalt laws in Markov random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence 1999, 21(11):1170-1187.