Is it better to select or to receive? Learning via active and passive hypothesis testing

Journal of Experimental Psychology: General

Volumn 143, Issue 1, 2014, Pages 94-122

  Markant, Douglas B ^a   Gureckis, Todd M ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Bayesian modeling; Category learning; Hypothesis testing; Hypothesisdependent sampling bias; Self directed learning

Indexed keywords

ARTICLE; ATTENTION; BAYES THEOREM; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DECISION MAKING; HUMAN; LEARNING; MOTIVATION; RANDOMIZED CONTROLLED TRIAL; REACTION TIME;

ATTENTION; BAYES THEOREM; DECISION MAKING; HUMANS; LEARNING; MOTIVATION; REACTION TIME;

EID: 84893373714     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0032108     Document Type: Article

References (106)

1. Ashby, F. G., Alfonso-Reese, L. A., Turken, U., & Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442-481.
2. Ashby, F., Boynton, G., & Lee, W. (1994). Categorization response time with multidimensional stimuli. Perception & Psychophysics, 55, 11-27.
3. Ashby, F. G., Maddox, W. T., & Bohil, C. J. (2002). Observational versus feedback training in rule-based and information-integration category learning. Memory & Cognition, 30, 666-677.
4. Ashby, F., Paul, E., & Maddox, W. (2011). COVIS. In E. Pothos & A. Willis (Eds. ), Formal approaches in categorization (pp. 65-87). New York, NY: Cambridge University Press.
5. Ashby, F., Queller, S., & Berretty, P. (1999). On the dominance of unidimensional rules in unsupervised categorization. Perception & Psychophysics, 61, 1178-1199.
6. Atkinson, R. (1972a). Ingredients for a theory of instruction. American Psychologist, 27, 921-931.
7. Atkinson, R. (1972b). Optimizing the learning of a second-language vocabulary. Journal of Experimental Psychology, 96, 124-129.
8. Austerweil, J., & Griffiths, T. (2008). A rational analysis of confirmation with deterministic hypotheses. In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 1041-1046). Austin, TX: Cognitive Science Society.
9. Bacon, F. (1902). Novum organum. New York, NY: P. F. Collier. (Original work published 1620)
10. Bonawitz, E., & Griffiths, T. (2010). Deconfounding hypothesis generation and evaluation in Bayesian models. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd Annual Conference of the Cognitive Science Society (pp. 2260-2265). Austin, TX: Cognitive Science Society.
11. Brown, S., & Steyvers, M. (2009). Detecting and predicting changes. Cognitive Psychology, 58, 49-67.
12. Bruner, J. (1961). The act of discovery. Harvard Educational Review, 31, 21-32.
13. Bruner, J., Goodnow, J., & Austin, G. (1956). A study of thinking. New York, NY: John Wiley and Sons.
14. Bruner, J., Jolly, A., & Sylva, K. (1976). Play: Its role in development and evolution. New York, NY: Basic Books.
15. Carey, S. (1978). The child as word learner. In M. Halle, J. Bresnan, & G. Miller (Eds.), Linguistic theory and psychological reality (pp. 264-293). Oxford, United Kingdom: MIT Press.
16. Castro, R., Kalish, C., Nowak, R., Qian, R., Rogers, T., & Zhu, X. (2009). Human active learning. In D. Koller, D. Schuurmans, Y. Bengio, & L. Bottou (Eds.), Advances in neural information processing systems (Vol. 21, pp. 241-249). Retrieved from: http://books.nips.cc/nips21.html
17. Chi, M. (2009). Active-constructive-interactive: A conceptual framework for differentiating learning activities. Topics in Cognitive Science, 1, 73-105.
18. Cohn, D., Atlas, L., & Ladner, R. (1992). Improving generalization with active learning. Machine Learning, 15, 201-221.
19. Dasgupta, S., Kalai, A., & Monteleoni, C. (2005). Analysis of perceptronbased active learning. In P. Auer & R. Meir (Eds.), 18th Annual Conference on Learning Theory, COLT 2005 (pp. 249-263). Bertinoro, Italy: Springer.
20. Denrell, J., & Le Mens, G. (2011). Seeking positive experiences can produce illusory correlations. Cognition, 119, 313-324.
21. Elio, R., & Lin, K. (1994). Simulation models of the influence of learning mode and training variance on category learning. Cognitive Science, 18, 185-218.
22. Enkvist, T., Newell, B., Juslin, P., & Olsson, H. (2006). On the role of causal intervention in multiple-cue judgment: Positive and negative effects on learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 163-179.
23. Erickson, M., & Kruschke, J. (1998). Rules and exemplars in category learning. Journal of Experimental Psychology: General, 127, 107-140.
24. Fazio, R., Eiser, J., & Shook, N. (2004). Attitude formation through exploration: Valence asymmetries. Journal of Personality and Social Psychology, 87, 293-311.
25. Feldman, J. (2000). Minimization of Boolean complexity in human concept learning. Nature, 407, 630-633.
26. Garner, W., & Felfoldy, G. (1970). Integrality of stimulus dimensions in various types of information processing. Cognitive Psychology, 1, 225-241.
27. Gigerenzer, G. (2006). What's in a sample? A manual for building cognitive theories. In K. Fiedler &, P. Juslin (Eds.), Information sampling and adaptive cognition (pp. 239-260). Cambridge, United Kingdom: Cambridge University Press.
28. Ginzberg, I., & Sejnowski, T. (1996). Dynamics of rule induction by making queries: Transition between strategies. In Proceedings of the 18th Annual Conference of the Cognitive Science Society (pp. 121-125). Hillsdale, NJ: Lawrence Erlbaum Associates.
29. Gregg, L., & Simon, H. (1967). Process models and stochastic theories of simple concept formation. Journal of Mathematical Psychology, 4, 246-276.
30. Gregory, R. (1970). The intelligent eye. New York, NY: McGraw-Hill.
31. Gregory, R. (1974). Choosing a paradigm for perception. In E. Carterett & M. Friedman (Eds.), Handbook of perception: Historical and philosophical roots of perception (Vol. 1, pp. 255-283). New York, NY: Academic Press.
32. Gureckis, T., & Love, B. (2002). Who says models can only do what you tell them? Unsupervised category learning data, fits, and predictions. In Proceedings of the 24th Annual Conference of the Cognitive Science Society (pp. 399-404). Hillsdale, NJ: Lawrence Erlbaum Associates.
33. Gureckis, T., & Markant, D. (2009). Active learning strategies in a spatial concept learning game. In N. Taatgen, H. van Rijn, L. Schomaker, & J. Nerbonne (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 3145-3150). Austin, TX: Cognitive Science Society.
34. Gureckis, T. M., & Markant, D. B. (2012). Self-directed learning: A cognitive and computational perspective. Perspectives on Psychological Science, 7, 464-481.
35. Gweon, H., Tenenbaum, J., & Schultz, L. (2010). Infants consider both the sample and the sampling process in inductive generalization. Proceedings of the National Academy of Sciences, 107, 9066-9071.
36. Heller, K., Sanborn, A. N., & Chater, N. (2009). Hierarchical learning of dimensional biases in human categorization. In J. Lafferty & C. Williams (Eds.), Advances in neural information processing systems (Vol. 22, pp. 727-736). Retrieved from http://books.nips.cc/nips22.html
37. Hunt, E. (1965). Selection and reception conditions in grammar and concept learning. Journal of Verbal Learning and Verbal Behavior, 4, 211-215.
38. Huttenlocher, J. (1962). Effects of manipulation of attributes on efficiency of concept formation. Psychological Reports, 10, 503-509.
39. Kemp, C. (2012). Exploring the conceptual universe. Psychological Review, 119, 685-722.
40. Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effects of direct instruction and discovery learning. Psychological Science, 15, 661-667.
41. Klayman, J., & Ha, Y. (1987). Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review, 94, 211-228.
42. Kolb, D. (1984). Experiential learning: Experience as the source of learning and development. Englewood Cliffs, NJ: Prentice Hall.
43. Kruschke, J. (1992). ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review, 99, 22-44.
44. Kruschke, J. (1993). Human category learning: Implications for backpropagation models. Connection Science, 5, 3-36.
45. Kuhn, D., & Ho, V. (1980). Self-directed activity and cognitive development. Journal of Applied Developmental Psychology, 1, 119-133.
46. Lagnado, D. A., & Sloman, S. (2004). The advantage of timely intervention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 856-876.
47. Lagnado, D., & Sloman, S. (2006). Time as a guide to cause. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 451-460.
48. Laughlin, P. R. (1972). Selection versus reception concept-attainment paradigms for individuals and cooperative pairs. Journal of Educational Psychology, 63, 116-122.
49. Laughlin, P. (1975). Selection versus reception concept-attainment paradigms. Journal of Experimental Psychology: Human Learning and Memory, 1, 319-325.
50. Love, B., Medin, D., & Gureckis, T. (2004). SUSTAIN: A network model of category learning. Psychological Review, 111, 309-332.
51. Mackay, D. (1992). Information-based objective functions for active data selection. Neural Computation, 4, 590-604.
52. Maddox, W. T., & Ashby, F. G. (2004). Dissociating explicit and procedural-learning based systems of perceptual category learning. Behavioural Processes, 66, 309-332.
53. Markant, D., & Gureckis, T. (2012). One piece at a time: Learning complex rules through self-directed sampling. In N. Miyake, D. Peebles, & R. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp. 725-730). Austin, TX: Cognitive Science Society.
54. Metropolis, N., & Ulam, S. (1949). The Monte Carlo method. Journal of the American Statistical Association, 44, 335-341.
55. Millward, R., & Spoehr, K. (1973). The direct measurement of hypothesissampling strategies. Cognitive Psychology, 4, 1-38.
56. Mitchell, T. (1997). Machine learning. New York, NY: McGraw-Hill.
57. Montessori, M. (1964). The Montessori method. New York, NY: Schocken. (Original work published 1912)
58. Murphy, K. (2001). Active learning of causal Bayes net structure (Technical report). Berkeley, California: Department of Computer Science, University of California, Berkeley.
59. Navarro, D., Dry, M., & Lee, M. (2012). Sampling assumptions in inductive generalization. Cognitive Science, 36, 187-223.
60. Navarro, D., & Perfors, A. (2011). Hypothesis generation, the positive test strategy, and sparse categories. Psychological Review, 118, 120-134.
61. Nelson, J. (2005). Finding useful questions: On Bayesian diagnosticity, probability, impact, and information gain. Psychological Review, 112, 979-999.
62. Nelson, J., McKenzie, C., Cottrell, G., & Sejnowski, T. (2010). Experience matters: Information acquisition optimizes probability gain. Psychological Science, 21, 960-969.
63. Nickerson, R. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2, 175-220.
64. Nosofsky, R. M. (1984). Choice, similarity, and the context theory of classification. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 104-114.
65. Nosofsky, R. (1989). Further tests of an exemplar-similarity approach to relating identification and categorization. Perception & Psychophysics, 45, 279-290.
66. Nosofsky, R., & Palmeri, T. (1998). A rule-plus-exception model for classifying objects in continuous-dimension spaces. Psychonomic Bulletin & Review, 5, 345-369.
67. Nosofsky, R. M., Palmeri, T. J., & McKinley, S. C. (1994). Rule-plusexception model of classification learning. Psychological Review, 101, 53-79.
68. Oaksford, M., & Chater, N. (1994). A rational analysis of the selection task as optimal data selection. Psychological Review, 101, 608-631.
69. Papert, S. (1980). Mindstorms: Children, computers, and powerful ideas. New York, NY: Basic Books.
70. Pearl, J. (2000). Causality: Models, reasoning, and inference. New York, NY: Cambridge University Press.
71. Piaget, J. (1930). The child's conception of physical causality. New York, NY: Harcourt, Brace.
72. Platt, J. (1964). Strong inference. Science, 146, 347-353.
73. Poletiek, F. (2011). Hypothesis-testing behavior. Hove, UK: Psychology Press.
74. Popper, K. (1959). The logic of scientific discovery. London, United Kingdom: Hutchinson. (Original work published 1935)
75. Schmidhuber, J. (1991). Curious model-building control systems. In Proceedings of the International Joint Conference on Neural Networks (pp. 1458-1463). Singapore: IEEE.
76. Schober, M., & Clark, H. (1989). Understanding by addressees and overhearers. Cognitive Psychology, 21, 211-232.
77. Schwartz, S. H. (1966). Trial-by-trial analysis of processes in simple and disjunctive concept-attainment tasks. Journal of Experimental Psychology, 72, 456-465.
78. Settles, B. (2009). Active learning literature survey (Computer Sciences Technical Report 1648). Madison: University of Wisconsin-Madison.
79. Shafto, P., & Goodman, N. (2008). Teaching games: Statistical sampling assumptions for learning in pedagogical situations. In B. Love, K. McRae, & V. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 1632-1637). Austin, TX: Cognitive Science Society.
80. Shafto, P., Goodman, N., & Frank, M. (2012). Learning from others: The consequences of psychological reasoning for human learning. Perspectives on Psychological Science, 7, 341-351.
81. Shepard, R. (1964). Attention and the metric structure of the stimulus space. Journal of Mathematical Psychology, 1, 54-87.
82. Shepard, R., Hovland, C., & Jenkins, H. (1961). Learning and memorization of classifications. Psychological Monographs: General and Applied, 75, 1-42.
83. Siskind, J. (1996). A computational study of cross-situational techniques for learning word-to-meaning mappings. Cognition, 61, 39-61.
84. Skov, R., & Sherman, S. (1986). Information-gathering processes: Diagnosticity, hypothesis-confirmatory strategies, and perceived hypothesis confirmation. Journal of Experimental Social Psychology, 22, 93-121.
85. Smalley, N. (1974). Modes of extracting information in concept attainment as a function of selection versus reception paradigms. Journal of Experimental Psychology, 102, 56-61.
86. Snyder, M., & Swann, W. (1978). Hypothesis-testing processes in social interaction. Journal of Personality and Social Psychology, 36, 1202-1212.
87. Sobel, D., & Kushnir, T. (2006). The importance of decision making in causal learning from interventions. Memory & Cognition, 34, 411-419.
88. Steffe, L., & Gale, J. (1995). Constructivism in education. Hillsdale, NJ: Lawrence Erlbaum Associates.
89. Steyvers, M., Tenenbaum, J., Wagenmakers, E., & Blum, B. (2003). Inferring causal networks from observations and interventions. Cognitive Science, 27, 453-489.
90. Tenenbaum, J. B. (1999). Bayesian modeling of human concept learning. In M. Kearns, S. Solla, & D. Cohn (Eds.), Advances in neural information processing systems (Vol. 11, pp. 59-65). Cambridge, MA: MIT Press.
91. Tenenbaum, J., & Griffiths, T. (2001). Generalization, similarity, and Bayesian inference. Behavioral and Brain Sciences, 24, 629-640.
92. Thomas, R., Dougherty, M., Sprenger, A., & Harbison, J. (2008). Diagnostic hypothesis generation and human judgment. Psychological Review, 115, 155-185.
93. Tong, S., & Koller, D. (2001). Active learning for structure in Bayesian networks. In Seventeenth International Joint Conference on Artificial Intelligence (pp. 863-869). Seattle, WA: AAAI Press.
94. Trabasso, T., & Bower, G. (1964). Presolution reversal and dimensional shifts in concept identification. Journal of Experimental Psychology, 67, 398-399.
95. Trabasso, T., & Bower, G. (1968). Attention in learning: Theory and research. New York, NY: Wiley.
96. Trope, Y., & Bassok, M. (1982). Confirmatory and diagnosing strategies in social information gathering. Journal of Personality and Social Psychology, 43, 22-34.
97. Trope, Y., & Liberman, A. (1996). Social hypothesis testing: Cognitive and motivational mechanisms. In E. Higgins & A. Kruglanski (Eds.), Social psychology: Handbook of basic principles (pp. 239-270). New York, NY: Guilford Press.
98. Ullman, T., Goodman, N., & Tenenbaum, J. (2010). Theory acquisition as stochastic search. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd Annual Conference of the Cognitive Science Society (pp. 2840-2845). Austin, TX: Cognitive Science Society.
99. Voss, J., Gonsalves, B., Federmeier, K., Tranel, D., & Cohen, N. (2011). Hippocampal brain-network coordination during volitional exploratory behavior enhances learning. Nature Neuroscience, 14, 115-120.
100. Vul, E., Goodman, N., Griffiths, T. L., & Tenenbaum, J. (2009). One and done? Optimal decisions from very few samples. In N. Taatgen, H. van Rijn, L. Schomaker, & J. Nerbonne (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 148-153). Austin, TX: Cognitive Science Society.
101. Vul, E., Tenenbaum, J., Griffiths, T., Levy, R., Steyvers, M., & McKenzie, C. (2009). Sympoisum: Rational process models. In N. Taatgen, H. van Rijn, L. Schomaker, & J. Nerbonne (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 45-46). Austin, TX: Cognitive Science Society.
102. Wason, P. (1960). On the failure to eliminate hypotheses in a conceptual task. The Quarterly Journal of Experimental Psychology, 12, 129-140.
103. Wason, P. (1966). Reasoning. In B. Foss (Ed.), New horizons in psychology I (pp. 135-151). Baltimore, MD: Penguin.
104. Wason, P. (1968). Reasoning about a rule. Quarterly Journal of Experimental Psychology, 20, 273-281.
105. Xu, F., & Tenenbaum, J. (2007a). Sensitivity to sampling in Bayesian word learning. Developmental Science, 10, 288-297.
106. Xu, F., & Tenenbaum, J. (2007b). Word learning as Bayesian inference. Psychological Review, 114, 245-272.