Metacognitive monkeys or associative animals? Simple reinforcement learning explains uncertainty in nonhuman animals

Journal of Experimental Psychology: Learning Memory and Cognition

Volumn 38, Issue 3, 2012, Pages 686-708

  Le Pelley, M E ^a,b  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Associative learning; Comparative psychology; Metacognition; Metamemory; Monkeys; Reinforcement learning

Indexed keywords

ANIMAL; ARTICLE; COGNITION; COMPUTER SIMULATION; DECISION MAKING; FEEDBACK SYSTEM; HAPLORHINI; HUMAN; LEARNING; PERCEPTION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REINFORCEMENT; UNCERTAINTY;

ANIMALS; ASSOCIATION LEARNING; CHOICE BEHAVIOR; COGNITION; COMPUTER SIMULATION; FEEDBACK, PHYSIOLOGICAL; HAPLORHINI; HUMANS; MODELS, PSYCHOLOGICAL; PERCEPTION; REINFORCEMENT (PSYCHOLOGY); UNCERTAINTY;

EID: 84864669932     PISSN: 02787393     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0026478     Document Type: Article

References (33)

1. Couchman, J. J., Coutinho, M. V. C., Beran, M. J., & Smith, J. D. (2010). Beyond stimulus cues and reinforcement signals: A new approach to animal metacognition. Journal of Comparative Psychology, 124, 356-368. doi:10.1037/a0020129
2. Fechner, G. T. (1966). Elements of psychophysics (H. E. Adler, Trans.). New York, NY: Holt, Rhinehart and Winston. (Original work published 1860)
3. Foote, A. L., & Crystal, J. D. (2007). Metacognition in the rat. Current Biology, 17, 551-555. doi:10.1016/j.cub.2007.01.061
4. Hampton, R. R. (2001). Rhesus monkeys know when they remember. Proceedings of the National Academy of Sciences of the United States of America, 98, 5359-5362. doi:10.1073/pnas.071600998
5. Haselgrove, M. (2010). Reasoning rats or associative animals? A common-element analysis of the effects of additive and subadditive pretraining on blocking. Journal of Experimental Psychology: Animal Behavior Pro-cesses, 36, 296-306. doi:10.1037/a0016603
6. Hebb, D. (1949). The organization of behavior. New York, NY: Wiley.
7. Jozefowiez, J., Staddon, J. E. R., & Cerutti, D. T. (2009). Metacognition in animals: How do we know that they know? Comparative Cognition & Behavior Reviews, 4, 29-39. doi:10.3819/ccbr.2009.40003
8. Kornell, N., Son, L. K., & Terrace, H. S. (2007). Transfer of metacognitive skills and hint seeking in monkeys. Psychological Science, 18, 64-71. doi:10.1111/j.1467-9280.2007.01850.x
9. Mackintosh, N. J. (1983). Conditioning and associative learning. Oxford, England: Clarendon Press.
10. Malenka, R. C., & Nicoll, R. A. (1999). Long-term potentiation: A decade of progress? Science, 285, 1870-1874. doi:10.1126/science .285.5435.1870
11. Metcalfe, J. (2003). Drawing the line on metacognition. Behavioral and Brain Sciences, 26, 350-351. doi:10.1017/S0140525X03340087
12. Mishkin, M., & Delacour, J. (1975). An analysis of short-term visual memory in the monkey. Journal of Experimental Psychology: Animal Behavior Processes, 1, 326-334. doi:10.1037/0097-7403.1.4.326
13. Morgan, C. L. (1903). An introduction to comparative psychology (2nd ed.). London, England: W. Scott.
14. Nelson, T. O. (1996). Consciousness and metacognition. American Psy-chologist, 51, 102-116. doi:10.1037/0003-066X.51.2.102
15. Overman, W. H., & Doty, R. W. (1980). Prolonged visual memory in macaques and man. Neuroscience, 5, 1825-1831. doi:10.1016/0306-4522(80)90032-9
16. Pearce, J. M. (1987). A model for stimulus generalization in Pavlovian conditioning. Psychological Review, 94, 61-73. doi:10.1037/0033-295X.94.1.61
17. Roberts, W. A., & Grant, D. S. (1974). Short-term memory in the pigeon with presentation time precisely controlled. Learning and Motivation, 5, 393-408. doi:10.1016/0023-9690(74)90020-4
18. Roberts, W. A., & Grant, D. S. (1976). Studies of short-term memory in the pigeon using the delayed-matching-to-sample procedure. In D. L. Medin, W. A. Roberts, & R. T. Davis (Eds.), Processes in animal memory (pp. 79-112). Hillsdale, NJ: Erlbaum.
19. Rumbaugh, D. M., Beran, M. J., & Pate, J. L. (2003). Uncertainty moni-toring may promote emergents. Behavioral and Brain Sciences, 26, 353. doi:10.1017/S0140525X03370086
20. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart, J. L. McLelland, & the PDP Research Group (Eds.), Parallel distributed processing (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press.
21. Shields, W. E. (1999). Nonverbal judgments of knowing by humans and rhesus monkey. (Unpublished doctoral dissertation). State University of New York at Buffalo.
22. Smith, J. D., Beran, M. J., Couchman, J. J., & Coutinho, M. V. C. (2008). The comparative study of metacognition: Sharper paradigms, safer in-ferences. Psychonomic Bulletin & Review, 15, 679-691. doi:10.3758/ PBR.15.4.679
23. Smith, J. D., Beran, M. J., Couchman, J. J., Coutinho, M. V. C., & Boomer, J. B. (2009). Animal metacognition: Problems and prospects. Compar-ative Cognition & Behavior Reviews, 4, 40-53. doi:10.3819/ ccbr.2009.40004
24. Smith, J. D., Redford, J. S., Beran, M. J., & Washburn, D. A. (2006). Dissociating uncertainty responses and reinforcement signals in the comparative study of uncertainty monitoring. Journal of Experimental Psychology: General, 135, 282-297. doi:10.1037/0096-3445.135.2.282
25. Smith, J. D., Shields, W. E., Schull, J., & Washburn, D. A. (1997). The uncertain response in humans and animals. Cognition, 62, 75-97. doi: 10.1016/S0010-0277(96)00726-3
26. Son, L. K., & Kornell, N. (2005). Meta-confidence judgements in rhesus macaques: Explicit versus implicit mechanisms. In H. S. Terrace (Ed.), The missing link in cognition: Origins of self-knowing consciousness (pp. 296-320). Oxford, England: Oxford University Press.
27. Spence, K. W. (1936). The nature of discrimination learning in animals. Psychological Review, 43, 427-449. doi:10.1037/h0056975
28. Sutton, R. S., & Barto, A. G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88, 135-170. doi:10.1037/0033-295X.88.2.135
29. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An intro-duction. Cambridge, MA: MIT Press.
30. Terrace, H. S., & Son, L. K. (2009). Comparative metacognition. Current Opinion in Neurobiology, 19, 67-74. doi:10.1016/j.conb.2009.06.004
31. Washburn, D. A., Gulledge, J. P., Beran, M. J., & Smith, J. D. (2010). With his memory magnetically erased, a monkey knows he is uncertain. Biology Letters, 6, 160-162. doi:10.1098/rsbl.2009.0737
32. Washburn, D. A., Smith, J. D., & Shields, W. E. (2006). Rhesus monkeys (Macaca mulatta) immediately generalize the uncertain response. Jour-nal of Experimental Psychology: Animal Behavior Processes, 32, 185-189. doi:10.1037/0097-7403.32.2.185
33. Wright, A. A., Santiago, H. C., Sands, S. F., Kendrick, D. F., & Cook, R. G. (1985). Memory processing of serial lists by pigeons, monkeys, and people. Science, 229, 287-289. doi:10.1126/science.9304205