Are People Successful at Learning Sequences of Actions on a Perceptual Matching Task?

Cognitive Science

Volumn 35, Issue 5, 2011, Pages 939-962

  Yakushijin, Reiko ^a   Jacobs, Robert A ^b  

^a AOYAMA GAKUIN UNIVERSITY   (Japan)

^b UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Action learning; Causal learning; Ideal actor; Perceptual matching; Reinforcement learning; Sequential action

Indexed keywords

ADULT; ARTICLE; HUMAN; LEARNING; PHOTOSTIMULATION; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT; VISION;

ADULT; HUMANS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT (PSYCHOLOGY); SERIAL LEARNING; VISUAL PERCEPTION;

EID: 79960129856     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2011.01176.x     Document Type: Article

References (37)

1. Anderson, J. R. (1990). The adaptive character of thought. Hillsdale, NJ: Lawrence Erlbaum Associates.
2. Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences, 20, 723-767.
3. Bellman, R. (1957). Dynamic programming. Princeton, NJ: Princeton University Press.
4. Busemeyer, J. R. (2001). Dynamic decision making. In N. J. Smelser & P. B. Baltes (Eds.), International encyclopedia of the social and behavioral sciences (pp. 3903-3908). Oxford, UK: Pergamon.
5. Busemeyer, J. R., & Pleskac, T. J. (2009). Theoretical tools for understanding and aiding dynamic decision making. Journal of Mathematical Psychology, 53, 126-138.
6. Chhabra, M., & Jacobs, R. A. (2006). Near-optimal human adaptive control across different noise environments. The Journal of Neuroscience, 26, 10883-10887.
7. Cormen, T. H., Leiserson, C. E., Rivest, R. L., & Stein, C. (2001). Introduction to algorithms (2nd ed.). Cambridge, MA: MIT Press.
8. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711.
9. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
10. Daw, N. D., & Touretzky, D. S. (2002). Long-term reward prediction in TD models of the dopamine system. Neural Computation, 14, 2567-2583.
11. Fu, W.-T., & Anderson, J. R. (2006). From recurrent choice to skill learning: A reinforcement-learning model. Journal of Experimental Psychology: General, 135, 184-206.
12. Geisler, W. S. (2004). Ideal observer analysis. In L. M. Chalupa & J. S. Werner (Eds.), The visual neurosciences (pp. 825-837). Cambridge, MA: MIT Press.
13. Gibson, F. P., Fichman, M., & Plaut, D. C. (1997). Learning in dynamic decision tasks: Computational model and empirical evidence. Organizational Behavior and Human Decision Processes, 71, 1-35.
14. Gielis, J. (2003). A generic geometric transformation that unifies a wide range of natural and abstract shapes. American Journal of Botany, 90, 333-338.
15. Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010). States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66, 585-595.
16. Gonzalez, C., Vanyukov, P., & Martin, M. K. (2005). The use of microworlds to study dynamic decision making. Computers in Human Behavior, 21, 273-286.
17. Gopnik, A., & Shulz, L. (2007). Causal learning: Psychology, philosophy, and computation. New York: Oxford University Press.
18. Gray, W. D., Sims, C. R., Fu, W.-T., & Schoelles, M. J. (2006). The soft constraints hypothesis: A rational analysis approach to resource allocation for interactive behavior. Psychological Review, 113, 461-482.
19. Gureckis, T. M., & Love, B. C. (2009a). Learning in noise: Dynamic decision-making in a variable environment. Journal of Mathematical Psychology, 53, 180-193.
20. Gureckis, T. M., & Love, B. C. (2009b). Short-term gains, long-term pains: Reinforcement learning in dynamic environments. Cognition, 113, 293-313.
21. Lee, M. D. (2006). A hierarchical Bayesian model of human decision-making on an optimal stopping problem. Cognitive Science, 30, 1-26.
22. McCallum, R. A. (1993). Overcoming incomplete perception with utile distinction memory. In Proceedings of the 10th International Machine Learning Conference, pp. 190-196. San Francisco: Morgan Kaufmann.
23. Moore, A., & Atkeson, C. (1993). Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning, 13, 103-130.
24. Neth, H., Sims, C. R., & Gray, W. D. (2005). Melioration despite more information: The role of feedback frequency in stable suboptimal performance. In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, pp. 627-632. Santa Monica, CA: Human Factors and Ergonomics Society.
25. Neth, H., Sims, C. R., & Gray, W. D. (2006). Melioration dominates maximization: Stable suboptimal performance despite global feedback. In Proceedings of the 28th Annual Meeting of the Cognitive Science Society, pp. 627-632. Mahwah, NJ: Erlbaum.
26. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1598.
27. Shanks, D. R., Tunney, R. J., & McCarthy, J. D. (2002). A re-examination of melioration and rational choice. Journal of Behavioral Decision Making, 15, 233-250.
28. Si, J., Barto, A. G., Powell, W. B., & Wunsch, D. (2004). Handbook of learning and approximate dynamic programming. Piscataway, NJ: Wiley-IEEE.
29. Stankiewicz, B. J., Legge, G. E., Mansfield, J. S., & Schlicht, E. J. (2006). Lost in virtual space: Studies in human and ideal spatial navigation. Journal of Experimental Psychology: Human Perception and Performance, 32, 688-704.
30. Stanley, W. B., Mathews, R. C., Buss, R. R., & Kotler-Cope, S. (1989). Insight without awareness: On the interaction of verbalization, instruction, and practice in a simulated process control task. Quarterly Journal of Experimental Psychology, 41A, 553-577.
31. Stephens, D. W., & Krebs, J. R. (1986). Foraging theory. Princeton, NJ: Princeton University Press.
32. Sun, R., Slusarz, P., & Terry, C. (2005). The interaction of the explicit and the implicit in skill learning: A dual-process approach. Psychological Review, 112, 159-192.
33. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
34. Todorov, E. (2004). Optimality principles in sensorimotor control. Nature Neuroscience, 7, 907-915.
35. Watkins, C. J. C. H. (1989). Learning from delayed rewards. Unpublished doctoral dissertation. Cambridge, UK: Cambridge, University.
36. Watkins, C. J. C. H., & Dayan, P. (1992). Q-learning. Machine Learning, 8, 279-292.
37. Whitehead, S. D., & Ballard, D. H. (1991). Learning to perceive and act by trial and error. Machine Learning, 7, 45-83.