SAwSu: An Integrated Model of Associative and Reinforcement Learning

Cognitive Science

Volumn 38, Issue 3, 2014, Pages 580-598

  Veksler, Vladislav D ^a   Myers, Christopher W ^a   Gluck, Kevin A ^a  

^a AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

Associative learning; Cognitive modeling; Cognitive system; Decision making; Integrated models; Learning; Reinforcement learning

Indexed keywords

HUMAN; LEARNING; PSYCHOLOGICAL MODEL; REINFORCEMENT; REWARD;

ASSOCIATION LEARNING; HUMANS; MODELS, PSYCHOLOGICAL; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84899087864     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/cogs.12103     Document Type: Article

References (45)

1. Alonso, E., & Mondragón, E. (2006). Associative learning for reinforcement learning: Where animal learning and machine learning meet. In E. Alonso, & Z. Guessoum (Eds.), Proceedings of the Fifth Symposium on Adaptive Agents and Multi-Agent Systems (pp. 87-99). Paris, France.
2. Anderson, J. R. (1993). Rules of the mind. Hillsdale, NJ: Lawrence Erlbaum Associates.
3. Anderson, J. R. (2001). Activation, latency, and the fan effect. In Eighth annual act-r workshop. Pittsburgh, PA. Available at http://act-r.psy.cmu.edu/workshops/workshop-2001/talks/JRAactivation.pdf.
4. Anderson, J. R. (2007). How can the human mind occur in the physical universe? Oxford series on cognitive models and architectures. Oxford, UK: Oxford University Press.
5. Anderson, J. R., & Lebiere, C. (1998). The atomic components of thought. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
6. Anderson, J. R., & Schooler, L. J. (1991). Reflections of the environment in memory. Psychological Science, 2(6), 396-408.
7. Blodgett, H. C. (1929). The effect of the introduction of reward upon the maze performance of rats. University of California Publications in Psychology, 4, 113-134.
8. Choi, D., & Ohlsson, S. (2011). Effects of multiple learning mechanisms in a cognitive architecture. In L. Carlson, C. Hoelscher, & T. F. Shipley (Eds.), Proceedings of the Thirty-Third Annual Meeting of the Cognitive Science Society (pp. 3003-3008). Boston, MA: Cognitive Science Society.
9. Chun, M. M. (2000). Contextual cueing of visual attention. Trends in Cognitive Sciences, 4(5), 170-178.
10. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8(12), 1704-1711.
11. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron, 69(6), 1204-1215.
12. Dickinson, A., & Balleine, B. (1993). Actions and responses: The dual psychology of behaviour. Spatial representation: Problems in philosophy and psychology. In N. Eilan, R. McCarthy, & B. Brewer (Eds.), Spatial representation: Problems in philosophy and psychology (pp. 277-293). New York: Oxford University Press.
13. Dickinson, A., & Balleine, B. (1994). Motivational control of goal-directed action. Animal Learning & Behavior, 22(1), 1-18.
14. Fu, W. T., & Anderson, J. R. (2006). From recurrent choice to skilled learning: A reinforcement learning model. Journal of Experimental Psychology: General, 135(2), 184-206.
15. Fu, W. T., & Anderson, J. R. (2008). Dual learning processes in interactive skill acquisition. Journal of Experimental Psychology: Applied, 14(2), 179-191.
16. Fu, W. T., & Pirolli, P. (2007). SNIF-ACT A: Cognitive model of user navigation on the world wide web. Human-Computer Interaction, 22(4), 355-412.
17. Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. (2010). States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66(4), 585-595.
18. Gluck, K. A. (2010). Cognitive architectures for human factors in aviation. In E. Salas & D. Maurino (Eds.), Human factors in aviation, 2nd edn (pp. 375-400). New York, NY: Elsevier.
19. Gray, W. D. (2007a). Composition and control of integrated cognitive systems. In W. D. Gray (Ed.), Integrated models of cognitive systems. New York: Oxford University Press.
20. Gray, W. D. (Ed.). (2007b). Integrated models of cognitive systems. New York: Oxford University Press.
21. Harris, J. (2008). MindModeling@Home: A large-scale computational cognitive modeling infrastructure. In The sixth annual conference on systems engineering research (pp. 246-252). Los Angeles, CA.
22. Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4), 679-709.
23. Laird, J. E. (2008). Extending the Soar cognitive architecture. In P. Wang, B. Goertzel, & S. Franklin (Eds.), Artificial General Intelligence 2008 (pp. 224-235). Memphis, TN: IOS Press.
24. Lovett, M. C., & Schunn, C. D. (1999). Task representations, strategy variability, and base-rate neglect. Journal of Experimental Psychology-General, 128(2), 107-130.
25. Lovett, M. C., & Schunn, C. D. (2000). The importance of frameworks for directing empirical questions: Reply to Goodie and Fantino (2000). Journal of Experimental Psychology-General, 129(4), 453-456.
26. Lovett, M. C., & Anderson, J. R. (1996). History of success and current context in problem solving- Combined influences on operator selection. Cognitive Psychology, 31(2), 168-217.
27. Meyer, D. E., & Kieras, D. E. (1997). A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. Psychological Review, 104(4), 749-791.
28. Myers, C. W., & Gray, W. D. (2010). Visual scan adaptation during repeated visual search. Journal of Vision, 8(10).
29. Myers, C. W., Gray, W. D., & Sims, C. R. (2012). The insistence of vision: Why do people look at a salient stimulus when it signals target absence? Visual Cognition, 9(19), 1122-1157.
30. Nason, S., & Laird, J. I. (2005). Soar-RL: Integrating reinforcement learning with Soar. Cognitive Systems Research, 6, 51-59.
31. Newell, A. (1973). You can't play 20 questions with nature and win: Projective comments on the papers of this symposium. In W. G. Chase (Ed.), Visual information processing (pp. 283-308). New York: Academic Press, Inc.
32. Peters, J., Vijayakumar, S., & Schaal, S. (2003). Reinforcement learning for humanoid robotics. In Humanoids2003, third ieee-ras international conference on humanoid robots. Karlsruhe, Germany, Sept. 29-30.
33. Quartermain, D., & Scott, T. H. (1960). Incidental learning in a simple task. Canadian Journal of Psychology/Revue Canadienne de Psychologie, 14(3), 175-182.
34. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In P. W. F. Black AH (Ed.), Classical conditioning ii: current research and theory (pp. 64-99). New York: Appleton Century Crofts.
35. Russell, S. J., & Norvig, P. (1995). Artificial intelligence: A modern approach. Upper Saddle River, NJ: Prentice Hall.
36. Schunn, C. D., Lovett, M. C., & Reder, L. M. (2001). Awareness and working memory in strategy adaptivity. Memory and Cognition, 29(2), 254-266.
37. Shen, J., Reingold, E. M., & Pomplun, M. (2000). Soar-RL: Integrating reinforcement learning with Soar. Perception, 29, 241-250.
38. Siegler, R. S., & Stern, E. (1998). Conscious and unconscious strategy discoveries: A microgenetic analysis. Journal of Experimental Psychology: General, 127(4), 377-397.
39. Stevenson, H. W. (1954). Latent learning in children. Journal of Experimental Psychology, 47(1), 17-21.
40. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: The MIT Press.
41. Taatgen, N. A., & Lee, F. J. (2003). Production composition: A simple mechanism to model complex skill acquisition. Human Factors, 45(1), 61-76.
42. Tolman, E. C. (1948). Cognitive maps in rats and men. Psychological Review, 55(4), 189-208.
43. Veksler, V. D., Gray, W. D., & Schoelles, M. J. (2013). Goal-proximity decision making. Cognitive Science, 37(4), 1-18.
44. Voicu, H., & Schmajuk, N. (2002). Latent learning, shortcuts and detours: A computational model. Behavioural Processes, 59(2), 67-86.
45. Widrow, B., & Hoff, M. (1960). Adaptive switching circuits. In 1960 IRE Wescon convention record (pp. 96-104). New York: Institute of Radio Engineers.