Associative theories of goal-directed behaviour: A case for animal-human translational models

Psychological Research

Volumn 73, Issue 4, 2009, Pages 463-476

  De Wit, Sanne ^a   Dickinson, Anthony ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; ATTENTION; CULTURAL ANTHROPOLOGY; CYBERNETICS; DECISION MAKING; HABIT; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; MOTIVATION; ORIENTATION; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; RAT; RECALL;

ANIMALS; ASSOCIATION LEARNING; ATTENTION; CONDITIONING, OPERANT; CULTURE; CYBERNETICS; DECISION MAKING; GOALS; HABITS; HUMANS; MENTAL RECALL; MODELS, PSYCHOLOGICAL; MOTIVATION; ORIENTATION; PSYCHOMOTOR PERFORMANCE; RATS;

EID: 67449126861     PISSN: 03400727     EISSN: 14302772     Source Type: Journal    
DOI: 10.1007/s00426-009-0230-6     Document Type: Article

References (91)

1. CD Adams 1982 Variations in the sensitivity of instrumental responding to reinforcer devaluation Quarterly Journal of Experimental Psychology 34B 77 98
2. CD Adams A Dickinson 1981 Instrumental responding following reinforcer devaluation Quarterly Journal of Experimental Psychology 33B 109 121
3. JR Anderson D Bothell MD Byrne S Douglas C Lebiere Y Qin 2004 An integrated theory of mind Psychological Review 111 1036 1060 (Pubitemid 39375086)
4. U Ansorge 2002 Spatial intention-response compatibility Acta Psychologia 109 3 285 299
5. EA Asratyan 1974 Conditional reflex theory and motivated behavior Acta Neurobiologiae Experimentalis 34 15 31
6. B Balleine 2005 Neural basis of food-seeking: affect, arousal, and reward in corticostriatolimbic circuits Physiology and Behavior 86 5 717 730 (Pubitemid 41741866)
7. BW Balleine A Dickinson 1998 Goal-directed instrumental action: contingency and incentive learning and their cortical substrates Neuropharmacology 37 407 419 (Pubitemid 28306930)
8. BW Balleine A Dickinson 1998 The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety Animal Learning & Behavior 26 1 46 59 (Pubitemid 28124631)
9. BW Balleine SB Ostlund 2007 Still at the choice-point: action selection and initiation in instrumental conditioning Annals of the New York Academy of Sciences 1104 147 171 (Pubitemid 47092732)
10. DJ Baxter E Zamble 1982 Reinforcer and response specificity in appetitive transfer of control Animal Learning & Behavior 10 201 210
11. T Beckers J De Houwer P Eelen 2002 Automatic integration of non-perceptual action effect features: the case of the associative affective Simon effect Psychological Research 66 3 166 173
12. P Blundell G Hall S Killcross 2001 Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats Journal of Neuroscience 21 22 9018 9026 (Pubitemid 33054863)
13. S Bray A Rangel S Shimojo B Balleine JP O'Doherty 2008 The neural mechanisms underlying the influence of Pavlovian cues on human decision making Journal of Neuroscience 28 5861 5866
14. Carpenter, W. B. (1852). On the influence of suggestion in modifying and directing muscular movement, independently of volition. Proceedings of the Royal Institution, 1, 147-154.
15. MAD Chutuape SH Mitchell H de Wit 1994 Ethano preloads increase ethanol preference under concurrent random-ratio schedules in social drinkers Experimental and Clinical Psychopharmacology 2 310 318
16. RM Colwill DK Motzkin 1994 Encoding of the Unconditioned Stimulus in Pavlovian Conditioning Animal Learning & Behavior 22 4 384 394 (Pubitemid 24332572)
17. RM Colwill RA Rescorla 1985 Postconditioning devaluation of a reinforcer affects instrumental responding Journal of Experimental Psychology: Animal Behavior Processes 11 1 120 132
18. RM Colwill RA Rescorla 1988 Associations between the discriminative stimulus and the reinforcer in instrumental learning Journal of Experimental Psychology: Animal Behavior Processes 14 2 155 164
19. LH Corbit BW Balleine 2003 The role of prelimbic cortex in instrumental conditioning Behavioural Brain Research 146 145 157 (Pubitemid 37476141)
20. LH Corbit PH Janak BW Balleine 2007 General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area The European Journal of Neuroscience 26 11 3141 3149 (Pubitemid 350135179)
21. LH Corbit JL Muir BW Balleine 2001 The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell Journal of Neuroscience 21 9 3251 3260 (Pubitemid 32323507)
22. LH Corbit JL Muir BW Balleine 2003 Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats European Journal of Neuroscience 18 1286 1294 (Pubitemid 37115047)
23. ND Daw Y Niv P Dayan 2005 Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control Nature Neuroscience 8 12 1704 1711 (Pubitemid 41683198)
24. R de Borchgrave JN Rawlins A Dickinson BW Balleine 2002 Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats Experimental Brain Research 144 1 50 68 (Pubitemid 34439304)
25. S de Wit D Niry R Wariyar MRF Aitken A Dickinson 2007 Stimulus-outcome interactions during conditional discrimination learning by rats and humans Journal of Experimental Psychology: Animal Behavior Processes 33 1 1 11 (Pubitemid 46130121)
26. Dickinson, A. (1994). Instrumental conditioning. In N. J. Mackintosh (Ed.), Animal learning and cognition (pp. 45-79). San Diego, CA: Academic Press.
27. Dickinson, A., & Balleine, B. W. (1993). Actions and responses: the dual psychology of behaviour. In N. Eilan & R. A. McCarthy (Eds.), Spatial representation: problems in philosophy and psychology (pp. 277-293). Malden: Blackwell.
28. A Dickinson B Balleine 1994 Motivational control of goal-directed action Animal Learning & Behavior 22 1 1 18 (Pubitemid 24054214)
29. Dickinson, A., & Balleine, B. (2008). The cognitive/motivational interface. In M. L. Kringelbach & K. C. Berridge (Eds.), Pleasures of the brain. The neural basis of taste, smell and other rewards. Oxford: Oxford University Press.
30. A Dickinson B Balleine A Watt F Gonzalez R Boakes 1995 Motivational control after extended instrumental training Animal Learning & Behavior 23 2 197 206
31. A Dickinson J Campos ZI Varga B Balleine 1996 Bidirectional instrumental conditioning Quarterly Journal of Experimental Psychology 49B 4 289 306 (Pubitemid 126683276)
32. A Dickinson DJ Nicholas CD Adams 1983 The effect of the instrumental training contingency on susceptibility to reinforcer devaluation Quarterly Journal of Experimental Psychology 35B 35 51
33. B Elsner B Hommel 2001 Effect anticipation and action control Journal of Experimental Psychology-Human Perception and Performance 27 1 229 240 (Pubitemid 33594511)
34. B Elsner B Hommel 2004 Contiguity and contingency in action-effect learning Psychological Research 68 2-3 138 154 (Pubitemid 40549807)
35. WK Estes 1943 Discriminative conditioning: I. A discriminative property of conditioned anticipation Journal of Experimental Psychology 32 150 155
36. WK Estes 1948 Discriminative conditioning: II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response Journal of Experimental Psychology 38 173 177
37. Estes, W. K. (1969). Reinforcement in human learning. In J. T. Tapp (Ed.), Reinforcement and Behavior (pp. 63-94). New York: Academic Press.
38. JSBT Evans 2003 In two minds: dual process accounts of reasoning Trends in Cognitive Sciences 7 454 459
39. DW Evans MD Lewis E Iobst 2004 The role of the orbitofrontal cortex in normally developing compulsive-like behaviors and obsessive-compulsive disorder Brain and Cognition 55 1 220 234 (Pubitemid 38591441)
40. BJ Everitt A Dickinson TW Robbins 2001 The neuropsychological basis of addictive behavior Brain Research Reviews 36 2-3 129 138
41. BJ Everitt TW Robbins 2005 Neural systems of reinforcement for drug addiction: from actions to habits to compulsion Nature Neuroscience 8 11 1481 1489 (Pubitemid 41573659)
42. JW Fagen CK Rovee 1976 Effects of quantitative shifts in a visual reinforcer on the instrumental response of infants Journal of Experimental Child Psychology 21 2 349 360
43. JW Fagen CK Rovee MG Kaplan 1976 Psychophysical scaling of stimulus similarity in 3-month-old infants and adults Journal of Experimental Child Psychology 22 2 272 281
44. J Garcia DJ Kimeldorf RA Koelling 1955 Conditioned aversion to saccharin resulting from exposure to gamma radiation Science 122 3160 157 158
45. I Gormezano RW Tait 1976 The Pavlovian analysis of instrumental conditioning The Pavlovian Journal of Biological Science 11 1 37 55
46. W Greve 2001 Traps and gaps in action explanation: theoretical problems of a psychology of human action Psychological Review 108 435 451 (Pubitemid 33610303)
47. Herbart, J. F. (1825). Psychologie als Wissenschaft neu gegrundet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. Konigsberg: Unzer.
48. WA Hershberger 1986 An approach through the looking glass Animal Learning & Behavior 14 443 451
49. C Heyes A Dickinson 1990 The intentionality of animal action Mind and Language 5 87 104
50. Hilario, M. R. F., Clouse, E., Yin, H. H., & Costa, R. M. (2007). Endocannabinoid signaling is critical for habit formation. Frontiers in Integrative Neuroscience, 1.
51. L Hogarth A Dickinson A Wright M Kouvaraki T Duka 2007 The role of drug expectancy in the control of human drug seeking Journal of Experimental Psychology: Animal Behavior Processes 33 4 484 496 (Pubitemid 350100770)
52. PC Holland 2004 Relations between Pavlovian-instrumental transfer and reinforcer devaluation Journal of Experimental Psychology: Animal Behavior Processes 30 2 104 117 (Pubitemid 38491959)
53. B Hommel 1993 The role of attention for the Simon effect Psychological Research 55 3 208 222
54. B Hommel 1996 The cognitive representation of action: automatic integration of perceived action effects Psychological Research 59 3 176 186 (Pubitemid 126450643)
55. Hommel, B. (2003). Planning and representing intentional action. The Scientific World Journal (3), 593-608.
56. B Hommel J Musseler G Aschersleben W Prinz 2001 The Theory of Event Coding (TEC): a framework for perception and action planning The Behavioral and Brain Sciences 24 5 849 878 discussion 878-937 (Pubitemid 34965924)
57. James, W. (1890). The principles of psychology. New York: Dover Publications.
58. Kenward, B., Folke, S., Holmberg, J., Johansson, A., & Gredeback, G. (2009). Goal-directedness and decision-making in infants. Developmental Psychology (in press).
59. S Killcross E Coutureau 2003 Coordination of actions and habits in the medial prefrontal cortex of rats Cerebral Cortex 13 4 400 408 (Pubitemid 36373685)
60. U Klossek J Russell A Dickinson 2008 The control of instrumental action following outcome devaluation in young children aged between 1 and 4 years Journal of Experimental Psychology: General 137 39 51
61. JM Kruse JB Overmier WA Konz E Rokke 1983 Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific Learning and Motivation 14 165 181
62. W Kunde I Koch J Hoffmann 2004 Anticipated action effects affect the selection, initiation, and execution of actions Quarterly Journal of Experimental Psychology 57A 1 87 106 (Pubitemid 38157021)
63. Lotze, R. H. (1852). Medicinische Psychologie oder die Physiologie der Seele. In Weidmann'sche Buchhandlung. Leipzig.
64. AM Ludwig A Wikler LH Stark K Lexington 1974 The first drink: psychobiological aspects of craving Archives of General Psychiatry 30 539 547
65. WH Meck 1985 Postreinforcement signal processing Journal of Experimental Psychology: Animal Behavior Processes 11 1 52 70
66. Newell, A. (1990). Unified theories of cognition. Cambridge, MA: Harvard University Press.
67. Pavlov, I. P. (1927). Conditional reflexes; an investigation of the physiological activity of the cerebral cortex. Oxford: Oxford University Press.
68. IP Pavlov 1932 The reply of a physiologist to psychologists Psychological Review 39 91 127
69. RT Pithers 1985 The roles of event contingencies and reinforcement in human autoshaping and ommission responding Learning and Motivation 16 210 237
70. AD Redish S Jensen A Johnson 2008 A unified framework for addiction: vulnerabilities in the decision process Behavioural Brain Science 31 4 415 437
71. RA Rescorla 1992 Response outcome versus outcome response associations in instrumental learning Animal Learning & Behavior 20 3 223 232
72. RA Rescorla 1994 Transfer of instrumental control mediated by a devalued outcome Animal Learning & Behavior 22 1 27 33 (Pubitemid 24054216)
73. RA Rescorla RM Colwill 1989 Associations with anticipated and obtained outcomes in instrumental learning Animal Learning & Behaviour 17 3 291 303 (Pubitemid 19192759)
74. Rovee-Collier, C. K. (1983). Infants as problem-solvers: a psychobiological perspective. In M. D. Zeiler & P. Harzem (Eds.), Advances in the analysis of behaviour (Vol. 3). Oxford, UK: Wiley.
75. SA Sloman 1996 The empirical case for two systems of reasoning Psychological Bulletin 119 1 3 22 (Pubitemid 126021382)
76. Stewart, J., & de Wit, H. (1987). Reinstatement of drug-taking behavior as a method of assessing incentive motivational properties of drugs. In M. A. Bozarth (Ed.), Methods of assessing the reinforcing properties of abused drugs (pp. 211-227). New York: Springer.
77. A Stock C Stock 2004 A short history of ideo-motor action Psychological Research 68 2-3 176 188 (Pubitemid 40549810)
78. RS Sutton AG Barto 1981 An adaptive network that constructs and uses an internal model of its world Cognition and Brain Theory 4 217 246
79. D Talmi B Seymour P Dayan RJ Dolan 2008 Human pavlovian-instrumental transfer The Journal of Neuroscience 28 2 360 368
80. Thorndike, E. L. (1911). Animal intelligence: experimental studies. New York: Macmillan.
81. Thorndike, E. L. (1931). Human learning. New York: Century.
82. Trapold, M. A., & Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning ii: Current research and theory (pp. 427-452). New York: Appleton-Cwntury-Croft.
83. VV Valentin A Dickinson JP O'Doherty 2007 Determining the neural substrates of goal-directed learning in the human brain The Journal of Neuroscience 27 15 4019 4026 (Pubitemid 46597159)
84. JR Wolpaw 1997 The complex structure of a simple memory Trends in Neuroscience 20 12 588 594 (Pubitemid 27508973)
85. DM Wolpert Z Ghahramani 2000 Computational principles of movement neuroscience Nature Neuroscience 3 1212 1227
86. HH Yin BJ Knowlton 2006 The role of the basal ganglia in habit formation Nature Reviews: Neuroscience 7 6 464 476 (Pubitemid 44012286)
87. HH Yin BJ Knowlton BW Balleine 2004 Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning The European Journal of Neuroscience 19 1 181 189 (Pubitemid 38122084)
88. HH Yin SB Ostlund BJ Knowlton BW Balleine 2005 The role of the dorsomedial striatum in instrumental conditioning European Journal of Neuroscience 22 513 523 (Pubitemid 41097624)
89. M Ziessler 1998 Response-effect learning as a major component of implicit serial learning Journal of Experimental Psychology: Learning, Memory and Cognition 24 962 978
90. M Ziessler D Nattkemper 2001 Learning of event sequences is based on response-effect learning: further evidence from a serial reaction task. Journal of Experimental Psychology-Learning Memoty and Cognition 27 3 595 613
91. Ziessler, M., & Nattkemper, D. (2002). Effect anticipation in action planning. In W. Prinz & B. Hommel (Eds.), Common mechanisms in perception and action:Attention and performance XIX (pp. 645-672). Oxford: Oxford University Press.