Contextual control of instrumental actions and habits

Journal of Experimental Psychology: Animal Learning and Cognition

Volumn 41, Issue 1, 2015, Pages 69-80

  Thrailkill, Eric A ^a   Bouton, Mark E ^a  

^a UNIVERSITY OF VERMONT   (United States)

Author keywords

Action; Context; Habit; Instrumental learning

Indexed keywords

ANALYSIS OF VARIANCE; ANIMAL; FEMALE; FOOD DEPRIVATION; HABIT; INSTRUMENTAL CONDITIONING; MOTIVATION; PHYSIOLOGY; RAT; REINFORCEMENT; TIME FACTOR;

ANALYSIS OF VARIANCE; ANIMALS; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; FEMALE; FOOD DEPRIVATION; HABITS; MOTIVATION; RATS; REINFORCEMENT (PSYCHOLOGY); TIME FACTORS;

EID: 84939573123     PISSN: 23298456     EISSN: 23298464     Source Type: Journal    
DOI: 10.1037/xan0000045     Document Type: Article

References (43)

1. Adams, C. D. (1982). Variations in the sensitivity of instrumental responding to reinforcer devaluation. The Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology, 34, 77-98.
2. Adams, C. D., & Dickinson, A. (1981a). Instrumental responding following reinforcer devaluation. The Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology, 33, 109-121.
3. Adams, C. D., & Dickinson, A. (1981b). Actions and habits: Variations in associative representations during instrumental learning. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 143-165). Hillsdale, NJ: Erlbaum.
4. Balleine, B. W. (2005). Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits. Physiology & Behavior, 86, 717-730. http://dx.doi.org/10.1016/j.physbeh.2005.08.061
5. Balleine, B. W., & Dickinson, A. (1998a). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419. http://dx.doi.org/10.1016/S0028-3908(98)00033-1
6. Balleine, B. W., & Dickinson, A. (1998b). The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Animal Learning & Behavior, 26, 46-59. http://dx.doi.org/10.3758/BF03199161
7. Balleine, B. W., & O'Doherty, J. P. (2010). Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35, 48-69. http://dx.doi.org/ 10.1038/npp.2009.131
8. Bouton, M. E., & King, D. A. (1983). Contextual control of the extinction of conditioned fear: Tests for the associative value of the context. Journal of Experimental Psychology: Animal Behavior Processes, 9, 248-265. http:// dx.doi.org/10.1037/0097-7403.9.3.248
9. Bouton, M. E., & Peck, C. A. (1989). Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation. Animal Learning & Behavior, 17, 188-198. http://dx.doi.org/10.3758/ BF03207634
10. Bouton, M. E., Todd, T. P., & León, S. P. (2014). Contextual control of discriminated operant behavior. Journal of Experimental Psychology: Animal Learning and Cognition, 40, 92-105. http://dx.doi.org/10.1037/ xan0000002
11. Bouton, M. E., Todd, T. P., Vurbic, D., & Winterbauer, N. E. (2011). Renewal after the extinction of free operant behavior. Learning & Behavior, 39, 57-67. http://dx.doi.org/10.3758/s13420-011-0018-6
12. Brackney, R. J., Cheung, T. H. C., Neisewander, J. L., & Sanabria, F. (2011). The isolation of motivational, motoric, and schedule effects on operant performance: A modeling approach. Journal of the Experimental Analysis of Behavior, 96, 17-38. http://dx.doi.org/10.1901/jeab.2011.96-17
13. Colwill, R. M., & Rescorla, R. A. (1985a). Postconditioning devaluation of a reinforcer affects instrumental responding. Journal of Experimental Psychology: Animal Behavior Processes, 11, 120-132. http://dx.doi.org/ 10.1037/0097-7403.11.1.120
14. Colwill, R. M., & Rescorla, R. A. (1985b). Instrumental responding remains sensitive to reinforcer devaluation after extensive training. Journal of Experimental Psychology: Animal Behavior Processes, 11, 520-536. http://dx.doi.org/10.1037/0097-7403.11.4.520
15. Colwill, R. M., & Rescorla, R. A. (1990). Effect of reinforcer devaluation on discriminative control of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes, 16, 40-47. http://dx.doi.org/ 10.1037/0097-7403.16.1.40
16. Corbit, L. H., Nie, H., & Janak, P. H. (2012). Habitual alcohol seeking: Time course and the contribution of subregions of the dorsal striatum. Biological Psychiatry, 72, 389-395. http://dx.doi.org/10.1016/j.biopsych.2012.02.024
17. Coutureau, E., & Killcross, S. (2003). Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behavioural Brain Research, 146, 167-174. http://dx.doi.org/10.1016/j.bbr.2003.09.025
18. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711. http://dx.doi.org/10.1038/nn1560
19. de Wit, S., & Dickinson, A. (2009). Associative theories of goal-directed behaviour: A case for animal-human translational models. Psychological Research, 73, 463-476. http://dx.doi.org/10.1007/s00426-009-0230-6
20. Dezfouli, A., & Balleine, B. W. (2012). Habits, action sequences and reinforcement learning. European Journal of Neuroscience, 35, 1036-1051. http://dx.doi.org/10.1111/j.1460-9568.2012.08050.x
21. Dezfouli, A., & Balleine, B. W. (2013). Actions, action sequences and habits: Evidence that goal-directed and habitual action control are hierarchically organized. PLoS Computational Biology, 9, e1003364. http:// dx.doi.org/10.1371/journal.pcbi.1003364
22. Dickinson, A. (1985). Actions and habits: The development of behavioral autonomy. Philosophical Transactions of the Royal Society of London Series B, Biological Sciences, 308, 67-78. http://dx.doi.org/10.1098/rstb.1985.0010
23. Dickinson, A. (1994). Instrumental conditioning. In N. J. Mackintosh (Ed.), Animal learning and cognition: Handbook of perception and cognition series (2nd ed., pp. 45-79). San Diego, CA: Academic Press. http://dx.doi.org/10.1016/B978-0-08-057169-0.50009-7
24. Dickinson, A. (2011). Goal-directed behavior and future planning in animals. In R. Menzel & J. Fischer (Eds.), Animal thinking: Contemporary issues in comparative cognition (pp. 79-91). Cambridge, MA: MIT Press.
25. Dickinson, A., & Balleine, B. (2002). The role of learning in the operation of motivational systems. In H. Pashler and R. Gallistel (Eds.), Stevens' handbook of experimental psychology, Vol. 3: Learning, motivation, and emotion (pp. 497-534). New York, NY: Wiley. http://dx.doi.org/ 10.1002/0471214426.pas0312
26. Dickinson, A., Balleine, B., Watt, A., Gonzalez, F., & Boakes, R. A. (1995). Motivational control after extended instrumental training. Animal Learning & Behavior, 23, 197-206. http://dx.doi.org/10.3758/ BF03199935
27. Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983). The effect of instrumental training contingency on susceptibility to reinforcer devaluation. The Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology, 35, 35-51.
28. Dickinson, A., Squire, S., Varga, Z., & Smith, J. W. (1998). Omission learning after instrumental pretraining. The Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology, 51, 271-286.
29. Everitt, B. J., & Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nature Neuroscience, 8, 1481-1489. http://dx.doi.org/10.1038/nn1579
30. Gillan, C. M., Papmeyer, M., Morein-Zamir, S., Sahakian, B. J., Fineberg, N. A., Robbins, T. W., & de Wit, S. (2011). Disruption in the balance between goal-directed behavior and habit learning in obsessivecompulsive disorder. The American Journal of Psychiatry, 168, 718-726. http://dx.doi.org/10.1176/appi.ajp.2011.10071062
31. Graybiel, A. M. (2008). Habits, rituals, and the evaluative brain. Annual Review of Neuroscience, 31, 359-387. http://dx.doi.org/10.1146/ annurev.neuro.29.051605.112851
32. Harris, J. A., Jones, M. L., Bailey, G. K., & Westbrook, R. F. (2000). Contextual control over conditioned responding in an extinction paradigm. Journal of Experimental Psychology: Animal Behavior Processes, 26, 174-185. http://dx.doi.org/10.1037/0097-7403.26.2.174
33. Hogarth, L., Balleine, B. W., Corbit, L. H., & Killcross, S. (2013). Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Annals of the New York Academy of Sciences, 1282, 12-24. http://dx.doi.org/10.1111/j.1749-6632.2012.06768.x
34. Lubow, R. E., & Moore, A. U. (1959). Latent inhibition: The effect of nonreinforced pre-exposure to the conditional stimulus. Journal of Comparative and Physiological Psychology, 52, 415-419. http://dx.doi.org/ 10.1037/h0046700
35. Reed, P. (2011). An experimental analysis of steady-state response rate components on variable ratio and variable interval schedules of reinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 37, 1-9. http://dx.doi.org/10.1037/a0019387
36. Rescorla, R. A. (1982). Comments on a technique for assessing associative learning. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner (Eds.), Quantitative analysis of behavior: Acquisition (Vol. 3, pp. 41-61). Cambridge, MA: Ballinger.
37. Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry. Trends in Cognitive Sciences, 16, 81-91. http://dx.doi.org/10.1016/j.tics.2011.11.009
38. Rosas, J. M., Todd, T. P., & Bouton, M. E. (2013). Context change and associative learning. WIREs Cognitive Science, 4, 237-244. http://dx.doi.org/10.1002/wcs.1225
39. Steiger, J. H. (2004). Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods, 9, 164-182. http://dx.doi.org/10.1037/1082-989X.9.2.164
40. Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008). Calculating consequences: Brain systems that encode the causal effects of actions. The Journal of Neuroscience, 28, 6750-6755. http://dx.doi.org/10.1523/ JNEUROSCI.1808-08.2008
41. Todd, T. P. (2013). Mechanisms of renewal after the extinction of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes, 39, 193-207. http://dx.doi.org/10.1037/a0032236
42. Trask, S., & Bouton, M. E. (2014). Contextual control of operant behavior: Evidence for hierarchical associations in instrumental learning. Learning & Behavior, 42, 281-288. http://dx.doi.org/10.3758/s13420-014-0145-y
43. Yin, H. H., & Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nature Reviews Neuroscience, 7, 464-476. http://dx.doi.org/ 10.1038/nrn1919