Learning and the persistence of appetite: Extinction and the motivation to eat and overeat

Physiology and Behavior

Volumn 103, Issue 1, 2011, Pages 51-58

  Bouton, Mark E ^a  

^a UNIVERSITY OF VERMONT   (United States)

Author keywords

Eating; Extinction; Overeating; Pavlovian and operant conditioning

Indexed keywords

APPETITE; ARTICLE; ASSOCIATION; CONDITIONING; EATING; FOOD INTAKE; HUMAN; LEARNING; MOTIVATION; NONHUMAN; OVERNUTRITION; PRIORITY JOURNAL;

ANIMALS; APPETITE; APPETITIVE BEHAVIOR; EXTINCTION, PSYCHOLOGICAL; HUMANS; LEARNING; MOTIVATION;

EID: 79952490207     PISSN: 00319384     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physbeh.2010.11.025     Document Type: Article

References (76)

1. Woods S.C. The control of food intake: behavioral versus molecular perspectives. Cell Metab 2009, 9:489-498.
2. Woods S.C. The eating paradox: how we tolerate food. Psychol Rev 1991, 98:488-505.
3. Strubbe J.H., Woods S.C. The timing of meals. Psychol Rev 2004, 111:128-141.
4. Woods S.C., Strubbe J.H. The psychobiology of meals. Psychon Bull Rev 1994, 1:141-155.
5. Why we eat what we eat 1996, American Psychological Association, Washington, DC. E.D. Capaldi (Ed.).
6. Holland P.C., Petrovich G.D. A neural systems analysis of the potentiation of feeding by conditioned stimuli. Physiol Behav 2005, 86:747-761.
7. Seeley R.J., Ramsay D.S., Woods S.C. Regulation of food intake: interactions between learning and physiology. Learning, motivation, and cognition: the functional behaviorism of Robert C. Bolles 1997, 99-115. American Psychological Association, Washington, DC. M.E. Bouton, M.S. Fanselow (Eds.).
8. Kessler D.A. The end of overeating: taking control of the insatiable American appetite 2009, Rodale, New York.
9. Hearst E., Jenkins H.M. Sign-tracking: the stimulus-reinforcer relation and directed action 1974, The Psychonomic Society, Austin, TX.
10. Bouton M.E. Learning and behavior: a contemporary synthesis 2007, Sinauer Associates, Inc., Sunderland, MA.
11. Birch L.L. Obesity and eating disorders: a developmental perspective. Bull Psychon Soc 1991, 29:265-272.
12. Holland P.C., Petrovich G.D., Gallagher M. The effects of amygdale lesions on conditioned stimulus-potentiated eating in rats. Physiol Behav 2002, 76:117-129.
13. Petrovich G.D., Ross C.A., Gallagher M., Holland P.C. Learned contextual cue potentiates eating in rats. Physiol Behav 2007, 90:363-367.
14. Weingarten H.P. Conditioned cues elicit feeding in sated rats: a role for learning in meal initiation. Science 1983, 220:431-433.
15. Weingarten H.P. Meal initiation controlled by learned cues: basic behavioral properties. Appetite 1984, 6:387-401.
16. Balleine B.W. Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 2005, 86:717-730.
17. Rescorla R.A., Solomon R.L. Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psychol Rev 1967, 74:151-182.
18. Berridge K.C. 'Liking' and 'wanting' food rewards: brain substrates and roles in eating disorders. Physiol Behav 2009, 97:537-550.
19. Berridge K.C., Robinson T.E., Aldridge J.W. Dissecting components of reward: 'liking', 'wanting', and learning. Curr Opin Pharmacol 2009, 9:65-73.
20. Holland P.C. Occasion setting in Pavlovian conditioning. The psychology of learning and motivation 1992, Vol. 28:69-125. Academic Press, San Diego, CA.
21. Bouton M.E. Context and behavioral processes in extinction. Learn Mem 2004, 11:485-494.
22. Rescorla R.A. Experimental extinction. Handbook of contemporary learning theories 2001, 119-154. Erlbaum, Mahwah, NJ. R.R. Mowrer, S.B. Klein (Eds.).
23. Bouton M.E. Context, ambiguity, and unlearning: sources of relapse after behavioral extinction. Biol Psychiatry 2002, 52:976-986.
24. Bouton M.E., Woods A.M. Extinction: behavioral mechanisms and their implications. Learning and memory: a comprehensive reference (vol. 1, learning theory and behaviour) 2008, 151-171. Elsevier, Oxford. J.H. Byrne, D. Sweatt, R. Menzel, H. Eichenbaum, H. Roediger (Eds.).
25. Bouton M.E., Bolles R.C. Contextual control of the extinction of conditioned fear. Learn Motiv 1979, 10:445-466.
26. Bouton M.E., King D.A. Contextual control of the extinction of conditioned fear: tests for the associative value of the context. J Exp Psychol Anim Behav Process 1983, 9:248-265.
27. Bouton M.E. Context and ambiguity in the extinction of emotional learning: implications for exposure therapy. Behav Res Ther 1988, 26:137-149.
28. Bouton M.E., Peck C.A. Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation. Anim Learn Behav 1989, 17:188-198.
29. Bouton M.E., Ricker S.T. Renewal of extinguished responding in a second context. Anim Learn Behav 1994, 22:317-324.
30. Brooks D.C., Bouton M.E. A retrieval cue for extinction attenuates response recovery (renewal) caused by a return to the conditioning context. J Exp Psychol Anim Behav Process 1994, 20:366-379.
31. Wilfley D.E., Van Buren D.J., Theim K.R., Stein R.I., Saelens B.E., Ezzet F., et al. The use of biosimulation in the design of a novel multilevel weight loss maintenance program for overweight children. Obesity 2010, 18:S91-S98.
32. Bossert J.M., Liu S.Y., Lu L., Shaham Y. A role of ventral tegmental area glutamate in contextual cue-induced relapse to heroin seeking. J Neurosci 2004, 24:10726-10730.
33. Hamlin A.S., Clemens K.J., McNally G.P. Renewal of extinguished cocaine-seeking. Neuroscience 2008, 151:659-670.
34. Crombag H.S., Shaham Y. Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behav Neurosci 2002, 116:169-173.
35. Hamlin A.S., Newby J., McNally G.P. The neural correlates and role of D1 dopamine receptors in renewal of extinguished alcohol-seeking. Neuroscience 2007, 146:525-536.
36. Zironi I., Burattini C., Aicardi G., Janak P.H. Context is a trigger for relapse to alcohol. Behav Brain Res 2006, 167:150-155.
37. Nakajima S., Tanaka S., Urushihara K., Imada H. Renewal of extinguished lever-press responses upon return to the training context. Learn Motiv 2000, 31:416-431.
38. Nakajima S., Urushihara K., Masaki T. Renewal of operant performance formerly eliminated by omission or noncontingency training upon return to the acquisition context. Learn Motiv 2002, 33:510-525.
39. Bouton M.E., Todd T.P., Vurbic D., Winterbauer N.E. Renewal after the extinction of free operant behavior. Learn Behav 2011, 39:57-67.
40. Baker A.G., Steinwald H., Bouton M.E. Contextual conditioning and reinstatement of extinguished instrumental responding. Q J Exp Psychol 1991, 43B:199-218.
41. Rescorla R.A. Extinction of facilitation. J Exp Psychol Anim Behav Process 1986, 12:16-24.
42. Conklin C.A., Tiffany S.T. Applying extinction research and theory to cue-exposure addiction treatments. Addiction 2002, 97:155-167.
43. Pavlov I.P. Conditioned reflexes 1927, Oxford University Press, Oxford, UK.
44. Rescorla R.A. Spontaneous recovery. Learn Mem 2004, 11:501-509.
45. Robbins S.J. Mechanisms underlying spontaneous recovery in autoshaping. J Exp Psychol Anim Behav Process 1990, 16:235-249.
46. Bouton M.E., Peck C.A. Spontaneous recovery in cross-motivational transfer (counterconditioning). Anim Learn Behav 1992, 20:313-321.
47. Bouton M.E., García-Gutiérrez A. Intertrial interval as a contextual stimulus. Behav Process 2006, 71:307-317.
48. Bouton M.E., Hendrix M.C. Intertrial interval as a contextual stimulus: further analysis of a novel asymmetry in temporal discrimination learning. J Exp Psychol Anim Behav Processes 2011, 37:79-93.
49. Todd T.P., Winterbauer N.E., Bouton M.E. Interstimulus interval as a discriminative cue: evidence of the generality of a novel asymmetry in temporal discrimination learning. Behav Process 2010, 84:412-420.
50. Brooks D.C., Bouton M.E. A retrieval cue for extinction attenuates spontaneous recovery. J Exp Psychol Anim Behav Process 1993, 19:77-89.
51. Leitenberg H., Rawson R.A., Bath K. Reinforcement of competing behavior during extinction. Science 1970, 169:301-303.
52. Lieving G.A., Lattal K.A. Recency, repeatability, and reinforcer retrenchment: an experimental analysis of resurgence. J Exp Anal Behav 2003, 80:217-233.
53. Winterbauer N.E., Bouton M.E. Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process 2010, 36:343-353.
54. Winterbauer NE, Bouton ME. Mechanisms of resurgence II: response-contingent reinforcers can reinstate a second extinguished behavior. Submitted for publication. Learn Motiv.
55. Podlesnik C.A., Jimenez-Gomez C., Shahan T.A. Resurgence of alcohol seeking produced by discontinuing non-drug reinforcement as an animal model of drug relapse. Behav Pharmacol 2006, 17:369-374.
56. Volpp K.G., John L.K., Troxel A.B., Norton L., Fassbender J., Loewenstein G. Financial incentive-based approaches for weight loss: a randomized trial. J Am Med Assoc 2008, 300:2631-2637.
57. Rawson R.A., Leitenberg H., Mulick J.A., Lefebvre M.F. Recovery of extinction responding in rats following discontinuation of reinforcement of alternative behavior: a test of two explanations. Anim Learn Behav 1977, 5:415-420.
58. Bouton M.E., Swartzentruber D. Sources of relapse after extinction in Pavlovian and instrumental learning. Clin Psychol Rev 1991, 11:123-140.
59. Bouton M.E. Differential control by context in the inflation and reinstatement paradigms. J Exp Psychol Anim Behav Process 1984, 10:56-74.
60. Rescorla R.A., Heth C.D. Reinstatement of fear to an extinguished conditioned stimulus. J Exp Psychol Anim Behav Process 1975, 1:88-96.
61. Reid R.L. The role of the reinforcer as a stimulus. Br J Psychol 1958, 49:202-209.
62. Rescorla R.A., Skucy J.C. Effect of response-independent reinforcers during extinction. J Comp Physiol Psychol 1969, 67:381-389.
63. Wise R.A., Wang B., You Z.-B. Cocaine serves as a peripheral interoceptive conditioned stimulus for central glutamate and dopamine release. PLoS ONE 2008, 3:1-9.
64. Bouton M.E., Bolles R.C. Role of conditioned contextual stimuli in reinstatement of extinguished fear. J Exp Psychol Anim Behav Process 1979, 5:368-378.
65. Ricker S.T., Bouton M.E. Reacquisition following extinction in appetitive conditioning. Anim Learn Behav 1996, 24:423-436.
66. Bouton M.E., Woods A.M., Pineño O. Occasional reinforced trials during extinction can slow the rate of rapid reacquisition. Learn Motiv 2004, 35:371-390.
67. Woods A.M., Bouton M.E. Occasional reinforced responses during extinction can slow the rate of reacquisition of an operant response. Learn Motiv 2007, 38:56-74.
68. Davidson T.L. The nature and function of interoceptive signals to feed: toward integration of physiological and learning perspectives. Psychol Rev 1993, 100:640-657.
69. Davidson T.L. Hunger cues as modulatory stimuli. Occasion setting: associative learning and cognition in animals 1998, 223-248. American Psychological Association, Washington, DC. N.A. Schmajuk, P.C. Holland (Eds.).
70. Bouton M.E., Nelson J.B. Context-specificity of target versus feature inhibition in a feature-negative discrimination. J Exp Psychol Anim Behav Process 1994, 20:51-65.
71. Nelson J.B., Bouton M.E. The effects of a context switch following serial and simultaneous feature-negative discriminations. Learn Motiv 1997, 28:56-84.
72. Nelson J.B. Context specificity of excitation and inhibition in ambiguous stimuli. Learn Motiv 2002, 33:284-310.
73. Peck C.A., Bouton M.E. Context and performance in aversive-to-appetitive and appetitive-to-aversive transfer. Learn Motiv 1990, 21:1-31.
74. Hollis K.L. Pavlovian conditioning of signal-centered action patterns and autonomic behavior: a biological analysis of function. Advances in the study of behavior 1982, Vol. 12:1-64. Academic Press, New York. R.A. Rosenblatt, R.A. Hinde, C. Beer, M.C. Busnel (Eds.).
75. Hollis K.L. Contemporary research on Pavlovian conditioning: a "new" functional analysis. Am Psychol 1997, 52:956-965.
76. Welker R.L., McAuley K. Reductions in resistance to extinction and spontaneous recovery as a function of changes in transportational and contextual stimuli. Anim Learn Behav 1978, 6:451-457.