The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning

Neuroscience

Volumn 166, Issue 3, 2010, Pages 752-762

  Ilango, A ^a   Wetzel, W ^a   Scheich, H ^a   Ohl, F W ^a,b  

^a LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

punishment; reinforcement learning; reward; rodent; shuttle box

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL TISSUE; APPETITE; ARTICLE; AUDITORY STIMULATION; AVERSIVE BEHAVIOR; BRAIN DEPTH STIMULATION; CONTROLLED STUDY; GERBIL; MALE; NONHUMAN; PRIORITY JOURNAL; PUNISHMENT; REINFORCEMENT; REWARD; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; TASK PERFORMANCE;

ACOUSTIC STIMULATION; ANIMALS; APPETITIVE BEHAVIOR; ASSOCIATION LEARNING; AVOIDANCE LEARNING; EXTINCTION, PSYCHOLOGICAL; GERBILLINAE; MALE; REINFORCEMENT (PSYCHOLOGY);

EID: 77249108276     PISSN: 03064522     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2010.01.010     Document Type: Article

References (54)

1. Aguilar R., Gil L., Fernández-Teruel A., and Tobena A. Genetically-based behavioural traits influence the effects of shuttle box avoidance overtraining and extinction upon intertrial responding: a study with the Roman rat strains. Behav Processes 66 (2004) 63-72
2. Aldavert-Vera L., Costa-Miserachs D., Massanes-Rotger E., Soriano-Mas C., Segura-Torres P., and Morgado-Bernal I. Facilitation of a distributed shuttle-box conditioning with posttraining intracranial self-stimulation in old rats. Neurobiol Learn Mem 67 (1997) 254-258
3. Baron A., DeWaad R.J., and Lipson J. Increased reinforcement when timeout from avoidance includes access to a safe place. J Exp Anal Behav 27 (1977) 479-494
4. Bull J.A. An interaction between appetitive pavlovian CSs and instrumental avoidance responding. Learn Motiv 1 (1970) 18-26
5. Carder B. Lateral hypothalamic stimulation and avoidance in rats. J Comp Physiol Psychol 71 (1970) 325-333
6. Carr K.D., and Coons E.E. Rats self-administer nonrewarding brain stimulation to ameliorate aversion. Science 215 (1982) 1516-1517
7. Castro-Alamancos M.A., and Borrell J. Facilitation and recovery of shuttle box avoidance behavior after frontal cortex lesions is induced by a contingent electrical stimulation in the ventral tegmental nucleus. Behav Brain Res 50 (1992) 69-76
8. Corda M.G., Piras G., Lecca D., Fernández-Terue A., Driscoll P., and Giorni O. The psychogenetically selected Roman rat lines differ in the susceptibility to develop amphetamine sensitization. Behav Brain Res 157 (2005) 147-156
9. Cox V.C., and Valenstein E.S. Attenuation of aversive properties of peripheral shock by hypothalamic stimulation. Science 149 (1965) 323-325
10. Day J.J., Roitman M.F., Wightman R.M., and Carelli R.M. Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10 (2007) 1020-1028
11. Daw N.D., Kakade S., and Dayan P. Opponent interactions between serotonin and dopamine. Neural Netw 15 (2002) 603-616
12. Dickinson A., and Pearce J.M. Inhibitory interactions between appetitive and aversive stimuli. Psychol Bull 84 (1977) 690-711
13. Dickinson A., and Dearing M.F. Appetitive-aversive interactions and inhibitory processes. In: Dickinson A., and Boakes R.A. (Eds). Mechanisms of learning and motivation (1979), Erlbaum, Hillsdale, NJ 203-231
14. Dickinson A., and Mackintosh N.J. Classical conditioning in animals. Annu Rev Psychol 29 (1978) 587-612
15. Dickinson A. Appetitive and aversive interactions: super conditioning of fear by an appetitive CS. Q J of Exp Psychology 29 (1977) 71-83
16. Dickinson A. Appetitive-aversion interactions: facilitation of aversive conditioning by prior appetitive training in the rat. Anim Learn Behav 4 (1976) 416-420
17. Dinsmoor J.A. Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J Exp Anal Behav 75 (2001) 311-333
18. Estes W.K., and Skinner B.F. Some quantitative properties of anxiety. J Exp Psychol 29 (1941) 390-400
19. Frank M.J., Seeberger L.C., and O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in Parkinsonism. Science 306 (2004) 1940-1943
20. Gallistel C.R. Dopamine and reward: comment on Hernandez et al. (2006). Behav Neurosci 120 (2006) 992-994
21. Gottfried J.A., O'Doherty J., and Dolan R.J. Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci 22 (2002) 10829-10837
22. Graybiel A.M. Habits, rituals, and the evaluative brain. Annu Rev Neurosci 31 (2008) 359-387
23. Hearst E. Simultaneous generalization gradients for appetitive and aversive behavior. Science 132 (1960) 1769-1770
24. Hernandez G., Hamdani S., Rajabi H., Conover K., Stewart J., Arvanitogiannis A., and Shizgal P. Prolonged rewarding stimulation of the rat medial forebrain bundle: neurochemical and behavioral consequences. Behav Neurosci 120 (2006) 888-904
25. Kelleher R.T., and Cook L. An analysis of the behavior of rats and monkeys on concurrent fixed-ratio avoidance schedules. J Exp Anal Behav 2 (1959) 203-211
26. Kim H., Shimojo S., and O'Doherty J.P. Is avoiding an aversive outcome rewarding?. Neural substrates of avoidance learning in the human brain. PLoS Biol 4 (2006) 1453-1461
27. Konorski J., and Szwejkowska G. Reciprocal transformations of heterogenous conditioned reflexes. Acta Biol Exp 16 (1956) 95-113
28. Konorski J. The integrative activity of the brain: an interdisciplinary approach (1967), Chicago University Press, Chicago
29. Leknes S., and Tracey I. A common neurobiology for pain and pleasure. Nat Rev Neurosci 9 (2008) 314-320
30. Loskota W.J., Lomax P., and Verity M.A. A stereotaxic atlas of the Mongolian gerbil (Meriones unguiculatus) brain (1974), Ann Arbor Science Publishers, Michigan
31. Mackintosh N.J. Conditioning and associative learning (1983), Oxford University Press, New York
32. Magoon M.A., and Critchfield T.S. Concurrent schedules of positive and negative reinforcement: differential-impact and differential-outcomes hypotheses. J Exp Anal Behav 90 (2008) 1-22
33. Margules D.L., and Stein L. Facilitation of Sidman avoidance behavior by positive brain stimulation. J Comp Physiol Psychol 66 (1968) 182-184
34. Matsumoto M., and Hikosaka O. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447 (2007) 1111-1115
35. Mogenson G.J., and Morrison M.J. Avoidance responses to reward stimulation of the brain. J Comp Physiol Psychol 55 (1962) 691-694
36. Morris R.G.M. Preconditioning of reinforcement properties to an exteroceptive feedback stimulus. Learn Motiv 6 (1975) 289-298
37. Morrison S.E., and Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J Neurosci 29 (2009) 11471-11483
38. Ohl F.W., Wetzel W., Wagner T., Rech A., and Scheich H. Bilateral ablation of auditory cortex in Mongolian gerbil affects discrimination of frequency modulated tones but not of pure tones. Learn Mem 6 (1999) 347-362
39. Ohl F.W., Scheich H., and Freeman W.J. Change in pattern of ongoing cortical activity with auditory category learning. Nature 412 (2001) 733-736
40. Olds M.E., and Olds J. Approach-escape interactions in rat brain. Am J Physiol 203 (1962) 803-810
41. Reed P., Mitchell C., and Nokes T. Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task. Anim Learn Behav 24 (1996) 38-45
42. Rolls E.T. Memory, attention, decision-making (2008), Oxford University Press, Oxford, UK
43. Scavio M.J. Classical-classical transfer: effects of prior aversive conditioning upon appetitive conditioning in rabbits. J Comp Physiol Psychol 86 (1974) 107-115
44. Schoenbaum G., Chiba A.A., and Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci 1 (1998) 155-159
45. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
46. Seymour B., O'Doherty J.P., Koltzenburg M., Wiech K., Frackowiak R., Friston K., and Dolan R. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 8 (2005) 1234-1240
47. Seymour B., Singer T., and Dolan R. Neurobiology of punishment. Nat Rev Neurosci 4 (2007) 300-311
48. Stark H., Bischof A., and Scheich H. Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box. Neurosci Lett 264 (1999) 77-80
49. Stark H., Rothe T., Wagner T., and Scheich H. Learning a new behavioral strategy in the shuttle-box increases prefrontal dopamine. Neuroscience 126 (2004) 21-29
50. Stein L. Facilitation of avoidance behaviour by positive brain stimulation. J Comp Physiol Psychol 60 (1965) 9-19
51. Tanimoto H., Heisenberg M., and Gerber B. Event timing turns punishment to reward. Nature 430 (2004) 983
52. Valenstein E.S., and Valenstein T. Interaction of positive and negative reinforcing neural systems. Science 145 (1964) 1456-1458
53. Wetzel W., Wagner T., Ohl F.W., and Scheich H. Categorical discrimination of direction in frequency-modulated tones by Mongolian gerbils. Behav Brain Res 91 (1998) 29-39
54. Wetzel W., Ohl F.W., and Scheich H. Global versus local processing of frequency-modulated tones in gerbils: an animal model of lateralized auditory cortex functions. Proc Natl Acad Sci U S A 105 (2008) 6753-6758