메뉴 건너뛰기




Volumn 87, Issue 1, 2011, Pages 125-134

Repeated extinction and reversal learning of an approach response supports an arousal-mediated learning model

Author keywords

Arousal; Extinction; Nose poke; Pavlovian conditioned approach; Rat; Reversal learning

Indexed keywords

EXPERIMENTAL STUDY; EXTINCTION; LINEARITY; NUMERICAL MODEL; PERFORMANCE ASSESSMENT; PHYSIOLOGICAL RESPONSE; RODENT;

EID: 79954733404     PISSN: 03766357     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.beproc.2010.12.005     Document Type: Article
Times cited : (9)

References (57)
  • 1
    • 0002659568 scopus 로고
    • A unified account of Pavlovian conditioning and operant training. In H.A. Black, W.F. Prokasy (Eds.), Classical Conditioning II: Current research and theory. Appleton-Century-Crofts, New York.
    • Bindra, D., 1972. A unified account of Pavlovian conditioning and operant training. In H.A. Black, W.F. Prokasy (Eds.), Classical Conditioning II: Current research and theory. Appleton-Century-Crofts, New York, pp. 453-482.
    • (1972) , pp. 453-482
    • Bindra, D.1
  • 2
    • 0027630812 scopus 로고
    • Context, time, and memory retrieval in the interference paradigms of Pavlovian learning
    • Bouton M.E. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psych. Bull. 1993, 114:80-99.
    • (1993) Psych. Bull. , vol.114 , pp. 80-99
    • Bouton, M.E.1
  • 3
    • 4644334535 scopus 로고    scopus 로고
    • Context and behavioral processes in extinction
    • Bouton M.E. Context and behavioral processes in extinction. Learn. Mem. 2004, 11:485-494.
    • (2004) Learn. Mem. , vol.11 , pp. 485-494
    • Bouton, M.E.1
  • 4
    • 0000748349 scopus 로고
    • Time and context effects on performance in a Pavlovian discrimination reversal
    • Bouton M.E., Brooks D.C. Time and context effects on performance in a Pavlovian discrimination reversal. J. Exp. Psych. Anim. Behav. Proc. 1993, 19:165-179.
    • (1993) J. Exp. Psych. Anim. Behav. Proc. , vol.19 , pp. 165-179
    • Bouton, M.E.1    Brooks, D.C.2
  • 5
    • 0020965801 scopus 로고
    • Contextual control of the extinction of conditioned fear: tests for the associative value of the context
    • Bouton M.E., King D.A. Contextual control of the extinction of conditioned fear: tests for the associative value of the context. J. Exp. Psych. Anim. Behav. Proc. 1983, 9:248-265.
    • (1983) J. Exp. Psych. Anim. Behav. Proc. , vol.9 , pp. 248-265
    • Bouton, M.E.1    King, D.A.2
  • 6
    • 0024518081 scopus 로고
    • Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation
    • Bouton M.E., Peck C.A. Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation. Anim. Learn. Behav. 1989, 17:188-198.
    • (1989) Anim. Learn. Behav. , vol.17 , pp. 188-198
    • Bouton, M.E.1    Peck, C.A.2
  • 7
    • 0027343306 scopus 로고
    • A retrieval cue for extinction attenuates spontaneous recovery
    • Brooks D.C., Bouton M.E. A retrieval cue for extinction attenuates spontaneous recovery. J. Exp. Psych. Anim. Behav. Proc. 1993, 19:77-89.
    • (1993) J. Exp. Psych. Anim. Behav. Proc. , vol.19 , pp. 77-89
    • Brooks, D.C.1    Bouton, M.E.2
  • 9
    • 34247485819 scopus 로고    scopus 로고
    • Neural-network simulations of two context-dependence phenomena
    • Burgos J.E., Murillo-Rodriguez E. Neural-network simulations of two context-dependence phenomena. Behav. Proc. 2007, 75:242-249.
    • (2007) Behav. Proc. , vol.75 , pp. 242-249
    • Burgos, J.E.1    Murillo-Rodriguez, E.2
  • 11
    • 0023035291 scopus 로고
    • Performance of honeybees in reversal and ambiguous-cue problems: tests of a choice model
    • Couvillon P.A., Bitterman M.E. Performance of honeybees in reversal and ambiguous-cue problems: tests of a choice model. Anim. Learn. Behav. 1986, 14:225-231.
    • (1986) Anim. Learn. Behav. , vol.14 , pp. 225-231
    • Couvillon, P.A.1    Bitterman, M.E.2
  • 12
    • 1842814143 scopus 로고    scopus 로고
    • Experimental extinction in Pavlovian conditioning: behavioural and neuroscience perspectives
    • Delamater A.R. Experimental extinction in Pavlovian conditioning: behavioural and neuroscience perspectives. Quart. J. Exp. Psych. B 2004, 57:97-132.
    • (2004) Quart. J. Exp. Psych. B , vol.57 , pp. 97-132
    • Delamater, A.R.1
  • 13
    • 0002200810 scopus 로고
    • Toward a statistical theory of learning
    • Estes W.K. Toward a statistical theory of learning. Psych. Rev. 1950, 57:94-107.
    • (1950) Psych. Rev. , vol.57 , pp. 94-107
    • Estes, W.K.1
  • 14
    • 0000419028 scopus 로고
    • Stimulus-reinforcer and response-reinforcer relations in the control of conditioned appetitive headpoking (goal tracking) in rats
    • Farwell B.J., Ayres J.J.B. Stimulus-reinforcer and response-reinforcer relations in the control of conditioned appetitive headpoking (goal tracking) in rats. Learn. Motiv. 1979, 10:295-312.
    • (1979) Learn. Motiv. , vol.10 , pp. 295-312
    • Farwell, B.J.1    Ayres, J.J.B.2
  • 16
    • 0034169238 scopus 로고    scopus 로고
    • Time, rate, and conditioning
    • Gallistel C.R., Gibbon J. Time, rate, and conditioning. Psych. Rev. 2000, 107:289-344.
    • (2000) Psych. Rev. , vol.107 , pp. 289-344
    • Gallistel, C.R.1    Gibbon, J.2
  • 17
    • 3242678250 scopus 로고    scopus 로고
    • A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning
    • Haselgrove M., Aydin A., Pearce J.M. A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning. J. Exp. Psych. Anim. Behav. Proc. 2004, 30:240-250.
    • (2004) J. Exp. Psych. Anim. Behav. Proc. , vol.30 , pp. 240-250
    • Haselgrove, M.1    Aydin, A.2    Pearce, J.M.3
  • 18
    • 79954724610 scopus 로고
    • Classical conditioning as the formation of interstimulus associations: stimulus substitution, parasitic reinforcement, and autoshaping. In A. Dickinson, R.A. Boakes (Eds.), Mechanisms of learning and motivation: a memorial volume to Jerzy Konorski. Lawrence Erlbaum Associates, Hillsdale, NJ.
    • Hearst, E., 1977. Classical conditioning as the formation of interstimulus associations: stimulus substitution, parasitic reinforcement, and autoshaping. In A. Dickinson, R.A. Boakes (Eds.), Mechanisms of learning and motivation: a memorial volume to Jerzy Konorski. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 19-52.
    • (1977) , pp. 19-52
    • Hearst, E.1
  • 20
    • 0004389892 scopus 로고    scopus 로고
    • Acquired relational equivalence between contexts and features
    • Honey R.C., Watt A. Acquired relational equivalence between contexts and features. J. Exp. Psych. Anim. Behav. Proc. 1999, 25:324-333.
    • (1999) J. Exp. Psych. Anim. Behav. Proc. , vol.25 , pp. 324-333
    • Honey, R.C.1    Watt, A.2
  • 22
    • 0024099853 scopus 로고
    • A layered network model of associative learning: learning to learn and configuration
    • Kehoe E.J. A layered network model of associative learning: learning to learn and configuration. Psych. Rev. 1988, 95:411-433.
    • (1988) Psych. Rev. , vol.95 , pp. 411-433
    • Kehoe, E.J.1
  • 23
    • 0016639430 scopus 로고
    • On the temporal control of behavior
    • Killeen P.R. On the temporal control of behavior. Psych. Rev. 1975, 82:89-115.
    • (1975) Psych. Rev. , vol.82 , pp. 89-115
    • Killeen, P.R.1
  • 24
    • 0001672170 scopus 로고
    • Mathematical principles of reinforcement
    • Killeen P.R. Mathematical principles of reinforcement. Behav. Brain. Sci. 1994, 17:105-135.
    • (1994) Behav. Brain. Sci. , vol.17 , pp. 105-135
    • Killeen, P.R.1
  • 25
    • 0002003357 scopus 로고    scopus 로고
    • The first principle of reinforcement. In C.D.L. Wynne, J.E.R. Staddon (Eds.) Models of Action: Mechanisms for Adaptive Behavior. Lawrence Erlbaum Associates, Mahwah, NJ.
    • Killeen, P.R., 1998. The first principle of reinforcement. In C.D.L. Wynne, J.E.R. Staddon (Eds.) Models of Action: Mechanisms for Adaptive Behavior. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 127-156.
    • (1998) , pp. 127-156
    • Killeen, P.R.1
  • 26
    • 0035293520 scopus 로고    scopus 로고
    • The principal components of response strength
    • Killeen P.R., Hall S.S. The principal components of response strength. J. Exp. Anal. Behav. 2001, 75:111-134.
    • (2001) J. Exp. Anal. Behav. , vol.75 , pp. 111-134
    • Killeen, P.R.1    Hall, S.S.2
  • 27
    • 0036730843 scopus 로고    scopus 로고
    • Molecular analyses of the principal components of response strength
    • Killeen P.R., Hall S.S., Reilly M.P., Kettle L.C. Molecular analyses of the principal components of response strength. J. Exp. Anal. Behav. 2002, 78:127-160.
    • (2002) J. Exp. Anal. Behav. , vol.78 , pp. 127-160
    • Killeen, P.R.1    Hall, S.S.2    Reilly, M.P.3    Kettle, L.C.4
  • 28
    • 0018037178 scopus 로고
    • Arousal: its genesis and manifestation as response rate
    • Killeen P.R., Hanson S.J., Osborne S.R. Arousal: its genesis and manifestation as response rate. Psych. Rev. 1978, 85:571-581.
    • (1978) Psych. Rev. , vol.85 , pp. 571-581
    • Killeen, P.R.1    Hanson, S.J.2    Osborne, S.R.3
  • 31
    • 39449120751 scopus 로고    scopus 로고
    • Associative models can describe both causal learning and conditioning
    • Larrauri J.A., Schmajuk N.A. Associative models can describe both causal learning and conditioning. Behav. Proc. 2008, 77:443-445.
    • (2008) Behav. Proc. , vol.77 , pp. 443-445
    • Larrauri, J.A.1    Schmajuk, N.A.2
  • 32
    • 0019557586 scopus 로고
    • Responses eliminated by noncontingent or negatively contingent reinforcement recover in extinction
    • Lindblom L.L., Jenkins H.M. Responses eliminated by noncontingent or negatively contingent reinforcement recover in extinction. J. Exp. Psych. Anim. Behav. Proc. 1981, 7:175-190.
    • (1981) J. Exp. Psych. Anim. Behav. Proc. , vol.7 , pp. 175-190
    • Lindblom, L.L.1    Jenkins, H.M.2
  • 34
    • 33746358592 scopus 로고
    • Theory of attention: variations in associability of stimuli with reinforcement
    • Mackintosh N.J. Theory of attention: variations in associability of stimuli with reinforcement. Psych. Rev. 1975, 82:276-298.
    • (1975) Psych. Rev. , vol.82 , pp. 276-298
    • Mackintosh, N.J.1
  • 36
    • 0026862446 scopus 로고
    • An integrative model for the study of behavioral momentum
    • Nevin J.A. An integrative model for the study of behavioral momentum. J. Exp. Anal. Behav. 1992, 57:301-316.
    • (1992) J. Exp. Anal. Behav. , vol.57 , pp. 301-316
    • Nevin, J.A.1
  • 37
    • 0034122003 scopus 로고    scopus 로고
    • Behavioral momentum and the law of effect
    • Nevin J.A., Grace R.C. Behavioral momentum and the law of effect. Behav. Brain. Sci. 2000, 73-90.
    • (2000) Behav. Brain. Sci. , pp. 73-90
    • Nevin, J.A.1    Grace, R.C.2
  • 38
    • 18744390388 scopus 로고    scopus 로고
    • Resistance to extinction in steady state and in transition
    • Nevin J.A., Grace R.C. Resistance to extinction in steady state and in transition. J. Exp Psych. Anim. Behav. Proc. 2005, 31:199-212.
    • (2005) J. Exp Psych. Anim. Behav. Proc. , vol.31 , pp. 199-212
    • Nevin, J.A.1    Grace, R.C.2
  • 39
    • 0025427099 scopus 로고
    • Alternative reinforcement increases resistance to change: Pavlovian or operant contingencies?
    • Nevin J.A., Tota M.E., Torquato R.D., Shull R.L. Alternative reinforcement increases resistance to change: Pavlovian or operant contingencies?. J. Exp. Anal. Behav. 1990, 53:359-379.
    • (1990) J. Exp. Anal. Behav. , vol.53 , pp. 359-379
    • Nevin, J.A.1    Tota, M.E.2    Torquato, R.D.3    Shull, R.L.4
  • 41
    • 0019089514 scopus 로고
    • A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli
    • Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psych. Rev. 1980, 87:532-552.
    • (1980) Psych. Rev. , vol.87 , pp. 532-552
    • Pearce, J.M.1    Hall, G.2
  • 42
    • 0000805712 scopus 로고
    • Conditioned approach and contact behavior toward signals for food or brain-stimulation reinforcement
    • Peterson G.B., Ackil J.E., Frommer G.P., Hearst E.S. Conditioned approach and contact behavior toward signals for food or brain-stimulation reinforcement. Science 1972, 1009-1011.
    • (1972) Science , pp. 1009-1011
    • Peterson, G.B.1    Ackil, J.E.2    Frommer, G.P.3    Hearst, E.S.4
  • 43
    • 70450181265 scopus 로고    scopus 로고
    • Behavioral momentum and relapse of extinguished operant responding
    • Podlesnik C.A., Shahan T.A. Behavioral momentum and relapse of extinguished operant responding. Learn. Behav. 2009, 37:357-364.
    • (2009) Learn. Behav. , vol.37 , pp. 357-364
    • Podlesnik, C.A.1    Shahan, T.A.2
  • 44
    • 77951975172 scopus 로고    scopus 로고
    • Extinction, relapse, and behavioral momentum
    • Podlesnik C.A., Shahan T.A. Extinction, relapse, and behavioral momentum. Behav. Proc. 2010, 84:400-411.
    • (2010) Behav. Proc. , vol.84 , pp. 400-411
    • Podlesnik, C.A.1    Shahan, T.A.2
  • 45
    • 0035318450 scopus 로고    scopus 로고
    • Treatments that weaken Pavlovian conditioned fear and thwart its renewal in rats: implications for treating human phobias
    • Rauhut A.S., Thomas B.L., Ayres J.J.B. Treatments that weaken Pavlovian conditioned fear and thwart its renewal in rats: implications for treating human phobias. J. Exp. Psych. Anim. Behav. Proc. 2001, 27:99-114.
    • (2001) J. Exp. Psych. Anim. Behav. Proc. , vol.27 , pp. 99-114
    • Rauhut, A.S.1    Thomas, B.L.2    Ayres, J.J.B.3
  • 46
    • 0027194563 scopus 로고
    • Preservation of response-outcome associations through extinction
    • Rescorla R.A. Preservation of response-outcome associations through extinction. Anim. Learn. Behav. 1993, 21:238-245.
    • (1993) Anim. Learn. Behav. , vol.21 , pp. 238-245
    • Rescorla, R.A.1
  • 47
    • 0002196480 scopus 로고    scopus 로고
    • Experimental extinction. In R.R. Mowrer, S.B. Klein (Eds.), Handbook of contemporary learning theories. Lawrence Erlbaum Associates, Mahwah, NJ.
    • Rescorla, R.A., 2001. Experimental extinction. In R.R. Mowrer, S.B. Klein (Eds.), Handbook of contemporary learning theories. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 119-154.
    • (2001) , pp. 119-154
    • Rescorla, R.A.1
  • 48
    • 0036781457 scopus 로고    scopus 로고
    • Comparison of the rates of associative change during acquisition and extinction
    • Rescorla R.A. Comparison of the rates of associative change during acquisition and extinction. J. Exp. Psych. Anim. Behav. Proc. 2002, 28:406-415.
    • (2002) J. Exp. Psych. Anim. Behav. Proc. , vol.28 , pp. 406-415
    • Rescorla, R.A.1
  • 49
    • 36148963326 scopus 로고    scopus 로고
    • Spontaneous recovery after reversal and partial reinforcement
    • Rescorla R.A. Spontaneous recovery after reversal and partial reinforcement. Learn. Behav. 2007, 35:191-200.
    • (2007) Learn. Behav. , vol.35 , pp. 191-200
    • Rescorla, R.A.1
  • 50
    • 0014085947 scopus 로고
    • Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning
    • Rescorla R.A., Solomon R.L. Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psych. Rev. 1967, 74:151-182.
    • (1967) Psych. Rev. , vol.74 , pp. 151-182
    • Rescorla, R.A.1    Solomon, R.L.2
  • 51
    • 0002109138 scopus 로고
    • A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement
    • Appleton-Century-Crofts, New York, H.A. Black, W.F. Prokasy (Eds.).
    • Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton-Century-Crofts, New York. H.A. Black, W.F. Prokasy (Eds.).
    • (1972) Classical Conditioning II: Current Research and Theory , pp. 64-99
    • Rescorla, R.A.1    Wagner, A.R.2
  • 52
    • 0012657388 scopus 로고
    • The relative effectiveness of certain incentives in animal learning
    • Simmons R. The relative effectiveness of certain incentives in animal learning. Comp. Psych. Monograph. 1924, 11:1-79.
    • (1924) Comp. Psych. Monograph. , vol.11 , pp. 1-79
    • Simmons, R.1
  • 54
    • 0026144263 scopus 로고
    • Blocking between occasion setters and contextual stimuli
    • Swartzentruber D. Blocking between occasion setters and contextual stimuli. J. Exp. Psych. Anim. Behav. Proc. 1991, 17:163-173.
    • (1991) J. Exp. Psych. Anim. Behav. Proc. , vol.17 , pp. 163-173
    • Swartzentruber, D.1
  • 55
    • 0040475748 scopus 로고
    • Context as a conditional cue in operant discrimination reversal learning
    • Thomas D.R., McKelvie A.R., Mah W.L. Context as a conditional cue in operant discrimination reversal learning. J. Exp. Psych. Anim. Behav. Proc. 1985, 11:317-330.
    • (1985) J. Exp. Psych. Anim. Behav. Proc. , vol.11 , pp. 317-330
    • Thomas, D.R.1    McKelvie, A.R.2    Mah, W.L.3
  • 56
    • 0001462431 scopus 로고
    • Behavior systems, associationism, and Pavlovian conditioning
    • Timberlake W. Behavior systems, associationism, and Pavlovian conditioning. Psychon. Bull. Rev. 1994, 1:405-420.
    • (1994) Psychon. Bull. Rev. , vol.1 , pp. 405-420
    • Timberlake, W.1
  • 57
    • 0002283156 scopus 로고
    • SOP: a model of automatic memory processing in animal behavior. In: Spear, N.E., Miller, R.R. (Eds.), Information Processing in Animals: Memory Mechanisms. Erlbaum, Hillsdale, NJ.
    • Wagner, A.R., 1981. SOP: a model of automatic memory processing in animal behavior. In: Spear, N.E., Miller, R.R. (Eds.), Information Processing in Animals: Memory Mechanisms. Erlbaum, Hillsdale, NJ, pp. 5-47.
    • (1981) , pp. 5-47
    • Wagner, A.R.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.