Comparative psychology of surprising nonreward

Brain, Behavior and Evolution

Volumn 62, Issue 2, 2003, Pages 83-95

  Papini, Mauricio R ^a  

^a TEXAS CHRISTIAN UNIVERSITY   (United States)

Author keywords

Allocentric learning; Egocentric learning; Emotion; Fear; Frustration; PREE; SNC

Indexed keywords

ANXIOLYTIC AGENT; BENZODIAZEPINE DERIVATIVE; CHLORDIAZEPOXIDE; DOPAMINE RECEPTOR BLOCKING AGENT; HALOPERIDOL;

AMPHIBIA; ANTICIPATION; BEHAVIORAL SCIENCE; BRAIN FUNCTION; CONDITIONING; CONFERENCE PAPER; EGO; EMOTION; ENVIRONMENTAL CHANGE; ENVIRONMENTAL FACTOR; EVOLUTIONARY ADAPTATION; FEAR; FISH; FRUSTRATION; HYPOTHALAMUS HYPOPHYSIS ADRENAL SYSTEM; LEARNING; MODULATION; NONHUMAN; PAIN; PRIORITY JOURNAL; PSYCHOLOGY; REINFORCEMENT; REPTILE; REWARD; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; VERTEBRATE;

AMPHIBIA; ANIMALS; APPETITE; BEHAVIOR, ANIMAL; CONDITIONING (PSYCHOLOGY); EMOTIONS; EVOLUTION; FISHES; HUMANS; REINFORCEMENT (PSYCHOLOGY); REPTILES; REWARD;

MAMMALIA; VERTEBRATA;

EID: 0141522503     PISSN: 00068977     EISSN: None     Source Type: Journal    
DOI: 10.1159/000072439     Document Type: Conference Paper

References (104)

1. Amsel A (1992) Frustration Theory. New York: Cambridge University Press.
2. Amsel A, Roussel J (1952) Motivational properties of frustration: I. Effect on a running response of the addition of frustration to the motivational complex. J Exp Psychol 43:363-368.
3. Archer J (2001) Grief from an evolutionary perspective. In: Handbook of Bereavement Research (Stroebe MS, Hansson RO, Stroebe W, Schut H, eds), pp 263-283. Washington, DC: American Psychological Association.
4. Azrin NH, Hutchinson RR, Hake DF (1966) Extinction-induced aggression. J Exp Anal Behav 9:191-204.
5. Bailey MT, Coe CL (1999) Maternal separation disrupts the integrity of the intestinal microflora in infant rhesus monkeys. Devel Psychobiol 35:146-155.
6. Barton RA, Harvey PH (2000) Mosaic evolution of brain structure in mammals. Nature 405:1055-1058.
7. Bartrop RW, Lockhurst E, Lazarus L, Kiloh LG, Penny R (1977) Depressed lymphocyte function after bereavement. Lancet 1:834-836.
8. Becker HC, Jarvis M, Wagner G, Flaherty CF (1984) Medial and lateral amygdala lesions differentially influence contrast with sucrose solutions. Physiol Behav 33:707-712.
9. Benton MJ (1990) Vertebrate Paleontology. London, UK: Unwin Hyman.
10. Bitterman ME (2000) Cognitive evolution: A psychological perspective. In: The Evolution of Cognition (Heyes C, Huber L, eds), pp 61-79. Cambridge, MA: MIT Press.
11. Blair HT, Schafe GE, Bauer EP, Rodrigues SM, LeDoux JE (2001) Synaptic plasticity in the lateral amygdala: A cellular hypothesis of fear conditioning. Learn Mem 8:229-242.
12. Carbonaro DA, Friend TH, Dellmeier GR, Nuti LC (1992) Behavioral and physiological responses of dairy goats to food thwarting. Physiol Behav 51:303-308.
13. Castro EA (2000) Role of opioids in consummatory successive negative contrast. Unpublished Master's Thesis, Texas Christian University.
14. Coe CL, Stanton ME, Levine S (1983) Adrenal responses to reinforcement and extinction: Role of expectancy versus instrumental responding. Behav Neurosci 97:654-657.
15. Coe CL, Wiener SG, Rosenberg LT, Levine S (1985) Endocrine and immune responses to separation and maternal loss in nonhuman primates. In: The Psychobiology of Attachment and Separation (Reite M, field T, eds), pp 163-200. New York: Academic Press.
16. Couvillon PA, Bitterman ME (1985) Analysis of choice in honeybees. Anim Learn Behav 13:246-252.
17. Crespi LP (1942) Quantitative variation of incentive and performance in the white rat. Am J Psychol 55:467-517.
18. Daly HB (1974) Reinforcing properties of escape from frustration aroused in various learning situations. Psychol Learn Motiv 8:187-231.
19. Dantzer R, Arnone M, Mormede P (1980) Effects of frustration on behaviour and plasma cortico-steroid levels in pigs. Physiol Behav 24:1-4.
20. Davis H, Memmott J, MacFadden L, Levine S (1976) Pituitary-adrenal activity under different appetitive extinction procedures. Physiol Behav 17:687-690.
21. Dudley RT, Papini MR (1995) Pavlovian performance of rats following unexpected reward omissions. Learn Motiv 26:63-82.
22. Dudley RT, Papini MR (1997) Amsel's frustration effect: A Pavlovian replication with control for frequency and distribution of rewards. Physiol Behav 61:627-629.
23. Eisenberg JF (1981) The Mammalian Radiations. An analysis of trends in evolution, adaptation, and behavior. Chicago, IL: University of Chicago Press.
24. Elliott MH (1928) The effect of change of reward on the maze performance of rats. Univ Calif Pub Psychol 4:19-30.
25. Epictetus (2000) Discourses (Oldfather WA, trans), Classical Loeb Collection, Vol. 218. Cambridge, MA: Harvard University Press.
26. Feldon J, Gray JA (1981) The partial reinforcement extinction effect after treatment with chlordiazepoxide. Psychopharmacology 73:269-275.
27. Feldon J, Weiner I (1991) Effects of haloperidol on the multitrial partial reinforcement extinction effect (PREE): Evidence for neuroleptic drug action on nonreinforcement but not on reinforcement. Psychopharmacology 105:407-414.
28. Feldon J, Katz Y, Weiner I (1988) The effects of haloperidol on the partial reinforcement extinction effect (PREE): Implications for neuroleptic drug action on reinforcement and nonreinforcement. Psychopharmacology 95:528-533.
29. Feldon J, Rawlins JNP, Gray JA (1985) Fornix-fimbria section and the partial reinforcement extinction effect. Exp Brain Res 58:435-439.
30. Flaherty CF (1996) Incentive Relativity. Cambridge, UK: Cambridge University Press.
31. Flaherty CF, Becker HC, Pohorecky L (1985) Correlation of corticosterone elevation and negative contrast varies as a function of postshift day. Anim Learn Behav 13:309-314.
32. Flaherty CF, Clarke S, Coppotelli C (1996) Lack of tolerance to contrast-reducing actions of chlordiazepoxide with repeated reward reductions. Physiol Behav 60:645-652.
33. Flaherty CF, Greenwood A, Martin J, Leszczuk M (1998) Relationship of negative contrast to animal models of fear and anxiety. Anim Learn Behav 26:397-407.
34. Flaherty CF, Grigson PS, Rowan GA (1986) Chlordiazepoxide and the determinants of negative contrast. Anim Learn Behav 14:315-321.
35. Gray JA, Dudderidge H (1971) Sodium amylobarbitone, the partial reinforcement extinction effect and the frustration effect in the double runway. Neuropharmacology 10:217-222.
36. Gray JA, McNaughton N (2000) The Neuropsychology of Anxiety. An enquiry into the functions of the septo-hippocampal system. 2nd Edition. Oxford, UK: Oxford University Press.
37. Hall M, Irwin M (2001) Physiological indices of functioning in bereavement. In: Handbook of Bereavement Research (Stroebe MS, Hansson RO, Stroebe W, Schut H, eds), pp 473-492. Washington, DC: American Psychological Association.
38. Haskell M, Coerse NCA, Forkman B (2000) Frustration-induced aggression in the domestic hen: The effect of thwarting access to food and water on aggressive responses and subsequent approach tendencies. Behaviour 137:531-546
39. Henke PG (1973) Effects of reinforcement omission on rats with lesions in the amygdala. J Comp Physiol Psychol 84:187-193.
40. Henke PG (1977) Dissociation of the frustration effect and the partial reinforcement extinction effect after limbic lesions in rats. J Comp Physiol Psychol 91:1032-1038.
41. Henke PG, Maxwell D (1973) Lesions in the amygdala and the frustration effect. Physiol Behav 10:647-650.
42. Holland PWH, Garcia-Fernandez J (1996) Hox genes and chordate evolution. Dev Biol 173:382-395.
43. Hull CL (1943) Principles of Behavior. New York: Appleton-Century-Crofts.
44. Hulse SH (1958) Amount and percentage of reinforcement and duration of goal confinement in conditioning and extinction. J Exp Psychol 56:48-57.
45. Iwahara S, Nagamura N, Iwasaki T (1967) Effect of chlordiazepoxide upon experimental extinction in the straight runway as a function of partial reinforcement in the rat. Jpn Psychol Res 9:128-134.
46. Jerison HJ (1973) Evolution of the Brain and Intelligence. New York: Academic Press.
47. Jones EC (1970) A correlational study of pre- and postgoal competing responses. Psychon Sci 21:25-27.
48. Jordan TC, Coe CL, Patterson J, Levine S (1984) Predictability and coping with separation in infant squirrel monkeys. Behav Neurosci 98:536-560.
49. Kielan-Jaworowska Z (1986) Brain evolution in Mesozoic mammals. In: Vertebrates, Phylogeny, and Philosophy (Flanagan KM, Lillegraven JA, eds), pp 21-34. Laramie, WY: University of Wyoming Press.
50. Kling A, Lloyd R, Tachiki K, Prince H, Klimenko V, Korneva E (1992) Effects of social separation on immune function and brain neuro-transmitters in cebus monkeys (C. apella). Ann New York Acad Sci 650:257-261.
51. Klinger E (1975) Consequences of commitment to and disengagement from incentives. Psychol Rev 82:1-25.
52. Kobre KR, Lipsitt LP (1972) A negative contrast effect in newborns. J Exp Child Psychol 14:81-91.
53. Lobaugh NJ, Bootin M, Amsel A (1985) Sparing of patterned alternation but not partial reinforcement effect after infant and adult hippocampal lesions in the rat. Behav Neurosci 99:46-59.
54. Lyons DM, Fong KD, Schrieken N, Levine S (2000) Frustrative nonreward and pituitary-adrenal activity in squirrel monkeys. Physiol Behav 71:559-563.
55. MacLean PD (1990) The Triune Brain in Evolution. New York: Plenum Press.
56. Macphail EM (1982) Brain and Intelligence in Vertebrates. Oxford, UK: Clarendon Press.
57. McNaughton N (1984) Effects of anxiolytic drugs on the partial reinforcement effect in runway and Skinner box. Q J Exp Psychol 36B:319-330.
58. Mikulka PJ, Lehr R, Pavlik WB (1967) Effect of reinforcement schedules on reward shifts. J Exp Psychol 74:57-61.
59. Mitchell C, Flaherty CF (1998) Temporal dynamics of corticosterone elevation in successive negative contrast. Physiol Behav 64:287-292.
60. Mustaca AE, Bentosela M, Papini MR (2000) Consummatory successive negative contrast in mice. Learn Motiv 31:272-282.
61. Muzio RN, Segura ET, Papini MR (1993) Effects of lesions in the medial pallium on instrumental learning in the toad (Bufo arenarum). Physiol Behav 54:185-188.
62. Muzio RN, Segura ET, Papini MR (1994) Learning under partial reinforcement in the toad (Bufo arenarum): Effects of lesions in the medial pallium. Behav Neural Biol 61:36-46.
63. Nissen HW (1958). Axes of behavioral comparison. In: Behavior and Evolution (Roe A, Simpson GG, eds), pp 183-205. New Haven, CT: Yale University Press.
64. Northcutt RG, Ronan M (1992) Afferent and efferent connections of the bullfrog medial pallium. Brain Behav Evol 40:1-16.
65. Overmier JB, Papini MR (1986) Factors modulating the effects of teleost telencephalon ablation on retention, relearning, and extinction of instrumental avoidance behavior. Behav Neurosci 100:190-199.
66. Papini MR (1997) Role of reinforcement in spaced-trial operant learning in pigeons (columba livia). J Comp Psychol 111:275-285.
67. Papini MR (2002a) Comparative Psychology. Evolution and development of behavior. Upper Saddle River, NJ: Prentice hall
68. Papini MR (2002b) Pattern and process in the evolution of learning. Psychol Rev 109:186-201.
69. Papini MR, Dudley RT (1997) Consequences of surprising reward omissions. Rev Gen Psychol 1:175-197.
70. Papini MR, Hollingsworth PR (1998) Role of nonreinforcement in the fixed-interval performance of pigeons. Psychon Bull Rev 5:84-90.
71. Papini MR, Mustaca AE, Bitterman ME (1988) Successive negative contrast in the consummatory responding of didelphid marsupials. Anim Learn Behav 16:53-57.
72. Papini MR, Muzio RN, Segura ET (1995) Instrumental learning in toads (Bufo arenarum): Reinforcer magnitude and the medial pallium. Brain Behav Evol 46:61-71.
73. Papini MR, Thomas BL (1997) Spaced-trial operant learning with purely instrumental contingencies in pigeons (Columba livia). Int J Comp Psychol 10:128-136.
74. Papini MR, Thomas BL, McVicar DG (2002) Between-subject PREE and within-subject reversed PREE in spaced-trial extinction with pigeons. Learn Motiv 33:485-509.
75. Pellegrini S, Papini MR (2002) Partial reinforcement attenuates consummatory successive negative contrast. Abst Psychon Soc 7:56.
76. portavella M, Salas C, Vargas JP, Papini MR (in press) Implication of telencephalon in spaced-trial avoidance learning in the goldfish (Carassius auratus). Physiol Behav.
77. Raff RA (1996) The Shape of Life. Genes, development, and the evolution of animal form. Chicago, IL: University of Chicago Press.
78. Rando TA (1993) Treatment of Complicated Mourning. Champaign, IL: Research Press.
79. Rawlins JNP, Feldon J, Gray JA (1980) The effects of hippocampectomy and of fimbria section upon the partial reinforcement extinction effect in rats. Exp Brain Res 38:273-283.
80. Reite M, Capitanio JP (1985) On the nature of social separation and social attachment. In: The Psychobiology of Attachment and Separation (Reite M, Field T, eds), pp 223-255. New York: Academic press.
81. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning: II. Current research and theory (Black AH, Prokasy WF, eds), pp 64-99. New York: Appleton-Century-Crofts.
82. Roberts WA, Bullock DH, Bitterman ME (1963) Resistance to extinction in the pigeon after partially reinforced instrumental training under discrete-trials conditions. Am J Psychol 76: 353-365.
83. Rodenburg TB, Zimmerman PH, Koene P (2002) Reaction to frustration in high and low feather pecking laying hens. Behav Proc 59:121-129.
84. Rosen AJ, Tessel RE (1970) Chlorpromazine, chlordiazepoxide and incentive shift performance in the rat. J Comp Physiol Psychol 72:257-262.
85. Rowan GA, Flaherty CF (1987) The effects of morphine in the consummatory contrast paradigm. Psychophramacology 93:51-58.
86. Schleifer SJ, Keller SE, Camerino M, Thornton JC, Stein M (1983) Suppression of lymphocyte stimulation following bereavement. J Am Med Assoc 250:374-377.
87. Schmajuk N (1997) Animal Learning and Cognition. Cambridge, UK: Cambridge University Press.
88. Scully J, Tosi H, Banning K (2000) Life event checklists: Revisiting the Social Readjustment Rating Scale after 30 years. Educ Psychol Measur 60:864-876.
89. Seneca LA (1996) On providence. In: Moral Essays, Vol. I (Basore JW, trans), Classical Loeb Collection, Vol. 214. Cambridge, MA: Harvard University Press.
90. Seneca LA (1996) On anger. In: Moral Essays, Vol. I (Basore JW, trans), Classical Loeb Collection, Vol. 214. Cambridge, MA: Harvard University Press.
91. Seneca LA (1996) On tranquility of mind. In: Moral Essays, Vol. II (Basore JW, trans), Classical Loeb Collection, Vol. 254. Cambridge, MA: Harvard University Press.
92. Stamps J (1998) Territoriality. In: Comparative Psychology (Greenberg G, Haraway MM, eds), pp 761-770. New York: Garland Publishing.
93. Stein M, Trestman RL (1990) Psychiatric perspectives of brain, behavior, and the immune system. In: Immunologic Mechanisms in Neurologic and Psychiatric Disease (Waksman BH, ed), pp 161-169. New York: Raven Press.
94. Stout SC, Boughner RL, Papini MR (in press) Reexamining the frustration effect in rats: Aftereffects of surprising reinforcement and nonreinforcement. Learn Motiv.
95. Stout SC, Muzio RN, Boughner RL, Papini MR (2002) Aftereffects of the surprising presentation and omission of appetitive reinforcers on key-pecking peformance in pigeons. J Exp Psychol: Anim Behav Proc 28:242-256.
96. Suomi SJ (1991) Primate separation models of affective disorders. In: Neurobiology of Learning, Emotion, and Affect (Madden J IV, ed), pp 195-214. New York: Raven Press.
97. Swanson AM, Isaacson RL (1967) Hippocampal ablation and performance during withdrawal of reinforcement. J Comp Physiol Psychol 64:30-35.
98. Terrace HS (1971) Escape from S-. Learn Motiv 2:148-163.
99. Terrace HS (1972) By-products of discrimination learning. Psychol Learn Motiv 5:195-265.
100. Thomas BL, Papini MR (2001) Adrenalectomy eliminates the extinction spike in autoshaping with rats. Physiol Behav 72:543-547.
101. Thomas BL, Papini MR (2003) Mechanisms of spaced-trial runway extinction in pigeons. Learn Motiv 34:104-126.
102. Thorndike EL (1911) Animal Intelligence: Experimental studies. New York: Macmillan.
103. Tondat LM, Daly HB (1972) The combined effects of frustrative nonreward and shock on aggression between rats. Psychon Sci 28:25-28.
104. Vogel JR, Mikulka PJ, Spear NE (1968) Effects of shifts in sucrose and saccharine concentrations on licking behavior in the rat. J Comp Physiol Psychol 66:661-666.