Its own reward: Lessons to be drawn from the reversed-reward contingency paradigm

Animal Cognition

Volumn 12, Issue 4, 2009, Pages 547-558

  Shifferman, Eran M ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

Behavioral inhibition; Cognition; Economic choice; Evolutionary developmental biology; Numerosity; Relative numerousness judgment; Weber's law

Indexed keywords

ANIMAL; ARTICLE; COGNITION; COMPREHENSION; CONCEPT FORMATION; LEARNING; MATHEMATICAL PHENOMENA; REWARD;

ANIMALS; ASSOCIATION LEARNING; COGNITION; COMPREHENSION; CONCEPT FORMATION; MATHEMATICAL CONCEPTS; REVERSAL LEARNING; REWARD;

ANIMALIA;

EID: 67949122055     PISSN: 14359448     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10071-009-0215-2     Document Type: Article

References (74)

1. C Agrillo M Dadda G Serena A Bisazza 2008 Do fish count? Spontaneous discrimination of quantity in female mosquitofish Anim Cogn 11 3 495 503
2. A Albaich-Serrano F Guillén-Salazar J Call 2007 Mangabeys (Cercocebus torquatus lunulatus) solve the reverse contingency task without a modified procedure Anim Cogn 10 387 396
3. ML Anderson 2006 Evidence for massive redeployment of brain areas in cognitive function Proc Cogn Sci Soc 28 24 29
4. ML Anderson 2007 Evolution of cognitive function via redeployment of brain areas Neuroscientist 13 1 13 21
5. ML Anderson 2007 Massive redeployment, exaptation, and the functional integration of cognitive operations Synthese 159 3 329 345
6. JR Anderson S Awazu K Fujita 2000 Can squirrel monkeys (Saimiri sciureus) learn self-control? A study using food array selection tests and reverse-reward contingency J Exp Psychol Anim Behav Process 26 1 87 97
7. JR Anderson S Awazu K Fujita 2004 Squirrel monkeys (Saimiri sciureus) choose smaller food arrays: long-term retention, choice with nonpreferred food, and transposition J Comp Psychol 118 1 58 64
8. MJ Beran TA Evans EH Harris 2008 Perception of food amounts by chimpanzees based on the number, size, contour length and visibility of items Anim Behav 75 5 1793 1802
9. D Biro T Matsuzawa 2001 Use of numerical symbols by the chimpanzee (Pan troglodytes): Cardinals, ordinals, and the introduction of zero Anim Cogn 4 3-4 193 199
10. ST Boysen GG Berntson 1989 Numerical competence in a chimpanzee (Pan troglodytes) J Comp Psychol 103 1 23 31
11. ST Boysen GG Berntson 1995 Responses to quantity - perceptual versus cognitive mechanisms in chimpanzees (Pan troglodytes) J Exp Psychol Anim Behav Process 21 1 82 86
12. ST Boysen GG Bernston MB Hannan JT Cacioppo 1996 Quantity-based interference and symbolic representations in chimpanzees (Pan troglodytes) J Exp Psychol Anim Behav Process 22 76 86
13. ST Boysen KL Mukobi GG Berntson 1999 Overcoming response bias using symbolic representations of number by chimpanzees (Pan troglodytes) Anim Learn Behav 27 2 229 235
14. ST Boysen GG Berntson KL Mukobi 2001 Size matters: impact of item size and quantity on array choice by chimpanzees (Pan troglodytes) J Comp Psychol 115 1 106 110
15. Brannon EM, Roitman J (2003) Nonverbal representations of time and number in non-human animals and human infants. In: Meck W (ed) Functional and neural mechanisms of interval timing. CRC Press, New York, pp 143-182
16. L Chittka K Geiger 1995 Can honey-bees count landmarks Anim Behav 49 1 159 164
17. Y Chudasama J Kralik E Murray 2007 Rhesus monkeys with orbital prefrontal cortex lesions can learn to inhibit prepotent responses in the reversed reward contingency task Cereb Cortex 17 5 1154 1159
18. Dacke M, Srinivasan MV (2008). Evidence for counting in insects. Anim Cogn. doi: 10.1007/s10071-008-0159-y
19. S Dehaene 2002 Single-neuron arithmetic Science 297 5587 1652 1653
20. S Dehaene JP Changeux 1993 Development of elementary numerical abilities: a neuronal model J Cogn Neuro 5 4 390 407
21. TA Evans MJ Beran 2007 Delay of gratification and delay maintenance by rhesus macaques (Macaca mulatta) J Gen Psychol 134 2 199 216
22. E Genty JJ Roeder 2006 Self-control: why should sea lions, Zalophus californianus, perform better than primates? Anim Behav 72 6 1241 1247
23. E Genty JJ Roeder 2007 Transfer of self-control in black (Eulemur macaco) and brown (Eulemur fulvus) lemurs: choice of a less preferred food item under a reverse-reward contingency J Comp Psychol 121 4 354 362
24. E Genty C Palmier JJ Roeder 2004 Learning to suppress responses to the larger of two rewards in two species of lemurs, Eulemur fulvus and E. macaco Anim Behav 67 925 932
25. JG Godin M Keenleyside 1984 Foraging on patchily distributed prey by a cichlid fish (Teleostei, Cichlidae): a test of the ideal free distribution theory Anim Behav 32 120 131
26. SJ Gould E Vrba 1982 Exaptation: a missing term in the science of form Paleobiology 8 1 4 15
27. MD Hauser 1999 Perseveration, inhibition and the prefrontal cortex: a new look Curr Opin Neurobiol 9 2 214 222
28. BY Hayden ML Platt 2007 Animal cognition - great apes wait for grapes Curr Biol 17 21 R922 R923
29. DJ Hoare ID Couzin JGJ Godin J Krause 2004 Context-dependent group-size choice in fish Anim Behav 67 1 155 164
30. SD Iversen M Mishkin 1970 Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity Exp Brain Res 11 4 376 386
31. B Jones M Mishkin 1972 Limbic lesions and the problem of stimulus-reinforcement associations Exp Neurol 36 2 362 377
32. T Kalenscher T Ohmann O Güntürkün 2006 The neuroscience of impulsive and self-controlled decisions Int J Psychophysiol 62 203 211
33. R Karban CA Black SA Weinbaum 2000 How 17-year cicadas keep track of time Ecol Lett 3 3 253 256
34. JD Kralik 2005 Inhibitory control and response selection in problem solving: how cotton-top tamarins (Saguinus oedipus) overcome a bias for selecting the larger quantity of food J Comp Psychol 119 1 78 89
35. JD Kralik MD Hauser R Zimlicki 2002 The relationship between problem solving and inhibitory control: cotton-top tamarin (Saguinus oedipus) performance on a reversed contingency task J Comp Psychol 116 1 39 50
36. LE Krueger 1989 Reconciling Fechner and Stevens: toward a unified psychophysical law Behav Brain Sci 12 2 251 267
37. H Kudo RIM Dunbar 2001 Neocortex size and social network size in primates Anim Behav 62 4 711 722
38. EE Leppik 1953 The ability of insects to distinguish number Am Nat 87 835 229 236
39. Mischel W (1974) Processes in delay of gratification. In: Berkowitz L (ed) Adavnces in experimental social psychology. Academic Press, New York, pp 249-292
40. EA Murray JD Kralik SP Wise 2005 Learning to inhibit prepotent responses: successful performance by rhesus macaques, Macaca mulatta, on the reversed-contingency task Anim Behav 69 991 998
41. A Nieder 2005 Counting on neurons: the neurobiology of numerical competence Nat Rev Neurosci 6 3 1 14
42. A Nieder K Merten 2007 A labeled-line code for small and large numerosities in the monkey prefrontal cortex J Neurosci 27 22 5986 5993
43. A Nieder EK Miller 2003 Coding of cognitive magnitude: compressed scaling of numerical information in the primate prefrontal cortex Neuron 37 1 149 157
44. A Nieder EK Miller 2004 A parieto-frontal network for visual numerical information in the monkey PNAS 101 19 7457 7462
45. A Nieder EK Miller 2004 Analog numerical representations in rhesus monkeys: evidence for parallel processing J Cogn Neurosci 16 5 889 901
46. A Nieder DJ Freedman EK Miller 2002 Representation of the quantity of visual items in the primate prefrontal cortex Science 297 5587 1708 1711
47. A Nieder I Diester O Tudusciuc 2006 Temporal and spatial enumeration processes in the primate parietal cortex Science 313 5792 1431 1435
48. C Padoa-Schioppa 2007 Orbitofrontal cortex and the computation of economic value Ann N Y Acad Sci 1121 232 253
49. C Padoa-Schioppa JA Assad 2006 Neurons in the orbitofromtal cortex encode economic value Nature 441 7090 223 226
50. C Padoa-Schioppa JA Assad 2008 The representation of economic value in the orbitofrontal cortex is invariant for changes of menu Nat Neurosci 11 1 95 102
51. C Padoa-Schioppa L Jandolo E Visalberghi 2006 Multi-stage mental process for economic choice in capuchins Cognition 99 1 B1 B13
52. IM Pepperberg 2006 Grey parrot (Psittacus erithacus) numerical abilities: addition and further experiments on a zero-like concept J Comp Psychol 120 1 1 11
53. IM Pepperberg JD Gordon 2005 Number comprehension by a grey parrot (Psittacus erithacus), including a zero-like concept J Comp Psychol 119 2 197 209
54. Reznikova ZI, Ryabko BY (2001) A study of ants' numerical competence. Elec Trans Art Intel 5(Sect B):111-126
55. KR Ridderinkhof WPM van den Wildenberg SJ Segalowitz CS Carter 2004 Neurocognitive mechanisms of cognitive control: the role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning Brain Cogn 56 2 129 140
56. AC Roberts JD Wallis 2000 Inhibitory control and affective processing in the prefrontal cortex: neuropsychological studies in the common marmoset Cereb Cortex 10 252 262
57. RD Rogers AM Owen HC Middleton EJ Williams JD Pickard BJ Sahakian TW Robbins 1999 Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex J Neurosci 19 20 9029 9038
58. AG Rosati JR Stevens B Hare MD Hauser 2007 The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults Curr Biol 17 1663 1668
59. RW Shumaker AM Palkovich BB Beck GA Guagnano H Morowitz 2001 Spontaneous use of magnitude discrimination and ordination by the orangutan (Pongo pygmaeus) J Comp Psychol 115 4 385 391
60. A Silberberg K Fujita 1996 Pointing at smaller food amounts in an analogue of Boysen and Berntson's (1995) procedure J Exp Anal Behav 66 1 143 147
61. JR Stevens EV Hallinan MD Hauser 2005 The ecology and evolution of patience in two New world monkeys Biol Lett 1 2 223 226
62. C Suda J Call 2004 Piagetian liquid conservation in the Great Apes (Pan paniscus, Pan troglodytes, and Pongo pygmaeus) J Comp Psychol 118 3 265 279
63. GM Sulkowski MD Hauser 2001 Can rhesus monkeys spontaneously subtract? Cognition 79 3 239 262
64. RW Tegeder J Krause 1995 Density dependence and numerosity in fright stimulated aggregation behaviour of shoaling fish Philos Tran R Soc Lond B Biol Sci 350 1334 381 390
65. Tomasello M, Call J (1997) Primate cognition. Oxford University Press, New York
66. O Tudusciuc A Nieder 2007 Neuronal population coding of continuous and discrete quantity in the primate posterior parietal cortex PNAS 104 36 14513 14518
67. J Uher J Call 2008 How the great apes (Pan troglodytes, Pongo pygmaeus, Pan paniscus, Gorilla gorilla) perform on the reversed reward contingency task II: transfer to new quantities, long-term retention, and the impact of quantity ratios J Comp Psychol 122 2 204 212
68. C Uller R Jaeger G Guidry C Martin 2003 Salamanders (Plethodon cinereus) go for more: rudiments of number in an amphibian Anim Cogn 6 2 105 112
69. PHJM Vlamings J Uher J Call 2006 How the great apes (Pan troglodytes, Pongo pygmaeus, Pan paniscus, and Gorilla gorilla) perform on the reversed contingency task: the effects of food quantity and food visibility J Exp Psychol Anim Behav Process 32 1 6 70
70. Waddington CH (1957) The strategy of the genes. Allen & Unwin, London
71. Waddington CH (1959) Biological organization: cellular and subcellular. Pergamon Press, New York
72. Waddington CH (1962) Genetics and development. Columbia University Press, London
73. JD Wallis EK Miller 2003 Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task Eur J Neurosci 18 7 2069 2081
74. West-Eberhard MJ (2003) Developmental plasticity and evolution. Oxford University Press, Oxford