By carrot or by stick: Cognitive reinforcement learning in Parkinsonism

Science

Volumn 306, Issue 5703, 2004, Pages 1940-1943

  Frank, Michael J ^a   Seeberger, Lauren C ^b   O'Reilly, Randall C ^a  

^a UNIVERSITY OF COLORADO   (United States)

^b Colorado Neurological Institute   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISEASES; ERROR ANALYSIS; HEALTH CARE;

LEARNING AID; LEARNING PROCESSES; MEDICATION; PARKINSON DISEASE;

PATIENT TREATMENT;

DOPAMINE;

LEARNING;

ARTICLE; BASAL GANGLION; CLINICAL ARTICLE; COGNITION; CONTROLLED STUDY; DOPAMINERGIC SYSTEM; HUMAN; LEARNING; MODEL; PARKINSONISM; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; TASK PERFORMANCE;

AGED; ANTIPARKINSON AGENTS; BASAL GANGLIA; COGNITION; COMPUTER SIMULATION; DOPAMINE; FEEDBACK, PSYCHOLOGICAL; FEMALE; FRONTAL LOBE; HUMANS; LEARNING; MALE; MATCHED-PAIR ANALYSIS; MIDDLE AGED; MODELS, NEUROLOGICAL; PARKINSON DISEASE; PROBABILITY; REINFORCEMENT (PSYCHOLOGY);

DAUCUS CAROTA;

EID: 10344250993     PISSN: 00368075     EISSN: None     Source Type: Journal    
DOI: 10.1126/science.1102941     Document Type: Article

References (37)

1. B. J. Knowlton, J. A. Mangels, L. R. Squire, Science 273, 1399 (1996).
2. F. Ashby, L. Alfonso-Reese, A. Turken, E. Waldron, Psychol. Rev. 105, 442 (1998).
3. D. Shohamy et al., Brain 127, 851 (2004).
4. S. Kish, K. Shannak, O. Hornykiewicz, N. Engl. J. Med. 318, 876 (1988).
5. R. A. Wise, P.-P. Rompre, Annu. Rev. Psychol. 40, 191 (1989).
6. R. Swainson et al., Neuropsychologia 38, 596 (2000).
7. R. Cools, R. Barker, B. Sahakian, T. Robbins, Cereb. Cortex 11, 1136 (2001).
8. M. Frank, J. Cognit. Neurosci., in press.
9. R. C. O'Reilly, M. J. Frank, ICS Tech. Rep., University of Colorado Institute of Cognitive Science (2004).
10. C. Gerfen, Annu. Rev. Neurosci. 15, 285 (1992).
11. I. Aubert, I. Ghorayeb, E. Normand, B. Bloch, J. Comp. Neurol. 418, 22 (2000).
12. S. Hernandez-Lopez, J. Bargas, D. Surmeier, A. Reyes, E. Galarraga, J. Neurosci. 17, 3334 (1997).
13. S. Hernandez-Lopez et al., J. Neurosci. 20, 8987 (2000).
14. W. Schultz, Neuron 36, 241 (2002).
15. W. Schultz, P. Dayan, P. R. Montague, Science 275, 1593 (1997).
16. J. Wickens, Network Comput. Neural Syst. 8, R77 (1997).
17. M. Ungless, P. Magill, J. Bolam, Science 303, 2040 (2004).
18. T. Satoh, S. Nakai, T. Sato, M. Kimura, J. Neurosci. 23, 9913 (2003).
19. C. B. Holroyd, M. G. H. Coles, Psychol. Rev. 109, 679 (2002).
20. D. Zald et al., J. Neurosci. 24, 4105 (2004).
21. A. Nishi, G. Snyder, P. Greengard, J. Neurosci. 17, 8147 (1997).
22. D. Centonze, B. Picconi, P. Gubellini, G. Bernardi, P. Calabresi, Eur. J. Neurosci. 13, 1071 (2001).
23. Note that, although participants may become aware of which stimulus they are actually choosing, they are likely not aware of the detailed influence of the history of positive and negative feedback on their choices. This is the sense in which we regard these as procedural or implicit learning tasks.
24. Materials and methods are available as supporting online material on Science Online.
25. M. Frank, J. Rudy, W. Levy, R. O'Reilly, Mem. Cognit., in press.
26. M. Frank, J. Rudy, R. O'Reilly, Hippocampus 13, 341 (2003).
27. L. von Fersen, C. D. L. Wynne, J. D. Delius, J. E. R. Staddon, J. Exp. Psychol. Anim. Behav. Process. 17, 334 (1991).
28. C. Wynne, Anim. Learn. Behav. 23, 207 (1995).
29. J. Delius, M. Siemann, Behav. Processes 42, 107 (1998).
30. M. R. Delgado, H. M. Locke, V. Stenger, J. A. Fiez, Cognit. Affect. Behav. Neurosci. 3, 27 (2003).
31. C. F. Zink, G. Pagnoni, M. E. Martin-Skurski, J. C. Chappelow, G. S. Berns, Neuron 42, 509 (2004).
32. V. Kaasinen et al., Proc. Natl. Acad. Sci. U.S.A. 98, 13272 (2001).
33. R. Tomer, J. Aharon-Peretz, J. Neurol. Neurosurg. Psychiatry 75, 972 (2004).
34. M. J. Frank, B. Loughry, R. C. O'Reilly, Cognit. Affect. Behav. Neurosci. 1, 137 (2001).
35. J. Mink, Prog. Neurobiol. 50, 381 (1996).
36. G. Chevalier, J. M. Deniau, Trends Neurosci. 13, 277 (1990).
37. Supported by Office of Naval Research grants N00014-00-1-0246 and N00014-03-1-0428, and NIH grant MH069S97-01. We thank the staff of the Colorado Neurological Institute for their assistance and K. Richardson for help in administering cognitive tasks to patients and senior participants. We also thank T. Curran, G. McClelland, and Y. Munakata for helpful comments.