Stochastic reinforcement benefits skill acquisition

Learning and Memory

Volumn 21, Issue 3, 2014, Pages 140-142

  Dayan, Eran ^a   Averbeck, Bruno B ^b   Richmond, Barry J ^b   Cohen, Leonardo G ^a  

^a NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE   (United States)

^b NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; EXECUTIVE FUNCTION; FEEDBACK SYSTEM; HUMAN; INFORMATION PROCESSING; LEARNING; MOTOR PERFORMANCE; PRIORITY JOURNAL; REINFORCEMENT; SIGNAL NOISE RATIO; SKILL ACQUISITION; SKILL RETENTION; STOCHASTIC REINFORCEMENT; TASK PERFORMANCE; UNCERTAINTY; VOLUNTARY MOVEMENT;

ADULT; FEMALE; HUMANS; MALE; PRACTICE (PSYCHOLOGY); PSYCHOMOTOR PERFORMANCE; REINFORCEMENT (PSYCHOLOGY); REWARD; YOUNG ADULT;

EID: 84896361800     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.032417.113     Document Type: Article

References (32)

1. Abe M, Schambra H, Wassermann EM, Luckenbaugh D, Schweighofer N, Cohen LG. 2011. Reward improves long-term retention of a motor memory through induction of offline memory gains. Curr Biol 21:557-562.
2. Bach DR, Dolan RJ. 2012. Knowing how much you don't know: A neural organization of uncertainty estimates. Nat Rev Neurosci 13:572-586.
3. Bell DE, Raiffa H, Tversky A. 1988. Decision making: Descriptive, normative, and prescriptive interactions. Cambridge UniversityPress, Cambridge, UK.
4. Dayan E, Cohen LG. 2011. Neuroplasticity subserving motor skill learning. Neuron 72:443-454.
5. Dayan P, Kakade S, Montague PR. 2000. Learning and selective attention. Nat Neurosci 3 Suppl: 1218-1223.
6. Doyon J, Benali H. 2005. Reorganization and plasticity in the adult brain during learning of motor skills. Curr Opin Neurobiol 15:161-167. (Pubitemid 41569264)
7. Esber GR, Haselgrove M. 2011. Reconciling the influence of predictiveness and uncertainty on stimulus salience: A model of attention in associative learning. Proc Biol Sci 278:2553-2561.
8. Fischer S, Born J. 2009. Anticipated reward enhances offline learning during sleep. J Exp Psychol Learn Mem Cogn 35:1586-1593.
9. Gallistel CR, Gibbon J. 2000. Time, rate, and conditioning. Psychol Rev 107:289-344.
10. Huang VS, Haith A, Mazzoni P, Krakauer JW. 2011. Rethinking motor learning and savings in adaptation paradigms: Model-free memory for successful actions combines with internal models. Neuron 70:787-801.
11. Humphreys LC. 1939. The effect of random alternation of reinforcement on the acquisition and extinction of conditioned eyelid reactions. J Exp Psychol 25:141-158.
12. Izawa J, Shadmehr R. 2011. Learning from sensory and reward prediction errors during motor adaptation. PLoS Comput Biol 7:e1002012.
13. Jenkins WO, Stanley JC Jr. 1950. Partial reinforcement: A review and critique. Psychol Bull 47:193-234.
14. Kaelbling LP, Littman ML, Moore AW. 1996. Reinforcement learning: A survey. J Artif Int Res 4:237-285. (Pubitemid 126646155)
15. McDonnell MD, Ward LM. 2011. The benefits of noise in neural systems: Bridging theory and experiment. Nat Rev Neurosci 12:415-426.
16. Orban G, Wolpert DM. 2011. Representations of uncertainty in sensorimotor control. Curr Opin Neurobiol 21:629-635.
17. Pearce JM, Hall G. 1980. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87:532-552.
18. Platt ML, Huettel SA. 2008. Risky business: The neuroeconomics of decision making under uncertainty. Nat Neurosci 11:398-403. (Pubitemid 351441878)
19. Reis J, Schambra HM, Cohen LG, Buch ER, Fritsch B, Zarahn E, Celnik PA, Krakauer JW. 2009. Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc Natl Acad Sci 106:1590-1595.
20. Schambra HM, Abe M, Luckenbaugh DA, Reis J, Krakauer JW, Cohen LG. 2011. Probing for hemispheric specialization for motor skill learning: A transcranial direct current stimulation study. J Neurophysiol 106:652-661.
21. Schmidt RA, Young DE, Swinnen S, Shapiro DC. 1989. Summary knowledge of results for skill acquisition: Support for the guidance hypothesis. J Exp Psychol Learn Mem Cogn 15:352-359.
22. Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN, Bossaerts P. 2008. Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond B Biol Sci 363:3801-3811.
23. Shadmehr R, Krakauer JW. 2008. A computational neuroanatomy for motor control. Exp Brain Res 185:359-381.
24. Shmuelof L, Huang VS, Haith AM, Delnicki RJ, Mazzoni P, Krakauer JW. 2012. Overcoming motor "forgetting" through reinforcement of learned actions. J Neurosci 32:14617-14621.
25. Shohamy D. 2011. Learning and motivation in the human striatum. Curr Opin Neurobiol 21:408-414.
26. Sutton RS, Barto AG. 1998. Reinforcement learning: An introduction. MIT Press, Cambridge, MA.
27. Swinnen SP. 1996. Information feedback for motor skill learning: A review. In Advances in motor learning and control (ed. Zelaznik HN), pp. 37-66. Human Kinetics, Champaign, IL.
28. Wachter T, Lungu OV, Liu T, Willingham DT, Ashe J. 2009. Differential effect of reward and punishment on procedural learning. J Neurosci 29:436-443.
29. Winstein CJ. 1991. Knowledgeofresults and motor learning-implications for physical therapy. Phys Ther 71:140-149.
30. Wolpert DM, Diedrichsen J, Flanagan JR. 2011. Principles of sensorimotor learning. Nat Rev Neurosci 12:739-751.
31. Yu AJ, Dayan P. 2003. Expected and unexpected uncertainty: ACh and NE in the neocortex. In Advances inneural information processing systems (ed. Becker S, et al.), 15:173-180. MIT Press, Cambridge, MA.
32. Yu AJ, Dayan P. 2005. Uncertainty, neuromodulation, and attention. Neuron 46:681-692. (Pubitemid 40797391)