Why skill matters

Trends in Cognitive Sciences

Volumn 17, Issue 9, 2013, Pages 434-441

  Hikosaka, Okihide ^a   Yamamoto, Shinya ^a,b   Yasuda, Masaharu ^a   Kim, Hyoung F ^a  

^a NATIONAL EYE INSTITUTE   (United States)

^b NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Automaticity; Gaze; Object value memory; Reward delay; Saccade; Stable value

Indexed keywords

AUTOMATIC ACQUISITION; AUTOMATICITY; GAZE; HIGH-CAPACITY MEMORY; REWARD DELAY; STABLE VALUE; TWO-COMPONENT; VALUE-BASED;

EYE MOVEMENTS;

COGNITIVE SYSTEMS;

ATTENTION; BEHAVIOR; EPISODIC MEMORY; GAZE; HUMAN; LEARNING; MENTAL CAPACITY; MOTIVATION; NONHUMAN; PRIMATE; REVIEW; REWARD; SKILL; SURVIVAL; VISUAL INFORMATION; WORKING MEMORY;

AUTOMATICITY; GAZE; OBJECT-VALUE MEMORY; REWARD DELAY; SACCADE; STABLE VALUE;

ANIMALS; ATTENTION; BRAIN; EYE MOVEMENTS; HUMANS; MOTIVATION; NEURAL PATHWAYS; REWARD; VISUAL PERCEPTION;

EID: 84882858866     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2013.07.001     Document Type: Review

References (111)

1. Newell A., Rosenbloom P.S. Mechanisms of skill acquisition and the law of practice. Cognitive Skills and Their Acquisition 1981, 1-55. Erlbaum. J.R. Anderson (Ed.).
2. Ericsson K.A., Lehmann A.C. Expert and exceptional performance: evidence of maximal adaptation to task constraints. Ann. Rev. Psychol. 1996, 47:273-305.
3. Gurven M., et al. How long does it take to become a proficient hunter? Implications for the evolution of extended development and long life span. J. Hum. Evol. 2006, 51:454-470.
4. Kaplan H.S., Robson A.J. The emergence of humans: the coevolution of intelligence and longevity with intergenerational transfers. Proc. Natl. Acad. Sci. U.S.A. 2002, 99:10221-10226.
5. Helton W.S. Expertise acquisition as sustained learning in humans and other animals: commonalities across species. Anim. Cogn. 2008, 11:99-107.
6. Doyon J. Skill learning. Int. Rev. Neurobiol. 1997, 41:273-294.
7. Ashby F.G., et al. Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci. 2010, 14:208-215.
8. Hikosaka O., et al. Central mechanisms of motor skill learning. Curr. Opin. Neurobiol. 2002, 12:217-222.
9. Salmon D.P., Butters N. Neurobiology of skill and habit learning. Curr. Opin. Neurobiol. 1995, 5:184-190.
10. Willingham D.B. A neuropsychological theory of motor skill learning. Psychol. Rev. 1998, 105:558-584.
11. Poldrack R.A., et al. The neural correlates of motor skill automaticity. J. Neurosci. 2005, 25:5356-5364.
12. Yin H.H., et al. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat. Neurosci. 2009, 12:333-341.
13. Seger C.A., Spiering B.J. A critical review of habit learning and the basal ganglia. Front. Syst. Neurosci. 2011, 5:66.
14. Rodriguez M.L., Logue A.W. Adjusting delay to reinforcement: comparing choice in pigeons and humans. J. Exp. Psychol. Anim. Behav. Process. 1988, 14:105-117.
15. Rosati A.G., et al. The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults. Curr. Biol. 2007, 17:1663-1668.
16. Myerson J., Green L. Discounting of delayed rewards: Models of individual choice. J. Exp. Anal. Behav. 1995, 64:263-276.
17. Pyke G.H., et al. Optimal foraging: a selective review of theory and tests. Q. Rev. Biol. 1977, 52:137-154.
18. Emlen J.M. The role of time and energy in food preference. Am. Nat. 1966, 100:611-617.
19. Chung S.H., Herrnstein R.J. Choice and delay of reinforcement. J. Exp. Anal. Behav. 1967, 10:67-74.
20. Shadmehr R. Control of movements and temporal discounting of reward. Curr. Opin. Neurobiol. 2010, 20:726-730.
21. Shadmehr R., et al. Temporal discounting of reward and the cost of time in motor control. J. Neurosci. 2010, 30:10507-10516.
22. Niv Y., et al. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 2007, 191:507-520.
23. Haith A.M., et al. Evidence for hyperbolic temporal discounting of reward in control of movements. J. Neurosci. 2012, 32:11727-11736.
24. Takikawa Y., et al. Modulation of saccadic eye movements by predicted reward outcome. Exp. Brain Res. 2002, 142:284-291.
25. Lauwereyns J., et al. A neural correlate of response bias in monkey caudate nucleus. Nature 2002, 418:413-417.
26. Bowman E.M., et al. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J. Neurophysiol. 1996, 75:1061-1073.
27. Minamimoto T., et al. Complementary process to response bias in the centromedian nucleus of the thalamus. Science 2005, 308:1798-1801.
28. Crossman E.R.F.W. A theory of the acquisition of speed-skill. Ergonomics 1959, 2:153-166.
29. Gunst N., et al. Development of skilled detection and extraction of embedded prey by wild brown capuchin monkeys (Cebus apella apella). J. Comp. Psychol. 2010, 124:194-204.
30. Dayan P., Balleine B. Reward, motivation, and reinforcement learning. Neuron 2002, 36:285-298.
31. Kamil A.C., Roitblat H.L. The ecology of foraging behavior: implications for animal learning and memory. Ann. Rev. Psychol. 1985, 36:141-169.
32. Shiffrin R.M., Schneider W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychol. Rev. 1977, 84:127-190.
33. Sigman M., Gilbert C.D. Learning to find a shape. Nat. Neurosci. 2000, 3:264-269.
34. Karni A., Bertini G. Learning perceptual skills: behavioral probes into adult cortical plasticity. Curr. Opin. Neurobiol. 1997, 7:530-535.
35. Ahissar M., Hochstein S. Learning pop-out detection: specificities to stimulus characteristics. Vision Res. 1996, 36:3487-3500.
36. Seitz A.R., et al. Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron 2009, 61:700-707.
37. Schwartz B.L., Evans S. Episodic memory in primates. Am. J. Primatol. 2001, 55:71-85.
38. Hikosaka O., et al. Parallel neural networks for learning sequential procedures. Trends Neurosci. 1999, 22:464-471.
39. Krakauer J.W., Mazzoni P. Human sensorimotor learning: adaptation, skill, and beyond. Curr. Opin. Neurobiol. 2011, 21:636-644.
40. Adams J.A. Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. Psychol. Bull. 1987, 101:41-74.
41. Gottlieb J. Attention, learning, and the value of information. Neuron 2012, 76:281-295.
42. Awh E., et al. Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn. Sci. 2012, 16:437-443.
43. Nissen M.J., Bullemer P. Attentional requirements of learning: evidence from performance measures. Cogn. Psychol. 1987, 19:1-32.
44. Chun M.M. Contextual cueing of visual attention. Trends Cog. Sci. 2000, 4:170-178.
45. Williams A.M. Perceptual skill in soccer: implications for talent identification and development. J. Sports Sci. 2000, 18:737-750.
46. Dye M.W., et al. Increasing speed of processing with action video games. Curr. Dir. Psychol. Sci. 2009, 18:321-326.
47. Rowe C. Receiver psychology and the evolution of multicomponent signals. Anim. Behav. 1999, 58:921-931.
48. Laska M., et al. Which senses play a role in nonhuman primate food selection? A comparison between squirrel monkeys and spider monkeys. Am. J. Primatol. 2007, 69:282-294.
49. Kulahci I.G., et al. Multimodal signals enhance decision making in foraging bumble-bees. Proc. Biol. Sci. 2008, 275:797-802.
50. Orban G.A., et al. Comparative mapping of higher visual areas in monkeys and humans. Trends Cog. Sci. 2004, 8:315-324.
51. Paukner A., et al. Tufted capuchin monkeys (Cebus apella) spontaneously use visual but not acoustic information to find hidden food items. J. Comp. Psychol. 2009, 123:26-33.
52. Hikosaka O., et al. Basal ganglia orient eyes to reward. J. Neurophysiol. 2006, 95:567-584.
53. Peck C.J., et al. Reward modulates attention independently of action value in posterior parietal cortex. J. Neurosci. 2009, 29:11182-11191.
54. Theeuwes J., Belopolsky A.V. Reward grabs the eye: oculomotor capture by rewarding stimuli. Vision Res. 2012, 74:80-85.
55. Hickey C., et al. Reward guides vision when it's your thing: trait reward-seeking in reward-mediated visual priming. PLoS ONE 2010, 5:e14087.
56. Kristjansson A., et al. Fortune and reversals of fortune in visual search: Reward contingencies for pop-out targets affect search efficiency and target repetition effects. Atten. Percept. Psychophys. 2010, 72:1229-1236.
57. Anderson B.A., et al. Value-driven attentional capture. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:10367-10371.
58. Chelazzi L., et al. Rewards teach visual selective attention. Vision Res. 2013, 85:58-72.
59. Hayhoe M., Ballard D. Eye movements in natural behavior. Trends Cogn. Sci. 2005, 9:188-194.
60. Miyashita K., et al. Anticipatory saccades in sequential procedural learning in monkeys. J. Neurophysiol. 1996, 76:1361-1366.
61. Johansson R.S., et al. Eye-hand coordination in object manipulation. J. Neurosci. 2001, 21:6917-6932.
62. Land M.F. Eye movements and the control of actions in everyday life. Prog. Retin. Eye Res. 2006, 25:296-324.
63. Yamamoto S., et al. Reward value-contingent changes of visual responses in the primate caudate tail associated with a visuomotor skill. J. Neurosci. 2013, 33:11227-11238.
64. Yamamoto S., et al. What and where information in the caudate tail guides saccades to visual objects. J. Neurosci. 2012, 32:11005-11016.
65. Yasuda M., et al. Robust representation of stable object values in the oculomotor basal ganglia. J. Neurosci. 2012, 32:16917-16932.
66. Kato M., et al. Eye movements in monkeys with local dopamine depletion in the caudate nucleus. I. Deficits in spontaneous saccades. J. Neurosci. 1995, 15:912-927.
67. Berg D.J., et al. Free viewing of dynamic stimuli by humans and monkeys. J. Vis. 2009, 9:19. 11-15.
68. Fuchs A.F. Saccadic and smooth pursuit eye movements in the monkey. J. Physiol. 1967, 191:609-631.
69. Logan G.D. Skill and automaticity: Relations, implications, and future directions. Can. J. Psychol. 1985, 39:367-386.
70. Chun M.M., Jiang Y. Contextual cueing: implicit learning and memory of visual context guides spatial attention. Cogn. Psychol. 1998, 36:28-71.
71. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Ann. Rev. Neurosci. 1995, 18:193-222.
72. Cowan N. The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav. Brain Sci. 2001, 24:87-185.
73. Sternberg S. Memory-scanning: mental processes revealed by reaction-time experiments. Am. Sci. 1969, 57:421-457.
74. Treisman A.M., Gelade G. A feature-integration theory of attention. Cogn. Psychol. 1980, 12:97-136.
75. Squire L.R., Zola S.M. Structure and function of declarative and nondeclarative memory systems. Proc. Natl. Acad. Sci. U.S.A. 1996, 93:13515-13522.
76. Saint-Cyr J.A., et al. Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido-nigral complex in the monkey. J. Comp. Neurol. 1990, 298:129-156.
77. Fernandez-Ruiz J., et al. Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum. Proc. Natl. Acad. Sci. U.S.A. 2001, 98:4196-4201.
78. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
79. Schultz W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 2006, 57:87-115.
80. Della Libera C., et al. Dissociable effects of reward on attentional learning: from passive associations to active monitoring. PLoS ONE 2011, 6:e19460.
81. Hikosaka O., et al. Long-term retention of motor skill in macaque monkeys and humans. Exp. Brain Res. 2002, 147:494-504.
82. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005, 8:1481-1489.
83. Ashby F.G., Maddox W.T. Human category learning. Annu. Rev. Psychol. 2005, 56:149-178.
84. Daw N.D., et al. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
85. Evans J.S. Dual-processing accounts of reasoning, judgment, and social cognition. Annu. Rev. Psychol. 2008, 59:255-278.
86. Kim H.F., Hikosaka O. Distinct basal ganglia circuits controlling behaviors guided by flexible and stable values. Neuron 2013, (in press).
87. Redgrave P., et al. Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat. Rev. Neurosci. 2010, 11:760-772.
88. Schneider W., Shiffrin R.M. Controlled and automatic human information processing: I. Detection, search, and attention. Psychol. Rev. 1977, 84:1-66.
89. Seger C.A. How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback. Neurosci. Biobehav. Rev. 2008, 32:265-278.
90. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 2006, 7:464-476.
91. Lee F.J., Taatgen N.A. Multi-tasking as skill acquisition. Proceedings of the Twenty-fourth Annual Conference of the Cognitive Science Society 2002, 572-577.
92. Fischer K.W. A theory of cognitive development: The control and construction of hierarchies of skills. Psychol. Rev. 1980, 87:477-531.
93. Sparks D.L. The brainstem control of saccadic eye movements. Nat. Rev. Neurosci. 2002, 3:952-964.
94. Hikosaka O., et al. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol. Rev. 2000, 80:953-978.
95. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 2011, 34:333-359.
96. Lay B.S., et al. Practice effects on coordination and control, metabolic energy expenditure, and muscle activation. Hum. Mov. Sci. 2002, 21:807-830.
97. Wu T., et al. How self-initiated memorized movements become automatic: a functional MRI study. J. Neurophysiol. 2004, 91:1690-1698.
98. Sigman M., et al. Top-down reorganization of activity in the visual pathway after learning a shape identification task. Neuron 2005, 46:823-835.
99. Schultz W., et al. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
100. Behrens T.E., et al. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
101. Dayan P., et al. Learning and selective attention. Nat. Neurosci. 2000, 3:1218-1223.
102. Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 2009, 63:119-126.
103. Kiani R., Shadlen M.N. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 2009, 324:759-764.
104. Faisal A.A., et al. Noise in the nervous system. Nat. Rev. Neurosci. 2008, 9:292-303.
105. Variability and Motor Control 1993, Human Kinetics. K.M. Newell, D.M. Corcos (Eds.).
106. Ratcliff R., Rouder J.N. Modeling response times for two-choice decisions. Psychol. Sci. 1998, 9:347-356.
107. Dosher B.A., Lu Z.L. Perceptual learning reflects external noise filtering and internal noise reduction through channel reweighting. Proc. Natl. Acad. Sci. U.S.A. 1998, 95:13988-13993.
108. Shmuelof L., et al. How is a motor skill learned? Change and invariance at the levels of task success and trajectory control. J. Neurophysiol. 2012, 108:578-594.
109. Mogg K., et al. Anxiety and orienting of gaze to angry and fearful faces. Biol. Psychol. 2007, 76:163-169.
110. Ellis M.E. Evolution of aversive information processing: a temporal trade-off hypothesis. Brain Behav. Evol. 1982, 21:151-160.
111. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.