Kalman filtering naturally accounts for visually guided and predictive smooth pursuit dynamics

Journal of Neuroscience

Volumn 33, Issue 44, 2013, Pages 17301-17313

  de Xivry, Jean Jacques Orban ^a   Coppe, Sébastien ^a   Blohm, Gunnar ^b,c   Lefèvre, Philippe ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b QUEEN S UNIVERSITY   (Canada)

^c Canadian Action and Perception Network   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACCELERATION; ARTICLE; EYE TRACKING; HUMAN; KALMAN FILTERING; MEMORY; MOLECULAR DYNAMICS; MOVEMENT PERCEPTION; PREDICTION; PRIORITY JOURNAL; SENSORY STIMULATION; SIMULATION; SMOOTH PURSUIT EYE MOVEMENT; STOCHASTIC MODEL; VISUAL INFORMATION;

ANTICIPATION, PSYCHOLOGICAL; FORECASTING; HUMANS; MODELS, NEUROLOGICAL; MOLECULAR DYNAMICS SIMULATION; MOTION PERCEPTION; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; PURSUIT, SMOOTH; REACTION TIME; VISUAL PATHWAYS;

EID: 84886709769     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2321-13.2013     Document Type: Article

References (118)

1. Adams RA, Perrinet LU, Friston K (2012) Smooth pursuit and visual occlusion: active inference and oculomotor control in schizophrenia. PLoS One 7:e47502. CrossRef Medline
2. Aftab Z, Robert T, Wieber PB (2012) Predicting multiple step placements for human balance recovery tasks. J Biomech 45:2804-2809. CrossRef Medline
3. Azevedo C, Poignet P, Espiau B (2004) Artificial locomotion control: from human to robots. Rob Auton Syst 47:203-223. CrossRef
4. Barborica A, Ferrera VP (2003) Estimating invisible target speed from neuronal activity in monkey frontal eye field. Nat Neurosci 6:66-74. CrossRef Medline
5. Barborica A, Ferrera VP (2004) Modification of saccades evoked by stimulation of frontal eye field during invisible target tracking. J Neurosci 24: 3260-3267. CrossRef Medline
6. Barnes GR (2008) Cognitive processes involved in smooth pursuit eye movements. Brain Cogn 68:309-326. CrossRef Medline
7. Barnes GR, Asselman PT (1991) The mechanism of prediction in human smooth pursuit eye movements. J Physiol 439:439-461. Medline
8. Barnes GR, Collins CJ (2008) Evidence for a link between the extra-retinal component of random-onset pursuit and the anticipatory pursuit of predictable object motion. J Neurophysiol 100:1135-1146 CrossRef Medline
9. Barnes GR, Donelan SF (1999) The remembered pursuit task: evidence for segregation of timing and velocity storage in predictive oculomotor control. Exp Brain Res 129:57-67. CrossRef Medline
10. Barnes GR, Ruddock CJ (1989) Factors affecting the predictability of pseudo-random motion stimuli in the pursuit reflex of man. J Physiol 408:137-165.Medline
11. Barnes GR, Donnelly SF, Eason RD (1987) Predictive velocity estimation in the pursuit reflex response to pseudo-random and step displacement stimuli in man. J Physiol 389:111-136. Medline
12. Barnes G, Grealy M, Collins S (1997) Volitional control of anticipatory ocular smooth pursuit after viewing, but not pursuing, a moving target: evidence for a re-afferent velocity store. Exp Brain Res 116:445-455. CrossRef Medline
13. Barnes GR, Barnes DM, Chakraborti SR (2000) Ocular pursuit responses to repeated, single-cycle sinusoids reveal behavior compatible with predictive pursuit. J Neurophysiol 84:2340-2355. Medline
14. Beck JM, Ma WJ, Pitkow X, Latham PE, Pouget A (2012) Not noisy, just wrong: the role of suboptimal inference in behavioral variability. Neuron 74:30-39. CrossRef Medline
15. Becker W, Fuchs AF (1985) Prediction in the oculomotor system: smooth pursuit during transient disappearance of a visual target. Exp Brain Res 57:562-575. Medline
16. Bennett SJ, Barnes GR (2003) Human ocular pursuit during the transient disappearance of a visual target. J Neurophysiol 90:2504-2520. CrossRef Medline
17. Bennett SJ, Barnes GR (2006) Smooth ocular pursuit during the transient disappearance of an accelerating visual target: the role of reflexive and voluntary control. Exp Brain Res 175:1-10. CrossRef Medline
18. Bennett SJ, Orban de Xivry JJ, Barnes GR, Lefèvre P (2007) Target acceleration can be extracted and represented within the predictive drive to ocular pursuit. J Neurophysiol 98:1405-1414. CrossRef Medline
19. Bennett SJ, Orban de Xivry JJ, Lefèvre P, Barnes GR (2010) Oculomotor prediction of accelerative target motion during occlusion: long-term and short-term effects. Exp Brain Res 204:493-504. CrossRef Medline
20. Berkes P, Orbán GA, Lengyel M, Fiser J (2011) Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331:83-87. CrossRef Medline
21. Bogadhi AR, Montagnini A, Mamassian P, Perrinet LU, Masson GS (2011) Pursuing motion illusions: a realistic oculomotor framework for Bayesian inference. Vision Res 51:867-880. CrossRef Medline
22. Born RT, Bradley DC (2005) Structure and function of visual area MT. Annu Rev Neurosci 28:157-189. CrossRef Medline
23. Carl JR, Gellman RS (1987) Human smooth pursuit: stimulus-dependent responses. J Neurophysiol 57:1446-1463. Medline
24. Cerminara NL, Apps R, Marple-Horvat DE (2009) An internal model of a moving visual target in the lateral cerebellum. J Physiol 587:429-442. CrossRef Medline
25. Churchland MM, Chou IH, Lisberger SG (2003) Evidence for object permanence in the smooth-pursuit eye movements of monkeys. J Neurophysiol 90:2205-2218. CrossRef Medline
26. Coppe S, Orban de Xivry JJ, Yuksel D, Ivanoiu A, Lefèvre P (2012) Dramatic impairment of prediction due to frontal lobe degeneration. J Neurophysiol 108:2957-2966. CrossRef Medline
27. Dallos P, Jones R (1963) Learning behavior of the eye fixation control system. IEEE Trans Automat Contr 8:218-227. CrossRef
28. de Brouwer S, Missal M, Barnes G, Lefèvre P (2002) Quantitative analysis of catch-up saccades during sustained pursuit. J Neurophysiol 87:1772-1780. Medline
29. Denève S, Duhamel JR, Pouget A (2007) Optimal sensorimotor integration in recurrent cortical networks: a neural implementation of Kalman filters. J Neurosci 27:5744-5756. CrossRef Medline
30. Diaz G, Cooper J, Rothkopf C, Hayhoe MM (2013) Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. J Vis 13(1): 20. CrossRef
31. Dimova K, Denham M (2009) A neurally plausible model of the dynamics of motion integration in smooth eye pursuit based on recursive Bayesian estimation. Biol Cybern 100:185-201. CrossRef Medline
32. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433. CrossRef Medline
33. Ferrera VP, Barborica A (2010) Internally generated error signals in monkey frontal eye field during an inferred motion task. J Neurosci 30:11612-11623. CrossRef Medline
34. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE (2012) Neural correlates of reliability-based cue weighting during multisensory integration. Nat Neurosci 15:146-154. CrossRef Medline
35. Frith CD, Blakemore S, Wolpert DM (2000) Explaining the symptoms of schizophrenia: abnormalities in the awareness of action. Brain Res Brain Res Rev 31:357-363. CrossRef Medline
36. Fukushima K, Yamanobe T, Shinmei Y, Fukushima J (2002) Predictive responses of periarcuate pursuit neurons to visual target motion. Exp Brain Res 145:104-120. CrossRef Medline
37. Gallistel CR, Matzel LD (2013) The neuroscience of learning: beyond the Hebbian synapse. Annu Rev Psychol 64:169-200. CrossRef Medline
38. Ghasia FF, Meng H, Angelaki DE (2008) Neural correlates of forward and inverse models for eye movements: evidence from three-dimensional kinematics. J Neurosci 28:5082-5087. CrossRef Medline
39. Gold JI, Watanabe T (2010) Perceptual learning. Curr Biol 20:R46-R48. CrossRef Medline
40. Harris CM, Wolpert DM (1998) Signal-dependent noise determines motor planning. Nature 394:780-784. CrossRef Medline
41. Hayhoe MM, Mannie N, Sullivan B, Gorgos K (2005) The role of internal models and prediction in catching balls. Proc Am Assoc Artif Intell 0505: 78-82.
42. Hillis JM, Ernst MO, Banks MS, Landy MS (2002) Combining sensory information: mandatory fusion within, but not between, senses. Science 298:1627-1630. CrossRef Medline
43. Hong LE, Tagamets M, Avila M, Wonodi I, Holcomb H, Thaker GK (2005) Specific motion processing pathway deficit during eye tracking in schizophrenia: a performance-matched functional magnetic resonance imaging study. Biol Psychiatry 57:726-732. CrossRef Medline
44. Hooker C, Park S (2000) Trajectory estimation in schizophrenia. Schizophr Res 45:83-92. CrossRef Medline
45. Izawa J, Rane T, Donchin O, Shadmehr R (2008) Motor adaptation as a process of reoptimization. J Neurosci 28:2883-2891. CrossRef Medline
46. Jellema T, Perrett DI (2003) Perceptual history influences neural responses to face and body postures. J Cogn Neurosci 15:961-971. CrossRef Medline
47. Kalman RE (1960) A new approach to linear filtering and prediction problems. J Basic Eng 82:35-45. CrossRef
48. Kao GW, Morrow MJ (1994) The relationship of anticipatory smooth eye movement to smooth pursuit initiation. Vision Res 34:3027-3036. CrossRef Medline
49. Karmali F, Merfeld DM (2012) A distributed, dynamic, parallel computational model: the role of noise in velocity storage. J Neurophysiol 108: 390-405. CrossRef Medline
50. Körding KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427:244-247. CrossRef Medline
51. Kording KP, Tenenbaum JB, Shadmehr R (2007) The dynamics of memory as a consequence of optimal adaptation to a changing body. Nat Neurosci 10:779-786. CrossRef Medline
52. Kowler E, McKee SP (1987) Sensitivity of smooth eye movement to small differences in target velocity. Vision Res 27:993-1015. CrossRef Medline
53. Kowler E, Steinman RM (1979a) The effect of expectations on slow oculomotor control. I. Periodic target steps. Vision Res 19:619-632. CrossRef Medline
54. Kowler E, Steinman RM (1979b) The effect of expectations on slow oculomotor control. II. Single target displacements. Vision Res 19:633-646. CrossRef Medline
55. Kowler E, Martins AJ, Pavel M (1984) The effect of expectations on slow oculomotor control. IV. Anticipatory smooth eye movements depend on prior target motions. Vision Res 24:197-210. CrossRef Medline
56. Krakauer JW, Mazzoni P, Ghazizadeh A, Ravindran R, Shadmehr R (2006) Generalization of motor learning depends on the history of prior action. PLoS Biol 4:e316. CrossRef Medline
57. Krauzlis RJ, Lisberger SG (1994) A model of visually-guided smooth pursuit eye movements based on behavioral observations. J Comput Neurosci 1:265-283. CrossRef Medline
58. Krauzlis RJ, Miles FA (1996) Transitions between pursuit eye movements and fixation in the monkey: dependence on context. J Neurophysiol 76: 1622-1638. Medline
59. Kveraga K, Fendrich R, Hughes HC (2001) Ocular pursuit of predicted motion trajectories. Exp Brain Res 138:393-397. CrossRef Medline
60. Land MF, McLeod P (2000) From eye movements to actions: how batsmen hit the ball. Nat Neurosci 3:1340-1345. CrossRef Medline
61. Lisberger SG, Evinger C, Johanson GW, Fuchs AF (1981) Relationship between eye acceleration and retinal image velocity during foveal smooth pursuit in man and monkey. J Neurophysiol 46:229-249. Medline
62. Madelain L, Krauzlis RJ (2003) Effects of learning on smooth pursuit during transient disappearance of a visual target. J Neurophysiol 90:972-982. CrossRef Medline
63. Maunsell JH, Van Essen DC (1983) Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. J Neurophysiol 49:1127-1147. Medline
64. Medina JF, Lisberger SG (2009) Encoding and decoding of learned smoothpursuit eye movements in the floccular complex of the monkey cerebellum. J Neurophysiol 102:2039-2054. CrossRef Medline
65. Merchant H, Georgopoulos AP (2006) Neurophysiology of perceptual and motor aspects of interception. J Neurophysiol 95:1-13. Medline
66. Merchant H, Battaglia-Mayer A, Georgopoulos AP (2004) Neural responses during interception of real and apparent circularly moving stimuli in motor cortex and area 7a. Cereb Cortex 14:314-331. CrossRef Medline
67. Miles FA, Fuller JH (1975) Visual tracking and the primate flocculus. Science 189:1000-1002. CrossRef Medline
68. Mitrani L, Dimitrov G (1978) Pursuit eye movements of a disappearing moving target. Vision Res 18:537-539. CrossRef Medline
69. Nagel M, Sprenger A, Nitschke M, Zapf S, Heide W, Binkofski F, Lencer R (2007) Different extraretinal neuronal mechanisms of smooth pursuit eye movements in schizophrenia: an fMRI study. Neuroimage 34:300-309. CrossRef Medline
70. Newsome WT, Wurtz RH, Komatsu H (1988) Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. J Neurophysiol 60:604-620. Medline
71. Nover H, Anderson CH, DeAngelis GC (2005) A logarithmic, scale-invariant representation of speed in macaque middle temporal area accounts for speed discrimination performance. J Neurosci 25:10049-10060. CrossRef Medline
72. Orban de Xivry JJ, Lefèvre P (2007) Saccades and pursuit: two outcomes of a single sensorimotor process. J Physiol 584:11-23. CrossRef Medline
73. Orban de Xivry JJ, Missal M, Lefèvre P (2008) A dynamic representation of target motion drives predictive smooth pursuit during target blanking. J Vis 8(15): 1-13. CrossRef
74. Orban de Xivry JJ, Missal M, Lefèvre P (2009) Smooth pursuit performance during target blanking does not influence the triggering of predictive saccades. J Vis 9(11):7 1-16. CrossRef
75. Orbán G, Wolpert DM (2011) Representations of uncertainty in sensorimotor control. Curr Opin Neurobiol 21:629-635. CrossRef Medline
76. Orban de Xivry JJ, Bennett SJ, Lefèvre P, Barnes GR (2006) Evidence for synergy between saccades and smooth pursuit during transient target disappearance. J Neurophysiol 95:418-427. Medline
77. Osborne LC, Lisberger SG (2009) Spatial and temporal integration of visual motion signals for smooth pursuit eye movements in monkeys. J Neurophysiol 102:2013-2025. CrossRef Medline
78. Osborne LC, Bialek W, Lisberger SG (2004) Time course of information about motion direction in visual area MT of macaque monkeys. J Neurosci 24:3210-3222. CrossRef Medline
79. Osborne LC, Lisberger SG, Bialek W (2005) A sensory source for motor variation. Nature 437:412-416. CrossRef Medline
80. Osborne LC, Hohl SS, Bialek W, Lisberger SG (2007) Time course of precision in smooth-pursuit eye movements of monkeys. J Neurosci 27:2987-2998. CrossRef Medline
81. Pack CC, Born RT (2001) Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain. Nature 409:1040-1042. CrossRef Medline
82. Perrett DI, Oram MW, Ashbridge E (1998) Evidence accumulation in cell populations responsive to faces: an account of generalisation of recognition without mental transformations. Cognition 67:111-145. CrossRef Medline
83. Poliakoff E, Collins CJ, Barnes GR (2005) Attention and selection for predictive smooth pursuit eye movements. Brain Res Cogn Brain Res 25: 688-700. CrossRef Medline
84. Pynn LK, DeSouza JF (2013) The function of efference copy signals: implications for symptoms of schizophrenia. Vision Res 76:124-133. CrossRef Medline
85. Rao RP, Ballard DH (1997) Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Comput 9:721-763. CrossRef Medline
86. Rasche C, Gegenfurtner KR (2009) Precision of speed discrimination and smooth pursuit eye movements. Vision Res 49:514-523. CrossRef Medline
87. Robinson DA (1976) Adaptive gain control of vestibuloocular reflex by the cerebellum. J Neurophysiol 39:954-969. Medline
88. Robinson DA (1981) The use of control systems analysis in the neurophysiology of eye movements. Annu Rev Neurosci 4:463-503. CrossRef Medline
89. Robinson DA, Gordon JL, Gordon SE (1986) A model of the smooth pursuit eye movement system. Biol Cybern 55:43-57. CrossRef Medline
90. Ronsse R, Miall RC, Swinnen SP (2009) Multisensory integration in dynamical behaviors: maximum likelihood estimation across bimanual skill learning. J Neurosci 29:8419-8428. CrossRef Medline
91. Sereno AB, Holzman PS (1993) Express saccades and smooth pursuit eye movement function in schizophrenic, affective disorder, and normal subjects. J Cogn Neurosci 5:303-316. Medline
92. Shergill SS, Samson G, Bays PM, Frith CD, Wolpert DM (2005) Evidence for sensory prediction deficits in schizophrenia. Am J Psychiatry 162:2384-2386. CrossRef Medline
93. Shibata T, Tabata H, Schaal S, Kawato M (2005) A model of smooth pursuit in primates based on learning the target dynamics. Neural Netw 18:213-224. CrossRef Medline
94. Skavenski AA, Robinson DA (1973) Role of abducens neurons in vestibuloocular reflex. J Neurophysiol 36:724-738. Medline
95. Snowden RJ, Braddick OJ (1991) The temporal integration and resolution of velocity signals. Vision Res 31:907-914. CrossRef Medline
96. Soechting JF, Rao HM, Juveli JZ (2010) Incorporating prediction in models for two-dimensional smooth pursuit. PLoS One 5:e12574. CrossRef Medline
97. Spering M, Gegenfurtner KR (2007) Contextual effects on smooth-pursuit eye movements. J Neurophysiol 97:1353-1367. Medline
98. Spering M, Dias EC, Sanchez JL, Schutz AC, Javitt DC (2013) Efference copy failure during smooth pursuit eye movements in schizophrenia. J Neurosci 33:11779-11787. CrossRef Medline
99. Stark L, Vossius G, Young LR (1962) Predictive control of eye tracking movements. IRE Trans Hum Fact Electr 3:52-57. CrossRef
100. Stein RB, Gossen ER, Jones KE (2005) Neuronal variability: noise or part of the signal? Nat Rev Neurosci 6:389-397. CrossRef Medline
101. Stone LS, Lisberger SG (1990) Visual responses of Purkinje cells in the cerebellar flocculus during smooth-pursuit eye movements in monkeys. II. Complex spikes. J Neurophysiol 63:1262-1275. Medline
102. Suh M, Leung HC, Kettner RE (2000) Cerebellar flocculus and ventral paraflocculus Purkinje cell activity during predictive and visually driven pursuit in monkey. J Neurophysiol 84:1835-1850. Medline
103. Synofzik M, Thier P, Leube DT, Schlotterbeck P, Lindner A (2010) Misattributions of agency in schizophrenia are based on imprecise predictions about the sensory consequences of one's actions. Brain 133:262-271. CrossRef Medline
104. Tarnutzer AA, Ramat S, Straumann D, Zee DS (2007) Pursuit responses to target steps during ongoing tracking. J Neurophysiol 97:1266-1279. CrossRef Medline
105. Thaker GK, Ross DE, Cassady SL, Adami HM, LaPorte D, Medoff DR, Lahti A (1998) Smooth pursuit eye movements to extraretinal motion signals: deficits in relatives of patients with schizophrenia. Arch Gen Psychiatry 55:830-836. CrossRef Medline
106. Thaker GK, Avila MT, Hong EL, Medoff DR, Ross DE, Adami HM (2003) A model of smooth pursuit eye movement deficit associated with the schizophrenia phenotype. Psychophysiology 40:277-284. CrossRef Medline
107. Todorov E (2005) Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural Comput 17:1084-1108. CrossRef Medline
108. Treue S, Hol K, Rauber HJ (2000) Seeing multiple directions of motionphysiology and psychophysics. Nat Neurosci 3:270-276. CrossRef Medline
109. Trillenberg P, Heide W, Junghanns K, Blankenburg M, Arolt V, Kömpf D (1998) Target anticipation and impairment of smooth pursuit eye movements in schizophrenia. Exp Brain Res 120:316-324. CrossRef Medline
110. van Beers RJ, Sittig AC, Gon JJ (1999) Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81:1355-1364. Medline
111. Vaziri S, Diedrichsen J, Shadmehr R (2006) Why does the brain predict sensory consequences of oculomotor commands? Optimal integration of the predicted and the actual sensory feedback. J Neurosci 26:4188-4197. CrossRef Medline
112. Wei K, Körding K (2010) Uncertainty of feedback and state estimation determines the speed of motor adaptation. Front Comput Neurosci 4:11. Medline
113. Wells SG, Barnes GR (1998) Fast, anticipatory smooth-pursuit eye movements appear to depend on a short-term store. Exp Brain Res 120:129-133. CrossRef Medline
114. Whittaker SG, Eaholtz G (1982) Learning patterns of eye motion for foveal pursuit. Invest Ophthalmol Vis Sci 23:393-397. Medline
115. Xiao Q, Barborica A, Ferrera VP (2007) Modulation of visual responses in macaque frontal eye field during covert tracking of invisible targets. Cereb Cortex 17:918-928. CrossRef Medline
116. Yang J, Lee J, Lisberger SG (2012) The interaction of Bayesian priors and sensory data and its neural circuit implementation in visually guided movement. J Neurosci 32:17632-17645. CrossRef Medline
117. Yasui S, Young L (1984) On the predictive control of foveal eye tracking and slow phases of optokinetic and vestibular nystagmus. J Physiol 347:17-33. Medline
118. Zee DS, Robinson DA (1979) A hypothetical explanation of saccadic oscillations. Ann Neurol 5:405-414. CrossRef Medline