From Spontaneous Motor Activity to Coordinated Behaviour: A Developmental Model

PLoS Computational Biology

Volumn 10, Issue 7, 2014, Pages

  Marques, Hugo Gravato ^a   Bharadwaj, Arjun ^a   Iida, Fumiya ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; MUSCULOSKELETAL SYSTEM; NEUROPHYSIOLOGY;

COMPUTATIONAL MODELLING; COORDINATED BEHAVIOR; DEVELOPMENTAL MODELS; DEVELOPMENTAL STAGE; DIFFERENT STAGES; INCREMENTAL LEARNING; MODULARS; MOTOR ACTIVITY; MOTOR CONTROL; SELF-ORGANISED;

MAMMALS;

ALGORITHM; ARTICLE; CENTRAL NERVOUS SYSTEM; COMPUTER MODEL; DEVELOPMENTAL STAGE; HOPPING; KINEMATICS; LOCOMOTION; MATHEMATICAL COMPUTING; MOTOR ACTIVITY; MOTOR COORDINATION; MOTOR DEVELOPMENT; MUSCLE STRETCHING; MUSCLE TWITCH; NEUROMODULATION; REFLEX; SENSORY NERVE; SPONTANEOUS MOTOR ACTIVITY; SUPRASPINAL SYSTEM; ADULT; BEHAVIOR; BIOLOGICAL MODEL; HUMAN; LEG; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; SKELETAL MUSCLE;

ADULT; BEHAVIOR; HUMANS; LEG; MODELS, NEUROLOGICAL; MOTOR ACTIVITY; MUSCLE, SKELETAL; PSYCHOMOTOR PERFORMANCE;

EID: 84905454877     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003653     Document Type: Article

References (127)

1. Blumberg M, Marques HG, Iida F, (2013) Twitching in sensorimotor development: From sleeping rats to robots. Curr Biol 23: R532-R537.
2. Prechtl HF, (1990) Qualitative changes of spontaneous movements in fetus and preterm infant are a marker of neurological dysfunction. Early Hum Dev 23: 151-158.
3. Robinson SR, Brumley M (2005) Prenatal behavior. In: Whishaw IQ, Kolb B, editors, The Behaviour of the Laboratory Rat: A Handbook with Tests, Oxford: Oxford University Press, chapter 24. pp. 257-265.
4. Brown TG, (1911) The intrinsic factors in the act of progression in the mammal. Proc R Soc Lond B 84: 308-319.
5. Sherrington CS (2010) The Integrative Action of the Nervous System. Nabu Press.
6. Ijspeert A, (2008) Central pattern generators for locomotion control in animals and robots: a review. Neural Netw 21: 642-653.
7. Lacquaniti F, Maioli C, (1987) Anticipatory and reflex coactivation of antagonist muscles in catching. Brain Res 406: 373-378.
8. Hiebert GW, Pearson KG, (1999) Contribution of Sensory Feedback to the Generation of Extensor Activity During Walking in the Decerebrate Cat. J Neurophysiol 81: 758-770.
9. Prochazka A, Gritsenko V, Yakovenko S (2002) Sensory control of locomotion: reflexes versus higher-level control. In: Sensorimotor Control of Movement and Posture, Springer. pp. 357-367.
10. Rossignol S, Barrière G, Frigon A, Barthélemy D, Bouyer L, et al. (2008) Plasticity of locomotor sensorimotor interactions after peripheral and/or spinal lesions. Brain Res Rev 57: 228-240.
11. Bear M, Connors B, Paradiso M (2007) Neuroscience. Lippincott Williams and Wilkins, 3rd edition.
12. Schouenborg J, Weng HR, (1994) Sensorimotor transformation in a spinal motor system. Exp Brain Res 100: 170-174.
13. Burke R, (2007) Sir Charles Sherrington's The integrative action of the nervous system: a centenary appreciation. Brain 130: 887-894.
14. Latash ML, (2008) Evolution of Motor Control: From Reflexes and Motor Programs to the Equilibrium-Point Hypothesis. J Hum Kinet 19: 3-24.
15. Feldman AG, Levin MF (2009) The equilibrium-point hypothesis-past, present and future. In: Progress in Motor Control, Springer. pp. 699-726.
16. Thelen ES, Smith LB (1996) Dynamic systems approach to the development of cognition and action. MIT press.
17. Geyer H, Herr H, (2010) A Muscle-Reflex Model that Encodes Principles of Legged Mechanics Produces Human Walking Dynamics and Muscle Activities. IEEE T Neur Sys Reh 18: 263-273.
18. Manoonpong P, Geng T, Kulvicius T, Porr B, Wörgötter F, (2007) Adaptive, fast walking in a biped robot under neuronal control and learning. PLoS Comput Biol 3: e134.
19. Bizzi E, Giszter S, Loeb E, Mussa-Ivaldi F, Saltiel P, (1995) Modular organization of motor behaviour in the frog's spinal cord. Trends Neurosci 18: 442-446.
20. DÁvella A, Saltiel P, Bizzi E, (2003) Combinations of muscle synergies in the construction of a natural motor behavior. Nat Neurosci 6: 300-308.
21. Ting LH, McKay JL, (2007) Neuromechanics of muscle synergies for posture and movement. Curr Opin Neurobiol 17: 622-8.
22. Dominici N, Ivanenko YP, Cappellini G, D'Avella A, Mondi V, et al. (2011) Locomotor Primitives in Newborn Babies and Their Development. Science 334: 997-999.
23. Alessandro C, Delis I, Nori F, Panzeri S, Berret B, (2013) Muscle synergies in neuroscience and robotics: from input-space to task-space perspectives. Front Comput Neurosci 7: 43.
24. Bernstein N (1967) The co-ordination and regulation of movements. Oxford: Pergamon Press.
25. Bizzi E, Cheung VCK, D'Avella A, Saltiel P, Tresch M, (2008) Combining modules for movement. Brain Res Rev 57: 125-33.
26. Sporns O, Edelman G, (1993) Solving Bernstein's problem: A proposal for the development of coordinated movement by selection. Child Dev 64: 960-981.
27. Smotherman W, Robinson S, (1996) The Development of Behaviour Before Birth. Dev Psychol 32: 425-434.
28. Weng J, McClelland J, Pentland A, Sporns O, (2001) Autonomous Mental Development by Robots and Animals. Science 291: 599-600.
29. Petersson P, Waldenström A, Fåhraeus C, Schouenborg J, (2003) Spontaneous muscle twitches during sleep guide spinal self-organization. Nature 424: 72-75.
30. Marques HG, Imtiaz F, Iida F, Pfeifer R, (2013) Self-organisation of Reflexive Behaviour from Spontaneous Motor Activity. Biol Cybern 107: 25-37.
31. Tözeren An (2000) Human Body Dynamics: Classical Mechanics and Human Movement. Springer-Verlag.
32. Hill AV, (1938) The heat of shortening and dynamics constants of muscles. Proc R Soc Lond B 126: 136-195.
33. Zajac FE, (1989) Muscle and tendon: properties, models, scaling and application to biomechanics and motor control. Crit Rev Biomed Eng 17: 359-410.
34. Millard M, Uchida T, Seth A, Delp SL, (2013) Flexing Computational Muscle: Modeling and Simulation of Musculotendon Dynamics. J Biomech Eng 135: 021005.
35. Shadmehr R, Wise S (2005) The Computational Neurobiology of Reaching and Pointing. Cambridge, Massachusetts: The MIT Press.
36. Robinson SR, Blumberg MS, Lane MS, Kreber LA, (2000) Spontaneous motor activity in fetal and infant rats is organized into discrete multilimb bouts. Behav Neurosci 114: 328-336.
37. de Vries N, Erwich J, Bos A, (2008) General Movements in the first forteen days of life in extremely low birth (ELBW) infants. Early Hum Dev 84: 763-768.
38. Blumberg MS, (2010) Beyond dreams: do sleep-related movements contribute to brain development? Front Neurol 1: 140.
39. Blumberg M, Gerth A, McMurray B, (2013) Spatiotemporal structure of rem sleep twitching reveals developmental origins of motor synergies. Curr Biol 23: 2100-2109.
40. Baldissera F, Broggi G, Mancia M, (1966) Monosynaptic and polysynaptic spinal reflexes during physiological sleep and wakefulness. Arch Ital Biol 104: 112-133.
41. Oja E, (1982) Simplified neuron model as a principal component analyzer. J Math Biol 15: 267-273.
42. Földiák P, (1990) Forming sparse representations by local anti-Hebbian learning. Biol Cybern 64: 165-170.
43. Hebb D (1949) The organization of behavior. New York: Wiley & Sons.
44. Kosko B, (1986) Differential hebbian learning. AIP Conf Proc 151: 277-282.
45. Andersen RA, Essick GK, Siegel RM, (1985) Encoding of spatial location by posterior parietal neurons. Science 230: 456-8.
46. Salinas E, Abbot LF, (2001) Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. Prog Brain Res 130: 175-190.
47. Brozović M, Abbott LF, Andersen RA, (2008) Mechanism of gain modulation at single neuron and network levels. J Comput Neurosci 25: 158-168.
48. Pearson K, Gordon J (2000) Principles of Neural Science, McGraw-Hill, New York, volume 4, chapter Spinal reflexes. pp. 713-36.
49. Dalcin BL, Cruz FA, Cortez CM, Passos EPL, (2005) Computer modeling of a spinal reflex circuit. Braz J Phys 35: 987-94.
50. Krishnaswamy P, Brown EN, Herr HM, (2011) Human leg model predicts ankle muscle-tendon morphology, state, roles and energetics in walking. PLoS Comput Biol 7: e1001107.
51. Jaeger H (2002) Adaptive nonlinear system identification with echo state networks. In: Advances in Neural Information Processing Systems, 9-14 December, 2002; Vancouver, British Columbia, Canada. NIPS2002.
52. Schrauwen B, Verstraeten D, Van Campenhout J (2007) An overview of reservoir computing: theory, applications and implementations. In: Proceedings of the 15th European Symposium on Artificial Neural Networks, April 25-27 April; Bruges, Belgium. ESANN2007.
53. Oh S, Koyanagi T, Hori Y (2009) Stiffness direction stabilization and inertia matrix diagonalization of robot manipulator by biarticular muscle. In: Proceedings of the IEEE International Symposium on Industrial Electronics, 5-8 July 2009; Seoul, Korea. ISIE2008.
54. Iida F, Rummel J, Seyfarth A, (2008) Bipedal walking and running with spring-like biarticular muscles. J Biomech 41: 656-667.
55. Akazawa K, Aldridge JW, Steeves JD, Stein RB, (1982) Modulation of stretch reflexes during locomotion in the mesencephalic cat. J Physiol 329: 553-567.
56. Bronsing R, van der Brurg J, Ruigrok TJ, (2005) Modulation of cutaneous reflexes in hindlimb muscles during locomotion in the freely walking rat: A model for studying cerebellar involvement in the adaptive control of reflexes during rythmic movements. Prog Brain Res 148: 243-257.
57. Xia R, Bush BMH, Karst GM, (2005) Phase-dependent and task-dependent modulation of stretch reflexes during rhythmical hand tasks in humans. J Physiol 564: 941-951.
58. Duysens J, Pearson K, (1976) The role of cutaneous afferents from the distal hindlimb in the regulation of the step cycle of thalamic cats. Exp Brain Res 24: 245-55.
59. Tsianos GA, Raphael G, Loeb GE, (2011) Modeling the potentiality of spinal-like circuitry for stabilization of a planar arm system. Prog Brain Res 194: 203-213.
60. Raphael G, Tsianos GA, Loeb GE, (2010) Spinal-like regulator facilitates control of a two-degree of-freedom wrist. J Neurosci 30: 9431-9444.
61. Lundberg A, Malmgren K, Schomburg ED, (1987) Reflex pathways from group II muscle afferents. Exp Brain Res 65: 294-306.
62. Pierrot-Deseilligny E, Burke D (2005) The Circuitry of the Human Spinal Cord. Cambridge University Press.
63. Kudo N, Yamada T, (1985) Development of the monosynaptic stretch reflex in the rat: an in vitro study. J Physiol 369: 127-144.
64. Chen HH, Hippenmeyer S, Arber S, Frank E, (2003) Development of the monosynaptic stretch reflex circuit. Curr Opin Neurobiol 13: 96-102.
65. Marques HG, Völk K, König S, Iida F Self-organization of spinal reflexes involving homonymous, antagonist and synergistic interactions. In: Proceedings of the 12th International Conference on the Simulation of Adaptive Behaviour, 27-30 August 2012; Odense, Denmark. SAB2012.
66. O'Donovan M, Landmesser L, (1987) The development of hindlimb motor activity studied in the isolated spinal cord of the chick embryo. J Neurosci 7: 3256-64.
67. Bekoff A, (1976) Ontogeny of leg motor output in the chick embryo: a neural analysis. Brain Res 106: 271-291.
68. Ryu YU, Bradley NS, (2009) Precocious locomotor behavior begins in the egg: development of leg muscle patterns for stepping in the chick. PLoS ONE 4: e6111.
69. Dehorter N, Vinay L, Hammond C, Ben-Ari Y, (2012) Timing of developmental sequences in different brain structures: physiological and pathological implications. Eur J Neurosci 35: 1846-56.
70. Hanson MG, Landmesser LT, (2006) Increasing the frequency of spontaneous rhythmic activity disrupts pool-specific axon fasciculation and pathfinding of embryonic spinal motoneurons. J Neurosci 26: 12769-12780.
71. Hanson MG, Milner LD, Landmesser LT, (2008) Spontaneous rhythmic activity in early chick spinal cord influences distinct motor axon pathfinding decisions. Brain Res Rev 57: 77-85.
72. Bradley NS, Ryu YU, Lin J, (2008) Fast locomotor burst generation in late stage embryonic motility. J Neurophysiol 99: 1733-1742.
73. Hamburger V, Oppenheim R, (1967) Prehatching motility and hatching behavior in the chick. J Exp Zool 166: 171-203.
74. Narayanan C, Fox M, Hamburger V, (1971) Prenatal development of spontaneous and evoked activity in the rat (rattus norvegicus albinus). Behaviour 40: 100-134.
75. Lee MT, Koebbe MJ, O'Donovan MJ, (1988) The development of sensorimotor synaptic connections in the lumbosacral cord of the chick embryo. J Neurosci 8: 2530-2543.
76. Kreider JC, Blumberg MS, (2000) Mesopontine contribution to the expression of active twitchsleep in decerebrate week-old rats. Brain Res 872: 149-159.
77. Gall AJ, Mohns EJ, Seelke AM, Blumberg MS, et al. (2005) The neural substrates of infant sleep in rats. PLoS Biol 3: e143.
78. Karlsson K, Blumberg M, (2005) Active medullary control of atonia in week-old rats. Neuroscience 130: 275-283.
79. O'Donovan MJ, (1999) The origin of spontaneous activity in developing networks of the vertebrate nervous system. Curr Opin Neurobiol 9: 94-104.
80. Khazipov R, Sirota A, Leinekugel X, Holmes GL, Ben-Ari Y, et al. (2004) Early motor activity drives spindle bursts in the developing somatosensory cortex. Nature 432: 758-761.
81. Tritsch NX, Yi E, Gale JE, Glowatzki E, Bergles DE, (2007) The origin of spontaneous activity in the developing auditory system. Nature 450: 50-55.
82. Ackman JB, Burbridge TJ, Crair MC, (2012) Retinal waves coordinate patterned activity throughout the developing visual system. Nature 490: 219-225.
83. Purves D, Lichtman JW, (1980) Others (1980) Elimination of synapses in the developing nervous system. Science 210: 153-157.
84. Lichtman JW, Colman H, (2000) Synapse elimination review and indelible memory. Neuron 25: 269-278.
85. Favero M, Busetto G, Cangiano A, (2012) Spike timing plays a key role in synapse elimination at the neuromuscular junction. Proc Natl Acad Sci 109: E1667-E1675.
86. Mentis GZ, Alvarez FJ, Shneider NA, Siembab VC, ODonovan MJ, (2010) Mechanisms regulating the specificity and strength of muscle afferent inputs in the spinal cord. Ann NY Acad Sci 1198: 220-230.
87. Schouenborg J, (2004) Learning in sensorimotor circuits. Curr Opin Neurobiol 14: 693-7.
88. Myklebust B, Gottlieb G, (1993) Development of the Stretch Reflex in the Newborn: Reciprocal Excitation and Reflex Irradiation. Child Dev 64: 1036-1045.
89. Pearson KG, Misiaszek JE, Hulliger M, (2003) Chemical ablation of sensory afferents in the walking system of the cat abolishes the capacity for functional recovery after peripheral nerve lesions. Exp Brain Res 150: 50-60.
90. Hulliger M, (1984) The Mammalian Muscle Spindle and Its Central Control. Rev Physiol Bioch P 101: 1-110.
91. Prochazka A (2010) Proprioceptive Feedback and Movement Regulation, John Wiley & Sons, Inc.
92. Ribot-Ciscar E, Hospod V, Roll JP, Aimonetti JM, (2009) Fusimotor drive may adjust muscle spindle feedback to task requirements in humans. J Neurophysiol 101: 633-640.
93. Rudomin P, (2009) In search of lost presynaptic inhibition. Exp Brain Res 196: 139-151.
94. Baudry S, Maerz AH, Enoka RM, (2010) Presynaptic modulation of ia afferents in young and old adults when performing force and position control. J Neurophysiol 103: 623-631.
95. Pearson KG, Collins DF, (1993) Reversal of the influence of group Ib afferents from plantaris on activity in medial gastrocnemius muscle during locomotor activity. J Neurophysiol 70: 1009-1017.
96. Grey MJ, Nielsen JB, Mazzaro N, Sinkjær T, (2007) Positive force feedback in human walking. J Physiol 581: 99-105.
97. Lacquaniti F, Borghese NA, Carrozzo M, (1991) Transient reversal of the stretch reflex in human arm muscles. J Neurophysiol 66: 939-954.
98. Prochazka A, Gillard D, Bennett DJ, (1997) Positive force feedback control of muscles. J Neurophysiol 77: 3226-3236.
99. Rybak IA, Shevtsova NA, Lafreniere-Roula M, McCrea DA, (2006) Modelling spinal circuitry involved in locomotor pattern generation: insights from deletions during fictive locomotion. J Physiol 577: 617-639.
100. Rybak IA, Stecina K, Shevtsova NA, McCrea DA, (2006) Modelling spinal circuitry involved in locomotor pattern generation: insights from the effects of afferent stimulation. J Physiol 577: 641-658.
101. Granit R, Holmgren B, Merton PA, (1955) The two routes for excitation of muscle and their subservience to the cerebellum. J Physiol 130: 213.
102. Gilman S, (1969) The Mechanism of Cerebellar Hypotonia an Experimental Study in the Monkey. Brain 92: 621-638.
103. Grillner S, Zangger P, (1979) On the central generation of locomotion in the low spinal cat. Exp Brain Res 34: 241-261.
104. Lajoie Y, Teasdale N, Cole JD, Burnett M, Bard C, et al. (1996) Gait of a deafferented subject without large myelinated sensory fibers below the neck. Neurology 47: 109-115.
105. Ekeberg Ö, Pearson K, (2005) Computer simulation of stepping in the hind legs of the cat: an examination of mechanisms regulating the stance-to-swing transition. J Neurophysiol 94: 4256-68.
106. McNeill Alexander R, (2002) Tendon elasticity and muscle function. Comp Biochem Phys A 133: 1001-11.
107. Lichtwark GA, Barclay CJ, (2010) The influence of tendon compliance on muscle power output and efficiency during cyclic contractions. J Exp Biol 213: 707-14.
108. Chvatal SA, Ting LH, (2013) Common muscle synergies for balance and walking. Front Comput Neurosci 7: 48.
109. Klein DA, Patino A, Tresch MC, (2010) Flexibility of motor pattern generation across stimulation conditions by the neonatal rat spinal cord. J Neurophysiol 103: 1580-1590.
110. Tomlinson RD, Saunders GE, Schwarz DWF, (1980) Analysis of human vestibulo-ocular reflex during active head movements. Acta Oto-Laryngol 90: 184-90.
111. Kömpf D, Piper HF, (1987) Eye movements and vestibulo-ocular reflex in the blind. J Neurol 234: 337-41.
112. Lungarella M, Metta G, Pfeifer R, Sandini G, (2003) Developmental robotics: a survey. Connect Sci 15: 151-190.
113. Asada M, Hosoda K, Kuniyoshi Y, Ishiguro H, Inui T, et al. (2009) Cognititive Developmental Robotics: A Survey. IEEE Trans Auton Mental Develop 1: 12-34.
114. Kuniyoshi Y, Sangawa S, (2006) Early motor development from partially ordered neural-body dynamics: experiments with as cortico-spinal-musculo-skeletal. Biol Cybern 95: 589-605.
115. Mizuuchi I, Yoshikai T, Sodeyama Y, Nakanishi Y, Miyadera A, et al. (2006) Development of musculoskeletal humanoid kotaro. In: Proceedings of the IEEE International Conference on Robotics and Automation, 15-19 May 2006; Orlando, Florida, USA. ICRA2006.
116. Mizuuchi I, Nakanishi Y, Sodeyama Y, Namiki Y, Nishino T, et al. (2007) An Advanced Musculoskeletal Humanoid Kojiro. In: Proceedings of the 7th IEEE-RAS International Conference on Humanoid Robots, 29 November - 1 December 2009; Pittsburgh, Pennsylvania, USA. ICHR2007.
117. Holland O, Knight R (2006) The Anthropomimetic Principle. In: Proceedings of the Conference on Artificial Intelligence and the Simulation of Behaviour, 3-6 April 2006; Bristol, England. AISB2006.
118. Marques H, Jäntsch M, Wittmeier S, Cristiano A, Lungarella M, et al. (2010) ECCE1: the first of a series of anthropomimetic musculoskelal upper torsos. In: Proceedings of the 10th IEEE-RAS International Conference on Humanoid Robots, 6-8 November 2010; Nashville, TN, USA. ICHR2007.
119. Johansson R (1993) System modeling & identification. Prentice-Hall, Inc.
120. Lungarella M, Sporns O, (2006) Mapping information flow in sensorimotor networks. PLoS Comput Biol 2: e144.
121. Schmidt N, Hoffmann M, Nakajima K, Pfeifer R, (2013) Bootstrapping perception using information theory: case studies in a quadruped robot running on different grounds. Adv Complex Syst 16: 1250078.
122. Hoffmann M, Schmidt NM, Pfeifer R, Engel AK, Maye A (2012) Using Sensorimotor Contingencies for Terrain Discrimination and Adaptive Walking Behavior in the Quadruped Robot Puppy. In: Proc SAB2012. Odense, Denmark.
123. Blickhan R, (1989) The spring-mass model for running and hopping. J Biomech 22: 1217-1227.
124. McGeer T, (1990) Passive bipedal running. Proc R Soc Lond B 240: 107-134.
125. Geyer H, Seyfarth A, Blickhan R, (2005) Spring-mass running: simple approximate solution and application to gait stability. Journal of Theor Biol 232: 315-328.
126. Sharbafi MA, Maufroy C, Ahmadabadi MN, Yazdanpanah MJ, Seyfarth A, (2013) Robust hopping based on virtual pendulum posture control. Bioinspir Biomim 8: 036002.
127. Salazar HRM, Carbajal JP, (2011) Exploiting the passive dynamics of a compliant leg to develop gait transitions. Phys Rev E 83: 066707.