Operant conditioning of spinal reflexes: From basic science to clinical therapy

Frontiers in Integrative Neuroscience

Volumn 8, Issue MAR, 2014, Pages

  Thompson, Aiko K ^a,b,c,d   Wolpaw, Jonathan R ^a,b,c,d  

^a HELEN HAYES HOSPITAL   (United States)

^b WADSWORTH CENTER   (United States)

^c NEUROLOGICAL INSTITUTE   (United States)

^d STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

H reflex; Learning and memory; Locomotion; Spinal cord injury; Spinal cord plasticity

Indexed keywords

ANIMAL BEHAVIOR; CENTRAL NERVOUS SYSTEM; HOFFMANN REFLEX; HUMAN; HUMAN VERSUS ANIMAL COMPARISON; INSTRUMENTAL CONDITIONING; KINEMATICS; LEARNING; LOCOMOTION; MAMMAL; MEMORY; MYOTATIC REFLEX; NERVE CELL PLASTICITY; NEUROANATOMY; NEUROSCIENCE; NONHUMAN; PATTERN RECOGNITION; REVIEW; SOLEUS MUSCLE; SPINAL CORD INJURY; SPINAL REFLEX;

EID: 84896943624     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2014.00025     Document Type: Review

References (83)

1. Abel, B. M., Emore, E., and Thompson, A. K. (2011). Operant up-conditioning of the ankle dorsiflexor motor evoked potential in people with multiple sclerosis. Society for Neuroscience 41st Annual Meeting, Program No. 917.919. Washington, D.C.
2. Barbeau, H., and Rossignol, S. (1987). Recovery of locomotion after chronic spinalization in the adult cat. Brain Res. 412, 84-95. doi: 10.1016/0006-8993(87)91442-9
3. Barbeau, H. (2003). Locomotor training in neurorehabilitation: emerging rehabilitation concepts. Neurorehabil. Neural Repair 17, 3-11. doi: 10. 1177/0888439002250442
4. Bawa, P., Stein, R. B., and Tatton, W. G. (1979). Dynamics of a long-latency reflex pathway in the monkey. Biol. Cybern. 34, 107-110. doi: 10.1007/bf00365474
5. Carp, J. S., Chen, X. Y., Sheikh, H., and Wolpaw, J. R. (2001a). Operant conditioning of rat H-reflex affects motoneuron axonal conduction velocity. Exp. Brain Res. 136, 269-273. doi: 10.1007/s002210000608
6. Carp, J. S., Chen, X. Y., Sheikh, H., and Wolpaw, J. R. (2001b). Motor unit properties after operant conditioning of rat H-reflex. Exp. Brain Res. 140, 382-386. doi: 10. 1007/s002210100830
7. Carp, J. S., Tennissen, A. M., Chen, X. Y., and Wolpaw, J. R. (2006a). H-reflex operant conditioning in mice. J. Neurophysiol. 96, 1718-1727. doi: 10.1152/jn.00470.2006
8. Carp, J. S., Tennissen, A. M., Chen, X. Y., and Wolpaw, J. R. (2006b). Diurnal H-reflex variation in mice. Exp. Brain Res. 168, 517-528. doi: 10.1007/s00221-005-0106-y
9. Carp, J. S., and Wolpaw, J. R. (1994). Motoneuron plasticity underlying operantly conditioned decrease in primate H-reflex. J. Neurophysiol. 72, 431-442.
10. Carp, J. S., and Wolpaw, J. R. (1995). Motoneuron properties after operantly conditioned increase in primate H-reflex. J. Neurophysiol. 73, 1365-1373.
11. Chen, X., Chen, Y., Chen, L., Liu, R., Wang, Y., Yao, L. H., et al. (2012). Inferior olive ablation prevents acquisition and long-term maintenance of soleus H-reflex down-conditioning in rats. Society for Neuroscience 42nd Annual Meeting, Program No. 475.417. New Orleans,
12. LA. Chen, X. Y. Carp, J. S. L. Chen., and Wolpaw, J. R. (2002). Corticospinal tract transection prevents operantly conditioned H-reflex increase in rats. Exp. Brain Res. 144, 88-94. doi: 10.1007/s00221-002-1026-8
13. Chen, X. Y., Carp, J. S., Chen, L., and Wolpaw, J. R. (2006a). Sensorimotor cortex ablation prevents H-reflex up-conditioning and causes a paradoxical response to down-conditioning in rats. J. Neurophysiol. 96, 119-127. doi: 10.1152/jn.01271. 2005
14. Chen, X. Y., Chen, L., Chen, Y., and Wolpaw, J. R. (2006b). Operant conditioning of reciprocal inhibition in rat soleus muscle. J. Neurophysiol. 96, 2144-2150. doi: 10.1152/jn.00253.2006
15. Chen, X. Y., Chen, L., and Wolpaw, J. R. (2001). Time course of H-reflex conditioning in the rat. Neurosci. Lett. 302, 85-88. doi: 10.1016/s0304-3940(01)01658-5
16. Chen, X. Y., Chen, Y., Chen, L., Tennissen, A. M., and Wolpaw, J. R. (2006c). Corticospinal tract transection permanently abolishes H-reflex down-conditioning in rats. J. Neurotrauma 23, 1705-1712. doi: 10.1089/neu.2006.23.1705
17. Chen, X. Y., and Wolpaw, J. R. (1995). Operant conditioning of H-reflex in freely moving rats. J. Neurophysiol. 73, 411-415.
18. Chen, X. Y., and Wolpaw, J. R. (2002). Probable corticospinal tract control of spinal cord plasticity in the rat. J. Neurophysiol. 87, 645-652. doi: 10.1152/jn.00391. 2001
19. Chen, X. Y., and Wolpaw, J. R. (2005). Ablation of cerebellar nuclei prevents Hreflex down-conditioning in rats. Learn. Mem. 12, 248-254. doi: 10.1101/lm. 91305
20. Chen, Y., Chen, L., Liu, R., Wang, Y., Chen, X. Y., and Wolpaw, J. R. (2013). Locomotor impact of beneficial or non-beneficial H-reflex conditioning after spinal cord injury. J. Neurophysiol. doi: 10.1152/jn.00756.2013. [Epub ahead of print].
21. Chen, Y., Chen, L., Wang, Y., Wolpaw, J. R., and Chen, X. Y. (2011). Operant conditioning of rat soleus H-reflex oppositely affects another H-reflex and changes locomotor kinematics. J. Neurosci. 31, 11370-11375. doi: 10.1523/jneurosci. 1526-11.2011
22. Chen, Y., Chen, X. Y., Jakeman, L. B., Chen, L., Stokes, B. T., and Wolpaw, J. R. (2006d). Operant conditioning of H-reflex can correct a locomotor abnormality after spinal cord injury in rats. J. Neurosci. 26, 12537-12543. doi: 10. 1523/JNEUROSCI.2198-06.2006
23. Chen, Y., Chen, X. Y., Jakeman, L. B., Schalk, G., Stokes, B. T., and Wolpaw, J. R. (2005). The interaction of a new motor skill and an old one: H-reflex conditioning and locomotion in rats. J. Neurosci. 25, 6898-6906. doi: 10. 1523/jneurosci.1684-05.2005
24. Chen, Y., Wang, Y., Chen, L., Sun, C., English, A. W., Wolpaw, J. R., et al. (2010). H-reflex up-conditioning encourages recovery of EMG activity and H-reflexes after sciatic nerve transection and repair in rats. J. Neurosci. 30, 16128-16136. doi: 10.1523/jneurosci.4578-10.2010
25. Christensen, L. O., Andersen, J. B., Sinkjaer, T., and Nielsen, J. (2001). Transcranial magnetic stimulation and stretch reflexes in the tibialis anterior muscle during human walking. J. Physiol. 531, 545-557. doi: 10.1111/j.1469-7793.2001. 0545i.x
26. Christensen, L. O., Petersen, N., Andersen, J. B., Sinkjaer, T., and Nielsen, J. B. (2000). Evidence for transcortical reflex pathways in the lower limb of man. Prog. Neurobiol. 62, 251-272. doi: 10.1016/s0301-0082(00)00007-1
27. Courtine, G., Gerasimenko, Y., van den Brand, R., Yew, A., Musienko, P., Zhong, H., et al. (2009). Transformation of nonfunctional spinal circuits into functional states after the loss of brain input. Nat. Neurosci. 12, 1333-1342. doi: 10.1038/nn. 2401
28. Dario, A., Scamoni, C., Picano, M., Casagrande, F., and Tomei, G. (2004). Pharmacological complications of the chronic baclofen infusion in the severe spinal spasticity. Personal experience and review of the literature. J. Neurosurg. Sci. 48, 177-181.
29. Dario, A., and Tomei, G. (2004). A benefit-risk assessment of baclofen in severe spinal spasticity. Drug Saf. 27, 799-818. doi: 10.2165/00002018-200427110-00004
30. Di Giorgio, A. M. (1929). Persistenza nell'animale spinale, di asimmetrie posturali e motorie di origine cerebellare. Nota I-III. Arch. Fisiol. 27, 519-542.
31. Di Giorgio, A. M. (1942). Azione del cervelletto-neocerebellum-sul tono posturale degli arti e localizzazioni cerebellari nell'animale rombencefalico. Arch. Fisiol. 42, 25-79.
32. Dietz, V., Grillner, S., Trepp, A., Hubli, M., and Bolliger, M. (2009). Changes in spinal reflex and locomotor activity after a complete spinal cord injury: a common mechanism? Brain 132, 2196-2205. doi: 10.1093/brain/awp124
33. Edgerton, V. R., Courtine, G., Gerasimenko, Y. P., Lavrov, I., Ichiyama, R. M., Fong, A. J., et al. (2008). Training locomotor networks. Brain Res. Rev. 57, 241-254. doi: 10.1016/j.brainresrev.2007.09.002
34. Edgerton, V. R., Leon, R. D., Harkema, S. J., Hodgson, J. A., London, N., Reinkensmeyer, D. J., et al. (2001). Retraining the injured spinal cord. J. Physiol. 533, 15-22. doi: 10.1111/j.1469-7793.2001.0015b.x
35. Edgerton, V. R., Tillakaratne, N. J., Bigbee, A. J., de Leon, R. D., and Roy, R. R. (2004). Plasticity of the spinal neural circuitry after injury. Annu. Rev. Neurosci. 27, 145-167. doi: 10.1146/annurev.neuro.27.070203.144308
36. Evarts, E. V., and Tanji, J. (1974). Gating of motor cortex reflexes by prior instruction. Brain Res. 71, 479-494. doi: 10.1016/0006-8993(74)90992-5
37. Evatt, M. L., Wolf, S. L., and Segal, R. L. (1989). Modification of human spinal stretch reflexes: preliminary studies. Neurosci. Lett. 105, 350-355. doi: 10. 1016/0304-3940(89)90646-0
38. Feng-Chen, K. C., and Wolpaw, J. R. (1996). Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons. Proc. Natl. Acad. Sci. U S A 93, 9206-9211. doi: 10.1073/pnas.93.17.9206
39. Frigon, A., and Rossignol, S. (2006). Functional plasticity following spinal cord lesions. Prog. Brain Res. 157, 231-260. doi: 10.1016/s0079-6123(06)57016-5
40. Grau, J. W. (2013). Learning from the spinal cord: how the study of spinal cord plasticity informs our view of learning. Neurobiol. Learn. Mem. 108C, 155-171. doi: 10.1016/j.nlm.2013.08.003
41. Grey, M. J., Ladouceur, M., Andersen, J. B., Nielsen, J. B., and Sinkjaer, T. (2001). Group II muscle afferents probably contribute to the medium latency soleus stretch reflex during walking in humans. J. Physiol. 534, 925-933. doi: 10.1111/j. 1469-7793.2001.00925.x
42. Hall, M. (1833). On the reflex function of the medulla oblongata and medulla spinalis. Philos. Trans. R. Soc. Lond. 123, 635-665. doi: 10.1098/rstl.1833.0028
43. Halter, J. A., Carp, J. S., and Wolpaw, J. R. (1995). Operantly conditioned motoneuron plasticity: possible role of sodium channels. J. Neurophysiol. 73, 867-871.
44. Hammond, P. H. (1956). The influence of prior instruction to the subject on an apparently involuntary neuro-muscular response. J. Physiol. 132, 17P-18P.
45. Harkema, S. J., Hillyer, J., Schmidt-Read, M., Ardolino, E., Sisto, S. A., and Behrman, A. L. (2012). Locomotor training: as a treatment of spinal cord injury and in the progression of neurologic rehabilitation. Arch. Phys. Med. Rehabil. 93, 1588-1597. doi: 10.1016/j.apmr.2012.04.032
46. Lee, R. G., Murphy, J. T., and Tatton, W. G. (1983). Long-latency myotatic reflexes in man: mechanisms, functional significance, and changes in patients with Parkinson's disease or hemiplegia. Adv. Neurol. 39, 489-508.
47. Lee, R. G., and Tatton, W. G. (1975). Motor responses to sudden limb displacements in primates with specific CNS lesions and in human patients with motor system disorders. Can. J. Neurol. Sci. 2, 285-293.
48. Lovely, R. G., Gregor, R. J., Roy, R. R., and Edgerton, V. R. (1986). Effects of training on the recovery of full-weight-bearing stepping in the adult spinal cat. Exp. Neurol. 92, 421-435. doi: 10.1016/0014-4886(86)90094-4
49. Maegele, M., Muller, S., Wernig, A., Edgerton, V. R., and Harkema, S. J. (2002). Recruitment of spinal motor pools during voluntary movements versus stepping after human spinal cord injury. J. Neurotrauma 19, 1217-1229. doi: 10. 1089/08977150260338010
50. Mendell, L. M. (1984). Modifiability of spinal synapses. Physiol. Rev. 64, 260-324.
51. Petruska, J. C., Ichiyama, R. M., Jindrich, D. L., Crown, E. D., Tansey, K. E., Roy, R. R., et al. (2007). Changes in motoneuron properties and synaptic inputs related to step training after spinal cord transection in rats. J. Neurosci. 27, 4460-4471. doi: 10.1523/jneurosci.2302-06.2007
52. Pillai, S., Wang, Y., Wolpaw, J. R., and Chen, X. Y. (2008). Effects of H-reflex up-conditioning on GABAergic terminals on rat soleus motoneurons. Eur. J. Neurosci. 28, 668-674. doi: 10.1111/j.1460-9568.2008.06370.x
53. Rossignol, S., Frigon, A., Barriere, G., Martinez, M., Barthelemy, D., Bouyer, L., et al. (2011). Chapter 16-spinal plasticity in the recovery of locomotion. Prog. Brain Res. 188, 229-241. doi: 10.1016/B978-0-444-53825-3.00021-8
54. Segal, R. L., and Wolf, S. L. (1994). Operant conditioning of spinal stretch reflexes in patients with spinal cord injuries. Exp. Neurol. 130, 202-213. doi: 10.1006/exnr. 1994.1199
55. Sheean, G. (2006). Botulinum toxin treatment of adult spasticity: a benefit-risk assessment. Drug Saf. 29, 31-48. doi: 10.2165/00002018-200629010-00003
56. Shurrager, P. S., and Dykman, R. A. (1951). Walking spinal carnivores. J. Comp. Physiol. Psychol. 44, 252-262. doi: 10.1037/h0059889
57. Thomas, A. M., and Simpson, D. M. (2012). Contralateral weakness following botulinum toxin for poststroke spasticity. Muscle Nerve 46, 443-448. doi: 10. 1002/mus.23492
58. Thompson, A. K., Abel, B. M., DeFrancesco, E., Lichtman, S. W., and Pomerantz, F. (2011). Operant up-conditioning of the tibialis anterior motor evoked potential in people with incomplete spinal cord injury. International conference of spinal cord medicine and rehabilitation and 37th Annual Meeting of the American Spinal Injury Association, Program No. 71. Washington, D.C.
59. Thompson, A. K., Chen, X. Y., and Wolpaw, J. R. (2009). Acquisition of a simple motor skill: task-dependent adaptation plus long-term change in the human soleus H-reflex. J. Neurosci. 29, 5784-5792. doi: 10.1523/jneurosci.4326-08.2009
60. Thompson, A. K., Chen, X. Y., and Wolpaw, J. R. (2013a). Soleus H-reflex operant conditioning changes the H-reflex recruitment curve. Muscle Nerve 47, 539-544. doi: 10.1002/mus.23620
61. Thompson, A. K., Pomerantz, F. R., and Wolpaw, J. R. (2013b). Operant conditioning of a spinal reflex can improve locomotion after spinal cord injury in humans Neurosci. 33, 2365-2375. doi: 10.1523/JNEUROSCI.3968-12.2013
62. Wang, Y., Chen, Y., Chen, L., Wolpaw, J. R., and Chen, X. (2013). Effects of soleus H-reflex conditioning on the motoneuron GABAA receptor, G-protein-activated inwardly-rectifying potassium channel 3.2 and voltagegated sodium channels. Society for Neuroscience 43rd Annual Meeting, Program No. 645.619. San Diego, CA.
63. Wang, Y., Pillai, S., Wolpaw, J. R., and Chen, X. Y. (2006). Motor learning changes GABAergic terminals on spinal motoneurons in normal rats. Eur. J. Neurosci. 23, 141-150. doi: 10.1111/j.1460-9568.2005.04547.x
64. Wang, Y., Pillai, S., Wolpaw, J. R., and Chen, X. Y. (2009). H-reflex downconditioning greatly increases the number of identifiable GABAergic interneurons in rat ventral horn. Neurosci. Lett. 452, 124-129. doi: 10.1016/j.neulet.2009.01.054
65. Ward, A. B. (2008). Spasticity treatment with botulinum toxins. J. Neural Transm. 115, 607-616. doi: 10.1007/s00702-007-0833-2
66. Wernig, A., and Müller, S. (1992). Laufband locomotion with body weight support improved walking in persons with severe spinal cord injuries. Paraplegia 30, 229-238. doi: 10.1038/sc.1992.61
67. Wolf, S. L., and Segal, R. L. (1996). Reducing human biceps brachii spinal stretch reflex magnitude. J. Neurophysiol. 75, 1637-1646.
68. Wolpaw, J. R. (1982). Change in short-latency response to limb displacement in primates. Fed. Proc. 41, 2156-2159.
69. Wolpaw, J. R. (1987). Operant conditioning of primate spinal reflexes: the H-reflex. J. Neurophysiol. 57, 443-459.
70. Wolpaw, J. R. (1997). The complex structure of a simple memory. Trends Neurosci. 20, 588-594. doi: 10.1016/s0166-2236(97)01133-8
71. Wolpaw, J. R. (2010). What can the spinal cord teach us about learning and memory? Neuroscientist 16, 532-549. doi: 10.1177/1073858410368314
72. Wolpaw, J. R., Braitman, D. J., and Seegal, R. F. (1983a). Adaptive plasticity in primate spinal stretch reflex: initial development. J. Neurophysiol. 50, 1296-1311.
73. Wolpaw, J. R., and Carp, J. S. (1993). Adaptive plasticity in spinal cord. Adv. Neurol. 59, 163-174.
74. Wolpaw, J. R., and Chen, X. Y. (2001). Operant conditioning of rat H-reflex: effects on mean latency and duration. Exp. Brain Res. 136, 274-279. doi: 10. 1007/s002210000609
75. Wolpaw, J. R., and Chen, X. Y. (2006). The cerebellum in maintenance of a motor skill: a hierarchy of brain and spinal cord plasticity underlies H-reflex conditioning. Learn. Mem. 13, 208-215. doi: 10.1101/lm.92706
76. Wolpaw, J. R., and Herchenroder, P. A. (1990). Operant conditioning of H-reflex in freely moving monkeys. J. Neurosci. Methods 31, 145-152. doi: 10.1016/0165-0270(90)90159-d
77. Wolpaw, J. R., Kieffer, V. A., Seegal, R. F., Braitman, D. J., and Sanders, M. G. (1983b). Adaptive plasticity in the spinal stretch reflex. Brain Res. 267, 196-200. doi: 10.1016/0006-8993(83)91059-4
78. Wolpaw, J. R., and Lee, C. L. (1989). Memory traces in primate spinal cord produced by operant conditioning of H-reflex. J. Neurophysiol. 61, 563-572.
79. Wolpaw, J. R., Maniccia, D. M., and Elia, T. (1994). Operant conditioning of primate H-reflex: phases of development. Neurosci. Lett. 170, 203-207. doi: 10. 1016/0304-3940(94)90319-0
80. Wolpaw, J. R., and O'Keefe, J. A. (1984). Adaptive plasticity in the primate spinal stretch reflex: evidence for a two-phase process. J. Neurosci. 4, 2718-2724.
81. Wolpaw, J. R., Seegal, R. F., and O'Keefe, J. A. (1983c). Adaptive plasticity in primate spinal stretch reflex: behavior of synergist and antagonist muscles. J. Neurophysiol. 50, 1312-1319.
82. Wolpaw, J. R., and Tennissen, A. M. (2001). Activity-dependent spinal cord plasticity in health and disease. Annu. Rev. Neurosci. 24, 807-843. doi: 10. 1146/annurev.neuro.24.1.807
83. Zehr, E. P. (2006). Training-induced adaptive plasticity in human somatosensory reflex pathways. J. Appl. Physiol. (1985) 101, 1783-1794. doi: 10.1152/japplphysiol.00540.2006