Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces

IEEE Transactions on Biomedical Engineering

Volumn 53, Issue 6, 2006, Pages 1164-1173

  Kim, Hyun K ^a,d   Biggs, S James ^a   Schloerb, David W ^a   Carmena, Jose M ^b,e   Lebedev, Mikhail A ^c,f   Nicolelis, Miguel A L ^c   Srinivasan, Mandayam A ^a,d,g,h  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c DUKE UNIVERSITY MEDICAL CENTER   (United States)

^d Massachusetts Institute of Technology Cambridge   (United States)

^e IEEE   (United States)

^f DUKE UNIVERSITY   (United States)

^g Touch Lab   (United States)

^h Society for Neuroscience   (United States)

Author keywords

Brain machine interface; Neuroprosthesis; Shared control; Telerobotics

Indexed keywords

BRAIN-MACHINE INTERFACE (BMI); CONTINUOUS SHARED CONTROL (CSC); NEUROPROSTHESIS; SHARED CONTROL; TELEROBOTICS;

DEGREES OF FREEDOM (MECHANICS); MEDICAL APPLICATIONS; NEUROLOGY; ROBOTS; SENSORS; SIGNAL THEORY; TRAJECTORIES;

BRAIN;

ARTICLE; BRAIN MACHINE INTERFACE; CONTROLLED STUDY; NONHUMAN; ROBOTICS; SENSOR; TASK PERFORMANCE;

ARM; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK; HAND STRENGTH; HUMANS; IMAGINATION; MOVEMENT; MOVEMENT DISORDERS; ROBOTICS; SYSTEMS INTEGRATION; TELEMEDICINE; THERAPY, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 33744988114     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2006.870235     Document Type: Article

References (41)

1. J. Wessberg, C. R. Stambaugh, J. D. Kralik, M. Laubach, J. K. Chapin, J. Kim, S. J. Biggs, M. A. Srinivasan, and M. A. L. Nicolelis, "Real-time prediction of hand trajectory by ensemble of cortical neurons in primates," Nature, vol. 408, pp. 361-365, 2000.
2. J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. O'Doherty, D. M. Santucci, D. Dimitrov, P. G. Patil, C. S. Henriquez, and M. A. L. Nicolelis, "Learning to control brain-machine interface for reaching and grasping by primates," PloS Biol., vol. 1, pp. 192-203, 2003.
3. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, "Instant neural control of a movement signal," Nature, vol. 416, pp. 141-142, 2002.
4. D. M. Taylor, S. I. Tillery, and A. B. Schwartz, "Direct cortical control of 3D neuroprosthetic devices," Science, vol. 296, pp. 1829-1832, 2002.
5. L. Shen and G. E. Alexander, "Preferential representation of instructed target location versus limb trajectory in dorsal premotor area," J. Neurophysiol., vol. 77, no. 3, pp. 1195-1212, 1997.
6. M. A. Lebedev and S. P. Wise, "Tuning for the orientation of spatial attention in dorsal premotor cortex," Eur. J. Neurosci., vol. 13, no. 5, pp. 1002-1008, 2001.
7. D. J. Crammond and J. F. Kalaska, "Modulation of preparatory neuronal activity in dorsal premotor cortex due to stimulus-response compatibility," J. Neurophysiol., vol. 71, no. 3, pp. 1281-1284, 1994.
8. L. A. Jones, "Dexterous hands: human, prosthetic and robotic," Presence, vol. 6, pp. 29-56, 1997.
9. B. Hannaford, L. Wood, D. A. McAffee, and H. Zak, "Stability and performance tradeoffs in bi-lateral telemanipulation," IEEE Trans. Syst. Man Cybern., vol. 21, no. 3, pp. 1764-1767, 1991.
10. M. Massimino and T. B. Sheridan, "Teleoperator performance with varying force and visual feedback," Hum. Factors, vol. 36, no. 1, pp. 145-157, 1994.
11. S. G. Meek, S. C. Jacobsen, and P. P. Goulding, "Extended physiological faction: design and evaluation of a proportional force feedback system," J. Rehabil. Res. Dev., vol. 26, pp. 53-62, 1989.
12. M. Burstedt, B. Edin, and R. Johansson, "Coordination of fingertip force during human manipulation can emerge from independent neural networks controlling each engaged digit," Exp. Brain Res., vol. 117, pp. 67-79, 1997.
13. K. Salisbury, "Issues in human/computer control of dexterous remote hands," IEEE Trans. Aerosp. Electron. Syst., vol. 24, pp. 591-596, 1988.
14. S. Hayati and S. T. Venkataraman, "Design and implementation of a robot control system with traded and shared control capability," in Proc. IEEE Int. Conf. Robotics and Automation, 1989, vol. 3, pp. 1310-1315.
15. S. P. Levine, D. A. Bell, L. A. Jaros, R. C. Simpson, Y. Koren, and J. Borenstein, "The NavChair assistive wheelchair navigation system," IEEE Trans. Rehab. Eng., vol. 7, no. 4, pp. 443-151, Dec. 1999.
16. G. Wasson, J. Gunderson, S. Graves, and R. Felder, "Effective shared control in cooperative mobility aids," in FLAIRS 2001, pp. 509-513.
17. M. Oda, N. Inaba, Y. Takano, S. Nishida, M. Kayashi, and Y. Sugano, "Onboard local compensation on ETS-W space robot teleoperation," in Pcoc. IEEE/ASME Int. Conf. Advanced Intelligent Mechatronics, 1999, pp. 701-706.
18. P. G. Backes, "Multi-sensor based impedance control for task execution," in Proc. IEEE Int. Conf. Robotics and Automation, 1992, vol. 2, pp. 1245-1250.
19. P. Michelman and P. Allen, "Shared autonomy in a robot hand teleoperation system," in Proc. IEEE/RSJ/GI Int. Conf. Intelligent Robots and Systems, 1994, vol. 1, pp. 253-259.
20. L. Li, B. Cox, M. Diftler, S. Shelton, and B. Rogers, "Development of a telepresence controlled ambidextrous robot for space applications," in Proc. IEEE Int. Conf. Robotics and Automation, 1996, vol. 1, pp. 58-63.
21. L. Turki and P. Coiffet, "On grasp synthesis and planning of multi-fingered robot hands for a telemanipulation task," in Proc. IEEE Int. Workshop on Robot and Human Communication, 1995, pp. 141-146.
22. B. Brunner, K. Arbter, and G. Herzinger, "Task directed programming of sensor based robots," in Proc. IEEE/RSJ/GI Int. Conf. Intelligent Robots and Systems, 1994, vol. 2, pp. 1080-1087.
23. C. S. Lovchik and M. A. Diftler, "The Robonaut hand: a dexterous robot hand for space," in Proc. IEEE Int. Conf. Robotics and Automation, 1999, vol. 2, pp. 907-912.
24. R. O. Ambrose, H. Aldridge, R. S. Askew, R. R. Burridge, W. Bluethmann, M. Ditfler, C. Lovchick, D. Magruder, and F. Rehnmark, "Robonaut: NASA's space humanoid," IEEE Intell. Syst. Applicat. Mag., vol. 15, no. 4, pp. 57-62, Jul.-Aug. 2000.
25. W. B. Griffin, "Shared Control for Dexterous Telemanipulation," Ph.D. dissertation, Dept. of Mech. Eng., Stanford Univ., Stanford, CA, 2003.
26. R. A. Brooks, "A robust layered control system for a mobile robot," IEEE J. Robotic. Autom., vol. 2, no. 1, pp. 14-23, 1986.
27. A. Matsikis, M. Schmitt, M. Rous, and K. F. Kraiss, "Ein Konzept für die mobile Manipulation von unbekannten Objektenmit Hilfe von 3D-Rekonstruktion und Visual Servoing," Informatik Aktuell, Fachgespräch AMS, vol. 15, pp. 179-187, Nov. 1999.
28. B. K. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.
29. S. Hutchinson, G. Hager, and P. Corke, "A tutorial on visual servo control," IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 651-670, Oct. 1996.
30. D. Kragic and H. Christensen, "Robust visual servoing," Int. J. Robot. Res. (Special Issue on Visual Servoing), vol. 22, no. 10-11, pp. 923-940, Oct. 2003.
31. O. Khatib, "Real-time obstacle avoidance for manipulators and mobile robots," Int. J. Robot. Res., vol. 5, no. 1, pp. 90-98, 1986.
32. J.-J. E. Slotine and W. Li, Applied Nonlinear Control. Englewood Cliffs, NJ: Prentice-Hall, 1991.
33. A. Levinsson, M. Garwicz, and J. Schouenborg, "Sensorimotor transformation in cat nociceptive withdrawal reflex system," Eur. J. Neurosci., vol. 11, pp. 4327-4332, 1999.
34. D. I. Zafeiriou, I. G. Tsikoulas, and G. M. Kremenopoulos, "Prospective follow-up of primitive reflex profiles in high-risk infants: clues to early diagnosis of cerebral palsy," Pediatr. Neurol., vol. 13, no. 2, pp. 148-152, 1995.
35. M. A. L. Nicolelis, D. Dimitrov, J. M. Carmena, R. E. Crist, G. Lehew, J. Kralik, and S. Wise, "Chronic, multi site, multi electrode recordings in macaque monkeys," Proc. Nat. Acad. Sci., vol. 100, no. 19, pp. 11041-11046, 2003.
36. D. A. Lawrence, "Stability and transparency in bilateral teleoperation," IEEE Trans. Robot. Autom., vol. 9, no. 5, pp. 624-637, Oct. 1993.
37. Y. Yokokohji and T. Yoshikawa, "Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment," IEEE Trans. Robot. Autom., vol. 10, no. 5, pp. 605-620, Oct. 1994.
38. T. B. Sheridan, Telerobotics, Automation, and Human Supervisory Control. Cambridge, MA: MIT Press, 1992.
39. J. H. Reynolds, L. Chelazzi, and R. Desimone, "Competitive mechanisms subserve attention in macaque areas V2 and V4," J. Neurosci., vol. 19, no. 5, pp. 1736-1753, Mar. 1999.
40. S. Kastner and L. G. Ungerleider, "Mechanisms of visual attention in the human cortex," Annu. Rev. Neurosci., vol. 23, pp. 315-341, 2000.
41. C. L. Colby and M. E. Goldberg, "Space and attention in parietal cortex," Annu. Rev. Neurosci., vol. 22, pp. 319-349, 1999.