A telepresence mobile robot controlled with a noninvasive brain-computer interface

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 3, 2012, Pages 793-804

  Escolano, Carlos ^a   Antelis, Javier Mauricio ^a   Minguez, Javier ^a  

^a UNIVERSITY OF ZARAGOZA   (Spain)

Author keywords

Brain computer interfaces; rehabilitation robotics; telerobotics

Indexed keywords

AUTONOMOUS NAVIGATION; BRAIN-COMPUTER INTERFACES (BCI); CAMERA ORIENTATION; EVALUATION STUDY; REHABILITATION ROBOTICS; REMOTE ENVIRONMENT; TECHNICAL EVALUATION; TELE-ROBOTICS; TELEPRESENCE; TELEPRESENCE SYSTEMS; VISUAL EXPLORATION;

ELECTRONIC DOCUMENT EXCHANGE; MOBILE ROBOTS; NAVIGATION; ROBOTICS; VISUAL COMMUNICATION;

BRAIN COMPUTER INTERFACE;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER INTERFACE; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; EVENT RELATED POTENTIAL; HUMAN; MAN MACHINE INTERACTION; METHODOLOGY; PSYCHOPHYSIOLOGY; ROBOTICS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOFEEDBACK, PSYCHOLOGY; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; EVENT-RELATED POTENTIALS, P300; HUMANS; MAN-MACHINE SYSTEMS; MODELS, THEORETICAL; ROBOTICS; USER-COMPUTER INTERFACE;

EID: 84861189819     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2177968     Document Type: Article

References (42)

1. J. R.Wolpaw, D. J. McFarl and , G.W. Neat, and C. A. Forneris, "An EEGbased brain-computer interface for cursor control," Electroencephalography Clin. Neurophysiol., vol. 78, no. 3, pp. 252-259, Mar. 1991.
2. N. Birbaumer, N. Ghanayim, T. Hinterberger, I. Iversen, B. Kotchoubey, A. Kübler, J. Perelmouter, E. Taub, and H. Flor, "A spelling device for the paralyzed," Nature, vol. 398, no. 6725, pp. 297-298, Mar. 1999.
3. A. A. Karim, T. Hinterberger, J. Richter, J. Mellinger, N. Neumann, H. Flor, A. Kübler, and N. Birbaumer, "Neural Internet: Web surfing with brain potentials for the completely paralyzed," Neurorehab. Neural Repair, vol. 20, no. 4, pp. 508-515, Dec. 2006. (Pubitemid 44690633)
4. J. R. Millán, F. Renkens, J. Mouriño, and W. Gerstner, "Noninvasive brain-actuated control of a mobile robot by human EEG," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 1026-1033, Jun. 2004. (Pubitemid 38661458)
5. I. Iturrate, J. M. Antelis, A. Kübler, and J. Minguez, "A noninvasive brainactuated wheelchair based on a P300 neurophysiological protocol and automated navigation," IEEE Trans. Robot., vol. 25, no. 3, pp. 614-627, Jun. 2009.
6. G. Vanacker, J. R. Millán, E. Lew, P. W. Ferrez, F. G. Moles, J. Philips, H. Van Brussel, and M. Nuttin, "Context-based filtering for assisted brainactuated wheelchair driving," Comput. Intell. Neurosci., vol. 2007, p. 3, Jan. 2007.
7. T. Luth, D. Ojdanic, O. Friman, O. Prenzel, and A. Graser, "Low level control in a semi-autonomous rehabilitation robotic system via a brain-computer interface," in Proc. IEEE 10th ICORR, 2007, pp. 721-728.
8. B. Rebsamen, E. Burdet, C. Guan, H. Zhang, C. L. Teo, Q. Zeng, C. Laugier, and M. H. Ang, Jr., "Controlling a wheelchair indoors using thought," IEEE Intell. Syst., vol. 22, no. 2, pp. 18-24, Mar./Apr. 2007. (Pubitemid 46495741)
9. A. Ferreira,W. C. Celeste, F. A. Cheein, T. F. Bastos-Filho, M. Sarcinelli-Filho, and R. Carelli, "Human-machine interfaces based on EMG and EEG applied to robotic systems," J. NeuroEng. Rehab., vol. 5, no. 1, pp. 1-15, Mar. 2008.
10. I. Iturrate, L. Montesano, and J. Minguez, "Single trial recognition of error-related potentials during observation of robot operation," in Proc. Int. Conf. IEEE EMBC, 2010, pp. 4181-4184.
11. C. J. Bell, P. Shenoy, R. Chalodhorn, and R. P. N. Rao, "Control of a humanoid robot by a noninvasive brain-computer interface in humans," J. Neural Eng., vol. 5, no. 2, pp. 214-220, Jun. 2007.
12. G. Pfurtscheller, G. R. Müller, J. Pfurtscheller, H. J. Gerner, and R. Rupp, ""Thought"-Control of functional electrical stimulation to restore h and grasp in a patient with tetraplegia," Neurosci. Lett., vol. 351, no. 1, pp. 33-36, Nov. 2003. (Pubitemid 37205178)
13. M. Tavella, R. Leeb, R. Rupp, and J. R. Millán, "Towards natural noninvasive h and neuroprostheses for daily living," in Proc. Int. Conf. IEEE EMBC, 2010, pp. 126-129.
14. A. Chella, E. Pagello, E. Menegatti, R. Sorbello, S. M. Anzalone, F. Cinquegrani, L. Tonin, F. Piccione, K. Prifitis, C. Bl and a, E. Buttita, and E. Tranchina, "A BCI teleoperated museum robotic guide," in Proc. Int. Conf. CISIS, 2009, pp. 783-788.
15. A. Akce, M. Johnson, and T. Bretl, "Remote teleoperation of an unmanned aircraft with a brain-machine interface: Theory and preliminary results," in Proc. IEEE ICRA, 2010, pp. 5322-5327.
16. L. Tonin, E. Menegatti, M. Cavinato, C. Avanzo, M. Pirini, A. Merico, L. Piron, K. Priftis, S. Silvoni, C. Volpato, and F. Piccione, "Evaluation of a robot as embodied interface for brain computer interface systems," Int. J. Bioelectromagn., vol. 11, no. 2, pp. 97-104, 2009.
17. L. Tonin, R. Leeb, M. Tavella, S. Perdikis, and J. R. Millán, "The role of shared-control in BCI-based telepresence," in Proc. IEEE Int. Conf. SMC, 2010, pp. 1462-1466.
18. A. Kübler and N. Birbaumer, "Brain-computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients?," Clin. Neurophysiol., vol. 119, no. 11, pp. 2658-2666, Nov. 2008.
19. F. Galán, M. Nuttin, E. Lew, P. W. Ferrez, G. Vanacker, J. Philips, and J. R. Millán, "A brain-actuated wheelchair: Asynchronous and noninvasive brain-computer interfaces for continuous control of robots," Clin. Neurophysiol., vol. 119, no. 9, pp. 2159-2169, Sep. 2008.
20. J. R. Wolpaw, N. Birbaumer, D. J. McFarl and , G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, no. 6, pp. 767-791, 2002. (Pubitemid 34621187)
21. J. Minguez, F. Lamiraux, and J. P. Laumond, "Motion planning and obstacle avoidance," in Springer H and book of Robotics, B. Siciliano and O. Khatib, Eds. Berlin, Germany: Springer-Verlag, 2008, pp. 827-852.
22. C. Escolano, J. M. Antelis, and J. Minguez, "Human brain-teleoperated robot between remote places," in Proc. IEEE ICRA, 2009, pp. 4430-4437.
23. S. Sutton, M. Braren, J. Zublin, and E. R. John, "Evoked potential correlates of stimulus uncertainty," Science, vol. 150, no. 3700, pp. 1187-1188, Nov. 1965.
24. S. H. Patel and P. N. Azzam, "Characterization of N200 and P300: Selected studies of the event-related potential," Int. J. Med. Sci., vol. 2, no. 4, pp. 147-154, 2005. (Pubitemid 41382986)
25. J. R. Millán, R. Rupp, G. R. Müller-Putz, R. Murray-Smith, C. Giugliemma, M. Tangermann, C. Vidaurre, F. Cincotti, A. Kübler, R. Leeb, C. Neuper, K. R. Müller, and D. Mattia, "Combining brain-computer interfaces and assistive technologies: State-of-the-art and challenges," Frontiers Neurosci., vol. 4, p. 161, 2010.
26. D. J. Krusienski, E. W. Sellers, F. Cabestaing, S. Bayoudh, D. J. McFarl and , T. M. Vaughan, and J. R. Wolpaw, "A comparison of classification techniques for the P300 speller," J. Neural Eng., vol. 3, no. 4, pp. 299-305, Dec. 2006.
27. G. Schalk, D. J. McFarl and , T. Hinterberger, N. Birbaumer, and J. R. Wolpaw, "BCI2000: A general-purpose brain-computer interface (BCI) system," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 1034-1043, Jun. 2004. (Pubitemid 38661459)
28. C. Escolano, A. Ramos, T. Matuz, N. Birbaumer, and J. Minguez, "A telepresence robotic system operated with a P300-based brain-computer interface: Initial tests with ALS patients," in Proc. Int. Conf. IEEE EMBC, 2010, pp. 4476-4480.
29. L. A. Farwell and E. Donchin, "Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials," Electroencephalography Clin. Neurophysiol., vol. 70, no. 6, pp. 510-523, Dec. 1988.
30. D. J. Krusienski, E. W. Sellers, D. J. McFarl and , T. M. Vaughan, and J. R. Wolpaw, "Toward enhanced P300 speller performance," J. Neurosci. Methods, vol. 167, no. 1, pp. 15-21, Jan. 2008. (Pubitemid 350180088)
31. T. H. J. Collett, B. A. MacDonald, and B. P. Gerkey, "Player 2.0: Toward a practical robot programming framework," in Proc. ACRA, 2005.
32. L. Montesano, J. Minguez, and L. Montano, "Modeling dynamic scenarios for local sensor-based motion planning," Auton. Robots, vol. 25, no. 3, pp. 231-251, Oct. 2008.
33. J. Minguez and L. Montano, "Sensor-based robot motion generation in unknown, dynamic and troublesome scenarios," Robot. Auton. Syst., vol. 52, no. 4, pp. 290-311, Sep. 2005. (Pubitemid 41230133)
34. L. Montesano, J. Minguez, and L. Montano, "Lessons learned in integration for sensor-based robot navigation systems," Int. J. Adv. Robot. Syst., vol. 3, no. 1, pp. 85-91, 2006.
35. A. Ranganathan and S. Koenig, "A reactive robot architecture with planning on dem and ," in Proc. IEEE Int. Conf. IROS, 2003, pp. 1462-1468.
36. J. Minguez and L. Montano, "Nearness diagram (ND) navigation: Collision avoidance in troublesome scenarios," IEEE Trans. Robot. Autom., vol. 20, no. 1, pp. 45-59, Feb. 2004.
37. J. Minguez and L. Montano, "Extending collision avoidance methods to consider the vehicle shape, kinematics, and dynamics of a mobile robot," IEEE Trans. Robot., vol. 25, no. 2, pp. 367-381, Apr. 2009.
38. L. Montesano, M. Diaz, S. Bhaskar, and J. Minguez, "Towards an intelligent wheelchair system for users with cerebral palsy," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 18, no. 2, pp. 193-202, Apr. 2010.
39. J. R. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarl and , P. H. Peckham, G. Schalk, E. Donchin, L. A. Quatrano, C. J. Robinson, and T. M. Vaughan, "Brain-computer interface technology: A review of the first international meeting," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164-173, Jun. 2000. (Pubitemid 30437005)
40. M. Baker, R. Casey, B. Keyes, and H. A. Yanco, "Improved interfaces for human-robot interaction in urban search and rescue," in Proc. IEEE Int. Conf. SMC, 2004, pp. 2960-2965. (Pubitemid 40408616)
41. H. Zhang, C. Guan, and C. Wang, "Asynchronous P300-based brain-computer interfaces: A computational approach with statistical models," IEEE Trans. Biomed. Eng., vol. 55, no. 6, pp. 1754-1763, Jun. 2008. (Pubitemid 351728023)
42. A. Buttfield, P. W. Ferrez, and J. R. Millán, "Towards a robust BCI: Error potentials and online learning," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 14, no. 2, pp. 164-168, Jun. 2006. (Pubitemid 44150232)