Toward brain-actuated humanoid robots: Asynchronous direct control using an EEG-Based BCI

IEEE Transactions on Robotics

Volumn 28, Issue 5, 2012, Pages 1131-1144

  Chae, Yongwook ^a   Jeong, Jaeseung ^a   Jo, Sungho ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Asynchronous direct control; brain computer interface (BCI); electroencephalograph (EEG); humanoid robots; rehabilitation robotics

Indexed keywords

BRAIN-COMPUTER INTERFACES (BCI); DIRECT CONTROL; ELECTROENCEPHALOGRAPH (EEG); HUMANOID ROBOT; REHABILITATION ROBOTICS;

ANTHROPOMORPHIC ROBOTS; ELECTROENCEPHALOGRAPHY; NAVIGATION SYSTEMS; REAL TIME CONTROL; ROBOTICS; SPECTRUM ANALYSIS;

BRAIN COMPUTER INTERFACE;

EID: 84867198549     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2012.2201310     Document Type: Article

References (51)

1. I.W. Park, J.Y. Kim, J. Lee, and J.H.Oh, "Mechanical design of humanoid robot platform KHR-3 (KAIST humanoid robot 3: HUBO)," in Proc. 5th IEEE/RAS Int. Conf. Humanoid Robots, Dec. 2005, pp. 321-326.
2. R. Tajima, D. Honda, and K. Suga, "Fast running experiments involving a humanoid robot," in Proc. IEEE Int. Conf. Robot. Autom., May 2009, pp. 1571-1576.
3. K. Hirai, M. Hirose, Y. Haikawa, and T. Takenaka, "The development of Honda humanoid robot," in Proc. IEEE Int. Conf. Robot. Autom., May 1998, vol. 2, pp. 1321-1326.
4. R. Hirose and T. Takenaka, "Development of the humanoid robot ASIMO," Honda R&D Tech. Rev., vol. 13, pp. 1-6, 2001.
5. K. Kimura, T. Higeo, I. Hiyoshi, and O. Keita, "Development of the compact humanoid robot HOAP-2," Nippon Robotto Gakkai Gakujutsu Koenkai Yokoshu, vol. 21, pp. 1-29, 2003.
6. G. A. Bekey, Autonomous robots: From Biological Inspiration to Implementation and Control. Cambridge, MA: MIT Press, 2005.
7. J. K. Chapin, K. Moxon, R. Markowitz, and M. Nicolelis, "Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex," Nature Neurosci., vol. 2, pp. 664-670, 1999.
8. J. Wessberg, C. R. Stambaugh, J. D. Kralik, P. D. Beck, M. Laubach, J. K. Chapin, J. Kim, S. J. Biggs, M. A. Srinivasan, and M. A. Nicolelis, "Real-time prediction of hand trajectory by ensembles of cortical neurons in primates," Nature, vol. 408, pp. 361-365, 2000.
9. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, "Brain-machine interface: Instant neural control of a movement signal," Nature, vol. 416, pp. 141-142, 2002.
10. M. A. L. Nicolelis, "Brain-machine interfaces to restore motor function and probe neural circuits," Nature Rev. Neurosci., vol. 4, pp. 417-422, 2003.
11. D. M. Taylor, S. H. Tillery, and A. B. Schwartz, "Direct cortical control of 3D neuroprosthetic devices," Science, vol. 296, no. 5574, pp. 1829-1832, 2002.
12. J. Wolpaw and D. McFarland, "Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans," in Proc. Natl. Acad. Sci. U.S.A., 2004, vol. 101, no. 51, pp. 17849-17854.
13. J. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarland, P. H. Peckham, G. Schalk, E. Donchin, L. A. Quatrano, C. J. Robinson, and T. M. Vaughan, "Brain-computer interface technology: A review of the first international meeting," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164-173, Jun. 2000.
14. G. Pfurtscheller, C. Neuper, C. Guger, W. Harkam, H. Ramoser, A. Schlogl, B. Obermaier, and M. Pregenzer, "Current trends in Graz brain-computer interface (BCI) research," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 216-219, Jun. 2000.
15. J. Millan, F. Renkens, J. Mourino, and W. Gerstner, "Noninvasive brainactuated control of a mobile robot by human EEG," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 1026-1033, Jun. 2004.
16. J. Vora, B. Allison, and M. Moore, "A P3 brain computer interface for robot arm control," presented at the Soc. Neurosci. Abstr., San Diego, CA, Oct. 2004.
17. B. Rebsamen, E. Burdet, C. Guan, H. Zhang, C. L. Teo, Q. Zeng, M. Ang, and C. Laugier, "A brain-controlled wheelchair based on P300 and path guidance," in Proc. 1st IEEE/RAS-EMBS Int. Conf. Biomed. Robot. Biomechatron., Feb. 2006, pp. 1101-1106.
18. I. Iturrate, J. Antelis, A. K̈ubler, and J. Minguez, "A noninvasive brainactuated wheelchair based on a P300 neurophysiological protocol and automated navigation," IEEE Trans. Robot., vol. 25, no. 3, pp. 614-627, Jun. 2009.
19. C. Bell, P. Shenoy, R. Chalodhorn, and R. Rao, "Control of a humanoid robot by a noninvasive brain-computer interface in humans," J. Neural Eng., vol. 5, pp. 214-220, 2008.
20. T. O. Zander, C. Kothe, S. Jatzev, M. Gaertner, "Enhancing humancomputer interaction with input from active and passive brain-computer interfaces," in Brain-Comput. Interfaces: Applying our Minds to Humancomputer Interaction, 1st ed., D. S. Tan and A. Nijholt, Eds. London: Springer, 2010, pp. 181-199.
21. E. Sellers, D. Krusienski, D. McFarland, T. Vaughan, and J. Wolpaw, "A P300 event-related potential brain-computer interface (BCI): The effects of matrix size and inter stimulus interval on performance," Biol. Psychol., vol. 73, pp. 242-252, 2006.
22. K. Muller, M. Tangermann, and B. Blankertz, "Machine learning for real-time sing-trial EEG-analysis: From brain-computer interfacing to mental state monitoring," J. Neurosci. Methods, vol. 167, pp. 82-90, 2008.
23. R. Scherer, G. Muller, C. Neuper, and G. Pfurtscheller, "An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 979-984, Jun. 2004.
24. G. Townsend, B. LaPallo, C. Boulay, D. Krusienski, G. Frye, C. Hauser, N. Schwartz, T. Vaughan, J. Wolpaw, and E. Sellers, "A novel P300-based brain-computer interfaces stimulus presentation paradigm: Moving beyond rows and columns," Clin. Neurophysiol., vol. 121, pp. 1109-1120, 2010.
25. D. McFarland and J. Wolpaw, "Brain-computer interfaces for communication and control," Commun. ACM, vol. 54, pp. 60-66, 2011.
26. Y. Chae, S. Jo, and J. Jeong, "Brain-actuated humanoid robot navigation control using asynchronous brain-computer interface," in Proc. Int. IEEE/EMBS Conf. Neural Eng., Apr./May 2011, pp. 519-524.
27. Y. Chae, J. Jeong, and S. Jo, "Noninvasive brain-computer interface-based control of humanoid navigation," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Sep. 2011, pp. 685-691.
28. S. Mason and G. Birch, "A brain-controlled switch for asynchronous control applications," IEEE Trans. Biomed. Eng., vol. 47, no. 10, pp. 1297-1307, Oct. 2000.
29. G. Townsend, B. Graimann, and G. Pfurtscheller, "Continuous EEG classification during motor imagery-simulation of an asynchronous BCI," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 12, no. 2, pp. 258-265, Jun. 2004.
30. R. Scherer, F. Lee, A. Schlogl, R. Leeb, H. Bischof, and G. Pfurtscheller, "Toward self-paced brain-computer communication: Navigation through virtual worlds," IEEE Trans. Biomed. Eng., vol. 55, no. 2, pp. 675-682, Feb. 2008.
31. B. Hjorth, "An on-line transformation of EEG scalp potentials into orthogonal source derivations," Electroencephal. Clin. Neurophysiol., vol. 39, pp. 526-530, 1975.
32. D. McFarland, L. McCane, S. David, and J. Wolpaw, "Spatial filter selection for EEG-based Communication," Electroencephal. Clin. Neurophysiol., vol. 103, pp. 386-394, 1997.
33. D. McFarland, L. Miner, T. Vaughan, and J. Wolpaw, "Mu and beta rhythm topographies duringmotor imagery and actual movements," Brain Topography, vol. 12, pp. 177-186, 2000.
34. S. L. Marple, Jr., Digital Spectral Analysis With Applications. Englewood Cliffs, NJ: Prentice-Hall, 1987.
35. D. J. McFarland and J. R. Wolpaw, "Sensorimotor rhythm-based braincomputer interface (BCI): Model order selection for autoregressive spectral analysis," J. Neural Eng., vol. 5, no. 2, pp. 155-162, Jun. 2008.
36. G. Pfurtscheller, Ch. Neuper, D. Flotzinger, and M. Pregenzer, "EEGbased discrimination between imagination of right and left hand movement," Electroencephal.Clin.Neurophysiol., vol. 103, pp. 642-651, 1997.
37. T. Dat and C. Guan, "Feature selection based on fisher ratio and mutual information analyses for robust brain computer interface," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Apr. 2007, pp. I-337-I-340.
38. X. Pei and C. Zheng, "Classification of left and right hand motor imagery tasks based on EEG frequency component selection," in Proc. Int. Conf. Bioinf. Biomed. Eng., May 2008, pp. 1888-1891.
39. J. Friedman, "Regularized discriminant analysis," J. Amer. Statist. Assoc., vol. 84, no. 405, pp. 165-175, 1989.
40. G. J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition. New York: Wiley, 2004.
41. F. Lotte, M. Congedo, A Lecuyer, F Lamarche, and B. Arnaldi, "A review of classification algorithms for EEG-based brain-computer interfaces," J. Neural Eng., vol. 4, pp. R1-R13, 2007.
42. D. Gouaillier, V. Hugel, P. Blazevic, C. Kilner, J. Monceaux, P. Lafourcade, B. Marnier, J. Serre, and B. Maissonier, "Mechatronic design of NAO humanoid," in Proc. IEEE Int. Conf. Robot. Autom., 2009, pp. 769-774.
43. G. Pfurtscheller, C. Brunner, A. Schl̈ogl, and F. H. L. da Silva, "Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks," Neuroimage, vol. 31, pp. 153-159, 2006.
44. J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, pp. 767-91, Jun. 2002.
45. R. Leeb, D. Friedman, G. R. Muller-Putz, R. Scherer, M. Slater, and G. Pfurtscheller, "Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: A case study with a tetraplegic," Comput. Intell. Neurosci., pp. 79642-1-79642-8, 2007.
46. K.-E. Ko, H.-C. Yang, and K.-B. Sim, "Emotion recognition using EEG signals with relative power values and Bayesian network," Int. J. Control Autom. Syst., vol. 7, no. 5, pp. 865-870, 2009.
47. D. Kulic and E. Croft, "Affective state estimation for human-robot interaction," IEEE Trans. Robot., vol. 23, no. 5, pp. 991-1000, Oct. 2007.
48. P. Rani, C. Liu,N. Sarkar, and E.Vanman, "An empirical study of machine learning techniques for affect recognition in human-robot interaction," Pattern Anal. Appl., vol. 9, pp. 58-89, 2006.
49. R. Picard, "Affective computing: challenges," Int. J. Human-Comput. Stud., vol. 59, pp. 55-64, 2003.
50. G. Pfurtscheller, B. Z. Allison, C. Brunner, G. Bauernfeind, T. Solis-Escalante, R. Scherer, T. O. Zander, G. Mueller-Putz, C. Neuper, and N. Birbaumer, "The hybrid BCI," Frontiers Neurosci., vol. 4, pp. 1-11, 2010.
51. M. Moore, "Real-world applications for brain-computer interface technology," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 162-165, Jun. 2003.