Quadcopter flight control using a low-cost hybrid interface with EEG-based classification and eye tracking

Computers in Biology and Medicine

Volumn 51, Issue , 2014, Pages 82-92

  Kim, Byung Hyung ^a   Kim, Minho ^a   Jo, Sungho ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Brain computer interface; Eye tracking; Hybrid interface; Mental concentration; Quadcopter flight control

Indexed keywords

INFORMATION DISSEMINATION; VISUAL COMMUNICATION;

CONTROL COMMAND; EYE-TRACKING; FLIGHT CONTROL; HYBRID INTERFACE; PHYSICAL ENVIRONMENTS; TARGET LOCATION; THREE DIMENSIONAL SPACE; VISUAL FEEDBACK;

EYE MOVEMENTS;

ADULT; AGILITY; ALGORITHM; ARTICLE; ASSOCIATION; COMPUTER INTERFACE; CONTROLLED STUDY; COST; ELECTROENCEPHALOGRAM; EVALUATION STUDY; EYE TRACKING; HUMAN; HUMAN EXPERIMENT; HYBRID; MENTAL CONCENTRATION; MENTAL HEALTH; MENTAL PERFORMANCE; NORMAL HUMAN; PERFORMANCE; PRIORITY JOURNAL; ROBOTICS; TRAVEL; VISUAL FEEDBACK; AIRCRAFT; BRAIN COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; EYE MOVEMENT; OCULOGRAPHY; PHYSIOLOGY;

AIRCRAFT; BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; EYE MOVEMENT MEASUREMENTS; EYE MOVEMENTS; HUMANS;

EID: 84901483912     PISSN: 00104825     EISSN: 18790534     Source Type: Journal    
DOI: 10.1016/j.compbiomed.2014.04.020     Document Type: Article

References (34)

1. Duchowski A.T. Eye Tracking Methodology: Theory and Practice 2007, Springer-Verlag, London. 2nd Ed.
2. Jacob R.J.K., Karn K.S. Eye tracking in human-computer interaction and usability research: ready to deliver the promises. Mind's Eye: Cogn. Appl. Asp. Eye Mov. Res. 2003, 4:573-607.
3. Wolpaw J.R., et al. Brain-computer interface technology: a review of the first international meeting. IEEE Trans. Rehabil. Eng. 2000, 8(2):164-173.
4. LaFleur K., Cassady K., Doud A., Shades K., Rogin E., He B. Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface. J. Neural Eng. 2013, 10.
5. Royer A.S., Doud A.J., Rose M.L., He B. EEG control of a virtual helicopter in 3-dimensional space using intelligent control strategies, Neural Systems and Rehabilitation Engineering. IEEE Trans. 2010, 18(6):581-589.
6. Doud A.J., Lucas J.P., Pisansky M.T., He B. Continuous three-dimensional control of a virtual helicopter using a motor imagery based brain-computer interface. PlOS One 2011, 6(10):e26322.
7. Chae Y., Jeong J., Jo S. Toward brain-actuated humanoid robots: asynchronous direct-control using an EEG-based BCI. IEEE Trans. Robot. 2012, 28(5):1131-1144.
8. Allison B.Z., Leeb R., Brunner C., Müller-Putz G.R., Bauernfeind G., Kelly J.W., Neuper C. Toward smarter BCIs: extending BCIs through hybridization and intelligent control. J. Neural Eng. 2012, 9(1):1-7.
9. Choi B., Jo B.S. A low-cost EEG system-based hybrid brain-computer interface for humanoid robot navigation and recognition. PLOS One 2013, 8(9).
10. Zander T.O., Gaertner M., Kothe C., Vilimek R. Combining eye gaze input with a brain-computer interface for touchless human-computer interaction. Int. J. Hum.-Comput. Interact. 2010, 27(1):38-51.
11. M. Kim, S. Jo, Hybrid EEG and eye movement interface to multi-directional target selection, in: Proceedings of the IEEE EMBS, (2013) 763-766.
12. Sanna A., Lamberti F., Paravati G., Henao Ramirez E.A., Manuri F. A kinect-based natural interface quadcoptor control. Enterain. Comput. 2013, 4(3):179-186.
13. Brunner P., Bianchi L., Guger C., Cincotti F., Schalk G. Current trends in hardware and software for brain-computer interfaces (BCIs). J. Neural Eng. 2011, 8:025001.
14. D. Li, J. Babcock, D.J. Parkhurst, OpenEyes: a low-cost head-mounted eye-tracking solution, in: Proceedings of the Symposium on Eye Tracking Research & Application (ETRA), (2006) 95-100.
15. Borghetti D., Bruni A., Fabbrini M., Murri L., Sartucci F. A low-cost interface for control of computer functions by means of eye movements. Comput. Biol. Med. 2007, 37:1765-1770.
16. A.T. Campbell, et al., NeuroPhone: brain-mobile phone interface using a wireless EEG headset, in: Proceedings of the ACM SIGCOM Workshop on Networking, Systems, & Applications on Mobile Handhelds, (2010) 3-8.
17. Bobrov P., et al. Brain-computer interface based on generation of visual images. PLOS One 2011, 6(6):e20674.
18. C.H. Morimoto, D. Koons, A. Amit, M. Flickner, S. Zhai, Keeping an eye for HCI, in: Proceedings of the XII Brazilian Symposium on Computer Graphics and Image Processing, 1999171-176.
19. Ramoser H., Muller-Gerking J., Pfurtscheller G. Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans. Rehabil. Eng. 2000, 8(4):441-446.
20. Kandel E.R., Schwartz J.H., Jessell T.M. Principles of Neural Science 2001, 916. McGraw-Hill, New York, US. 4th Ed.
21. Purves D., et al. Neuroscience 2004, 668-670. Sinauer Associates, Inc., Sunderland, Massachusetts, USA. 3rd Ed.
22. Abbott W.W., Faisal A.A. Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain-machine interfaces. J. Neural Eng. 2012, 9(4):046016.
23. McFarland D.J., Sarnacki W.A., Vaughan T.M., Wolpaw J.R. Brain-computer interface (BCI) operation: signal and noise during early training sessions. Clin. Neurophysiol. 2005, 116(1):56-62.
24. Hand D.J., Till R.J. A simple generalisation of the area under the ROC curve for multiple class classification problems. Mach. Learn. 2001, 45:171-186.
25. R. Poli, C. Cinel, A. Matran-Fernandez, F. Sepulveda, A. Stoica, Towards cooperative brain-computer interfaces for space navigation. in: Proceedings of the 2013 International Conference on Intelligent User Interfaces. ACM, 2013.
26. Brain-Computer Interfaces: Revolutionizing Human-Computer Interaction 2010, Springer, Heidelberg, Germany. B. Graimann, B. Allison, G. Pfurtscheller (Eds.).
27. Guger C., Edlinger G., Harkam W., Niedermayer I., Pfurtscheller G. How many people are able to operate an EEG-based brain-computer interface (BCI)?. Neural Syst. Rehabil. Eng. IEEE Trans. 2003, 11(2):145-147.
28. Pfurtscheller G., Neuper C. Motor imagery and direct brain-computer communication. Proc. IEEE 2001, 89(7):1123-1134.
29. Bashashati A., Fatourechi M., Ward R.K., Birch G.E. A survey of signal processing algorithms in brain-computer interfaces based on electrical brain signals. J. Neural Eng. 2007, 4(2):R32.
30. Hwang H.J., Kwon K., Im C.H. Neurofeedback-based motor imagery training for brain-computer interface (BCI). J. Neurosci. Methods 2009, 179.1:150-156.
31. Neuper C., Schlögl A., Pfurtscheller G. Enhancement of left-right sensorimotor EEG differences during feedback-regulated motor imagery. J. Clin. Neurophysiol. 1999, 16(4):373-382.
32. J. Park, K.E. Kim, S. Jo, A POMDP approach to P300-based brain-computer interfaces, in: Proceedings of the International Conference on Intelligent User Interfaces (IUI), (2010) 1-10.
33. Y. Chae, S. Jo, J. Jeong, Brain-actuated humanoid robot navigation control using asynchronous brain-computer interface, in: Proceedings of the International IEEE EMBS Conference on Neural Engineering, (2011) 519-524.
34. Müller-Putz G.R., Scherer R., Brauneis C., Pfurtscheller G. Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components. J. Neural Eng. 2004, 2(4).