Steering a tractor by means of an EMG-based human-machine interface

Sensors

Volumn 11, Issue 7, 2011, Pages 7110-7126

  Gomez Gil, Jaime ^a   San Jose Gonzalez, Israel ^a   Nicolas Alonso, Luis Fernando ^a   Alonso Garcia, Sergio ^a  

^a UNIVERSITY OF VALLADOLID   (Spain)

Author keywords

Agricultural vehicles; Brain computer interface (BCI); Control; Electroencephalography (EEG); Global positioning system (GPS); Guidance; Human computer interface (HCI); Human machine interface (HMI); Tractor

Indexed keywords

AGRICULTURE; ARTICLE; COMPUTER INTERFACE; ELECTROMYOGRAPHY; HUMAN; INSTRUMENTATION; MAN MACHINE INTERACTION; MOTOR VEHICLE;

AGRICULTURE; ELECTROMYOGRAPHY; HUMANS; MAN-MACHINE SYSTEMS; MOTOR VEHICLES; USER-COMPUTER INTERFACE;

EID: 79960804315     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s110707110     Document Type: Article

References (96)

1. O'Connor, M.; Bell, T.; Elkaim, G.; Parkinson, B. Automatic steering of farm vehicles using GPS. In Proceedings of the 3rd International Conference on Precision Agriculture, Minneapolis, MN, USA, 23-26 June 1996.
2. Cho, S.I.; Lee, J.H. Autonomous speedsprayer using differential global positioning system, genetic algorithm and fuzzy control. J. Agric. Eng. Res. 2000, 76, 111-119.
3. Stoll, A.; Dieter Kutzbach, H. Guidance of a forage harvester with GPS. Precis. Agric. 2000, 2, 281-291.
4. Thuilot, B.; Cariou, C.; Martinet, P.; Berducat, M. Automatic guidance of a farm tractor relying on a single CP-DGPS. Auton. Robot. 2002, 13, 53-71.
5. Gan-Mor, S.; Clark, R.L.; Upchurch, B.L. Implement lateral position accuracy under RTK-GPS tractor guidance. Comput. Electron. Agric. 2007, 59, 31-38.
6. Gerrish, J.B.; Fehr, B.W.; Ee, G.R.V.; Welch, D.P. Self-steering tractor guided by computer-vision. Appl. Eng. Agric. 1997, 13, 559-563.
7. Cho, S.I.; Ki, N.H. Autonomous speed sprayer guidance using machine vision and fuzzy logic. Trans. ASABE 1999, 42, 1137-1143.
8. Benson, E.R.; Reid, J.F.; Zhang, Q. Machine vision-based guidance system for an agricultural small-grain harvester. Trans. ASABE 2003, 46, 1255-1264.
9. Kise, M.; Zhang, Q.; Rovira Más, F. A stereovision-based crop row detection method for tractor-automated guidance. Biosyst. Eng. 2005, 90, 357-367.
10. Noguchi, N.; Ishii, K.; Terao, H. Development of an agricultural mobile robot using a geomagnetic direction sensor and image sensors. J. Agric. Eng. Res. 1997, 67, 1-15.
11. Zhang, Q.; Reid, J.F.; Noguchi, N. Agricultural vehicle navigation using multiple guidance sensors. In Proceedings of the International Conference of Field and Service Robotics, Pittsburgh, PA, USA, 29-31 August 1999; pp. 293-298.
12. Pilarski, T.; Happold, M.; Pangels, H.; Ollis, M.; Fitzpatrick, K.; Stentz, A. The demeter system for automated harvesting. Auton. Robot. 2002, 13, 9-20.
13. Nagasaka, Y.; Umeda, N.; Kanetai, Y.; Taniwaki, K.; Sasaki, Y. Autonomous guidance for rice transplanting using global positioning and gyroscopes. Comput. Electron. Agric. 2004, 43, 223-234.
14. Murakami, N.; Ito, A.; Will, J.D.; Steffen, M.; Inoue, K.; Kita, K.; Miyaura, S. Development of a teleoperation system for agricultural vehicles. Comput. Electron. Agric. 2008, 63, 81-88.
15. Slaughter, D.C.; Giles, D.K.; Downey, D. Autonomous robotic weed control systems: A review. Comput. Electron. Agric. 2008, 61, 63-78.
16. Santana-Fernández, J.; Gómez-Gil, J.; del-Pozo-San-Cirilo, L. Design and implementation of a GPS guidance system for agricultural tractors using augmented reality technology. Sensors 2010, 10, 10435-10447.
17. Rovira-Más, F. Sensor architecture and task classification for agricultural vehicles and environments. Sensors 2010, 10, 11226-11247.
18. Barea, R.; Boquete, L.; Mazo, M.; López, E. Wheelchair guidance strategies using EOG. J. Intell. Robot. Syst. 2002, 34, 279-299.
19. Wei, L.; Hu, H.; Yuan, K. Use of forehead bio-signals for controlling an intelligent wheelchair. In Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO'08), Bangkok, Tahiland, 21-26 February 2008; pp. 108-113.
20. Neto, A.F.; Celeste, W.C.; Martins, V.R.; Filho, T.F.B.; Filho, M.S. Human-Machine interface based on electro-biological signals for mobile vehicles. In Proceedings of the IEEE International Symposium on Industrial Electronics (ISIE'06), Montreal, QC, Canada, 9-13 July 2006; pp. 2954-2959.
21. Bai, O.; Rathi, V.; Lin, P.; Huang, D.; Battapady, H.; Fei, D.Y.; Schneider, L.; Houdayer, E.; Chen, X.; Hallett, M. Prediction of human voluntary movement before it occurs. Clin. Neurophysiol. 2011, 122, 364-372.
22. Funase, A.; Yagi, T.; Kuno, Y.; Uchikawa, Y. Prediction of eye movements from EEG. In Proceedings of the 6th International Conference on Neural Information Processing (ICONIP'99), Perth, Austria, 16-20 November 1999; pp. 1127-1131.
23. Morash, V.; Bai, O.; Furlani, S.; Lin, P.; Hallett, M. Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries. Clin. Neurophysiol. 2008, 119, 2570-2578.
24. Zhao, C.; Zheng, C.; Zhao, M.; Tu, Y.; Liu, J. Multivariate autoregressive models and kernel learning algorithms for classifying driving mental fatigue based on electroencephalographic. Expert Syst. Appl. 2011, 38, 1859-1865.
25. Jap, B.T.; Lal, S.; Fischer, P.; Bekiaris, E. Using EEG spectral components to assess algorithms for detecting fatigue. Expert Syst. Appl. 2009, 36, 2352-2359.
26. Lin, C.T.; Ko, L.W.; Chung, I.F.; Huang, T.Y.; Chen, Y.C.; Jung, T.P.; Liang, S.F. Adaptive EEG-based alertness estimation system by using ICA-Based fuzzy neural networks. IEEE Trans. Circuits Syst. I-Regul. Pap. 2006, 53, 2469-2476.
27. Lin, C.T.; Chen, Y.C.; Huang, T.Y.; Chiu, T.T.; Ko, L.W.; Liang, S.F.; Hsieh, H.Y.; Hsu, S.H.; Duann, J.R. Development of wireless brain computer interface with embedded multitask scheduling and its application on real-time driver's drowsiness detection and warning. IEEE Trans. Biomed. Eng. 2008, 55, 1582-1591.
28. De Rosario, H.; Solaz, J.S.; Rodri X.; Guez, N.; Bergasa, L.M. Controlled inducement and measurement of drowsiness in a driving simulator. IET Intell. Transp. Syst. 2010, 4, 280-288.
29. Eoh, H.J.; Chung, M.K.; Kim, S.H. Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. Int. J. Ind. Ergon. 2005, 35, 307-320.
30. Lin, C.T.; Ko, L.W.; Chiou, J.C.; Duann, J.R.; Huang, R.S.; Liang, S.F.; Chiu, T.W.; Jung, T.P. Noninvasive neural prostheses using mobile and wireless EEG. Proc. IEEE 2008, 96, 1167-1183.
31. Kandel, E.; Schwartz, J.H.; Jessel, T.M. Principies of Neural Science, 4th ed.; McGraw-Hill: Palatino, CA, USA, 2000.
32. Croft, R.J.; Barry, R.J. Removal of ocular artifact from the EEG: A review. Neurophysiol. Clin.-Clin. Neurophysiol. 2000, 30, 5-19.
33. Jervis, B.; Ifeachor, E.; Allen, E. The removal of ocular artefacts from the electroencephalogram: A review. Med. Biol. Eng. Comput. 1988, 26, 2-12.
34. Fatourechi, M.; Bashashati, A.; Ward, R.K.; Birch, G.E. EMG and EOG artifacts in brain computer interface systems: A survey. Clin. Neurophysiol. 2007, 118, 480-494.
35. Shenoy, P.; Miller, K.J.; Crawford, B.; Rao, R.P.N. Online electromyographic control of a robotic prosthesis. IEEE Trans. Biomed. Eng. 2008, 55, 1128-1135.
36. Foldes, S.T.; Taylor, D.M. Discreet discrete commands for assistive and neuroprosthetic devices. IEEE Trans. Neural Syst. Rehabil. Eng. 2010, 18, 236-244.
37. Soares, A.; Andrade, A.; Lamounier, E.; Carrijo, R. The development of a virtual myoelectric prosthesis controlled by an emg pattern recognition system based on neural networks. J. Intell. Inf. Syst. 2003, 21, 127-141.
38. Oonishi, Y.; Sehoon, O.; Hori, Y. A new control method for power-assisted wheelchair based on the surface myoelectric signal. IEEE Trans. Ind. Electron. 2010, 57, 3191-3196.
39. Wei, L.; Hu, H.; Lu, T.; Yuan, K. Evaluating the performance of a face movement based wheelchair control interface in an indoor environment. In Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO'10), Tianjin, China, 14-18 December 2010; pp. 387-392.
40. Seki, H.; Takatsu, T.; Kamiya, Y.; Hikizu, M.; Maekawa, M. A powered wheelchair controlled by EMG signals from neck muscles. In Human Friendly Mechatronics; Eiji, A., Tatsuo, A., Masaharu, T., Eds.; Elsevier Science: Amsterdam, The Netherlands, 2001; pp. 87-92.
41. Barreto, A.B.; Scargle, S.D.; Adjouadi, M. A practical EMG-based human-computer interface for users with motor disabilities. J. Rehabil. Res. Dev. 2000, 37, 53-64.
42. Tecce, J.J.; Gips, J.; Olivieri, C.P.; Pok, L.J.; Consiglio, M.R. Eye movement control of computer functions. Int. J. Psychophysiol. 1998, 29, 319-325.
43. Williams, M.R.; Kirsch, R.F. Evaluation of head orientation and neck muscle emg signals as command inputs to a human-computer interface for individuals with high tetraplegia. IEEE Trans. Neural Syst. Rehabil. Eng. 2008, 16, 485-496.
44. Chang, G.C.; Kang, W.J.; Luh, J.J.; Cheng, C.K.; Lai, J.S.; Chen, J.J.J.; Kuo, T.S. Real-time implementation of electromyogram pattern recognition as a control command of man-machine interface. Med. Eng. Phys. 1996, 18, 529-537.
45. Artemiadis, P.K.; Kyriakopoulos, K.J. An EMG-based robot control scheme robust to time-varying EMG signal features. IEEE T. Inf. Technol. Biomed. 2010, 14, 582-588.
46. Rovetta, A.; Cosmi, F.; Tosatti, L.M. Teleoperator response in a touch task with different display conditions. IEEE Trans. Syst. Man Cybern. 1995, 25, 878-881.
47. Wheeler, K.R.; Jorgensen, C.C. Gestures as input: Neuroelectric joysticks and keyboards. IEEE Pervasive Comput. 2003, 2, 56-61.
48. Oppenheim, H.; Armiger, R.S.; Vogelstein, R.J. WiiEMG: A real-time environment for control of the Wii with surface electromyography. In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS'10), Paris, France, 30 May-2 June 2010; pp. 957-960.
49. Lyons, G.M.; Sharma, P.; Baker, M.; O'Malley, S.; Shanahan, A. A computer game-based EMG biofeedback system for muscle rehabilitation. In Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'03), Cancun, Mexico, 17-21 September 2003; pp. 1625-1628.
50. Polak, S.; Barniv, Y.; Baram, Y. Head motion anticipation for virtual-environment applications using kinematics and EMG energy. IEEE Trans. Syst. Man Cybern. A-Syst. Hum. 2006, 36, 569-576.
51. Wada, T.; Yoshii, N.; Tsukamoto, K.; Tanaka, S. Development of virtual reality snowboard system for therapeutic exercise. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'04), Sendai, Japan, 28 September-2 October 2004; pp. 2277-2282.
52. Takeuchi, T.; Wada, T.; Mukobaru, M.; Doi, S. A training system for myoelectric prosthetic hand in virtual environment. In Proceedings of the IEEE/ICME International Conference on Complex Medical Engineering (CME'07), Beijing, China, 22-27 May 2007; pp. 1351-1356.
53. Muller-Putz, G.R.; Pfurtscheller, G. Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Trans. Biomed. Eng 2008, 55, 361-364.
54. Horki, P.; Solis-Escalante, T.; Neuper, C; Müller-Putz, G. Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb. Med. Biol. Eng. Comput. 2011, 49, 567-577.
55. Patil, P.; Turner, D. The development of brain-machine interface neuroprosthetic devices. Neurotherapeutics 2008, 5, 137-146.
56. Galán, F.; Nuttin, M.; Lew, E.; Ferrez, P.W.; Vanacker, G; Philips, J.; Millán, J.D.R. A brain-actuated wheelchair: Asynchronous and non-invasive brain-computer interfaces for continuous control of robots. Clin. Neurophysiol. 2008, 119, 2159-2169.
57. Perrin, X.; Chavarriaga, R.; Colas, F.; Siegwart, R.; Millán, J.D.R. Brain-coupled interaction for semi-autonomous navigation of an assistive robot. Robot. Auton. Syst. 2010, 58, 1246-1255.
58. Millan, J.R.; Renkens, F.; Mourino, J.; Gerstner, W. Noninvasive brain-actuated control of a mobile robot by human EEG. IEEE Trans. Biomed. Eng. 2004, 51, 1026-1033.
59. Nijholt, A.; Bos, D.P.O.; Reuderink, B. Turning shortcomings into challenges: Brain-Computer interfaces for games. Entertain. Comput. 2009, 1, 85-94.
60. Scherer, R.; Lee, F.; Schlogl, A.; Leeb, R.; Bischof, H.; Pfurtscheller, G. Toward self-paced brain-computer communication: Navigation through virtual worlds. IEEE Trans. Biomed. Eng. 2008, 55, 675-682.
61. Finke, A.; Lenhardt, A.; Ritter, H. The MindGame: A P300-based brain-computer interface game. Neural Netw. 2009, 22, 1329-1333.
62. Chen, W.D.; Zhang, J.H.; Zhang, J.C.; Li, Y.; Qi, Y.; Su, Y.; Wu, B.; Zhang, S.M.; Dai, J.H.; Zheng, X.X.; Xu, D.R. A P300 based online brain-computer interface system for virtual hand control. J. Zhejiang Univ. Sci. C 2010, 11, 587-597.
63. Bayliss, J.D. Use of the evoked potential P3 component for control in a virtual apartment. IEEE Trans. Neural Syst. Rehabil. Eng. 2003, 11, 113-116.
64. Liu, B.; Wang, Z.; Song, G.; Wu, G. Cognitive processing of traffic signs in immersive virtual reality environment: An ERP study. Neurosci. Lett. 2010, 485, 43-48.
65. Choi, C.; Micera, S.; Carpaneto, J.; Kim, J. Development and quantitative performance evaluation of a noninvasive EMG computer interface. IEEE Trans. Biomed. Eng. 2009, 56, 188-191.
66. Nojd, N.; Hannula, M.; Hyttinen, J. Electrode position optimization for facial EMG measurements for human-computer interface. In Proceedings of the 2nd International Conference on Pervasive Computing Technologies for Healthcare, Tampere, Finland, 29 January-1 February 2008; pp. 319-322.
67. Moon, I.; Lee, M.; Mun, M. A novel EMG-based human-computer interface for persons with disability. In Proceedings of the IEEE International Conference on Mechatronics (ICM'04), Istanbul, Turkey, 3-5 June 2004; pp. 519-524.
68. Bu, N.; Okamoto, M.; Tsuji, T. A hybrid motion classification approach for EMG-based human-robot interfaces using bayesian and neural networks. IEEE Trans. Robot. 2009, 25, 502-511.
69. Xu, Z.; Xiang, C.; Lantz, V.; Ji-Hai, Y.; Kong-Qiao, W. Exploration on the feasibility of building muscle-computer interfaces using neck and shoulder motions. In Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'09), Mineapolis, MN, USA, 2-6 September 2009; pp. 7018-7021.
70. de la Rosa, R.; Alonso, A.; Carrera, A.; Durán, R.; Fernández, P. Man-machine interface system for neuromuscular training and evaluation based on EMG and MMG signals. Sensors 2010, 10, 11100-11125.
71. Eckhouse, R.H.; Maulucci, R.A. A multimedia system for augmented sensory assessment and treatment of motor disabilities. Telemat. Inform. 1997, 14, 67-82.
72. Jain, A.K.; Duin, R.P.W.; Jianchang, M. Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 4-37.
73. Zhu, X.; Wu, J.; Cheng, Y.; Wang, Y. A unified framework to exploit information in BCI data for continuous prediction. Neurocomputing 2008, 71, 1022-1031.
74. Felzer, T.; Freisieben, B. Analyzing EEG signals using the probability estimating guarded neural classifier. IEEE Trans. Neural Syst. Rehabil. Eng. 2003, 11, 361-371.
75. Farquhar, J. A linear feature space for simultaneous learning of spatio-spectral filters in BCI. Neural Netw. 2009, 22, 1278-1285.
76. Burke, D.P.; Kelly, S.P.; de Chazal, P.; Reilly, R.B.; Finucane, C. A parametric feature extraction and classification strategy for brain-computer interfacing. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 12-17.
77. Lipták, B.G. Process Control and Optimization; CRC Press: Boca Raton, FL, USA, 2006.
78. Ogata, K. Modern Control Engineering, 4th ed.; Prentice Hall: Englewood Cliffs, NJ, USA, 2001.
79. Reznik, L. Fuzzy Controllers; Newnes: Melbourne, Australia, 1997.
80. Emotiv-Brain Computer Interface Technology. Available online: http://www.emotiv.com (accesed on 14 June 2011).
81. Carrera-González, A.; Alonso-García, S.; Gómez-Gil, J. Design, development and implemementation of a steering controller box for an automatic agricultural tractor guidance system, using fuzzy logic. In Technological Developments in Education and Automation; Iskander, M., Kapila, V., Karim, M.A., Eds.; Springer: New York, NY, USA, 2010; pp. 153-158.
82. Ranky, G.N.; Adamovich, S. Analysis of a commercial EEG device for the control of a robot arm. In Proceedings of the 36th Annual Northeast Bioengineering Conference (NEBEC'10), New York, NY, USA, 27-28 March 2010; pp. 1-2.
83. Rosas-Cholula, G; Rami X; Rez-Cortes, J.M.; Alarcon-Aquino, V.; Martinez-Carballido, J.; Gomez-Gil, P. On signal P-300 detection for BCI applications based on wavelet analysis and ICA preprocessing. In Proceedings of the IEEE Electronics, Robotics and Automotive Mechanics Conference (CERMA'10), Cuernavaca, Mexico, 25-28 September 2010; pp. 360-365.
84. Esfahani, E.T.; Sundararajan, V. Classification of primitive shapes using brain-computer interfaces. Comput. -Aided Des. 2011, in press.
85. Paulson, L.D. A new Wi-Fi for peer-to-peer communications. Computer 2008, 41, 19-21.
86. Zintel, E. Tools and products. IEEE Comput. Graph. Appl. 2008, 28, 103-104.
87. Stamps, K.; Hamam, Y. Towards inexpensive BCI control for wheelchair navigation in the enabled environment-A hardware survey. In Brain Informatics; Yao, Y., Sun, R., Poggio, T., Liu, J., Zhong, N., Huang, J., Eds.; Springer: Heidelberg, Germany, 2010; pp. 336-345.
88. Jackson, M.M.; Mappus, R. Applications for brain-computer interfaces. In Brain-Computer Interfaces; Tan, D.S., Nijholt, A., Eds.; Springer: London, UK, 2010; pp. 89-103.
89. Allison, B.Z. Toward ubiquitous BCIs. In Brain-Computer Interfaces; Graimann, B., Pfurtscheller, G, Allison, B., Eds.; Springer: Heidelberg, Germany, 2010; pp. 357-387.
90. Wolpaw, J.R.; Birbaumer, N.; McFarland, D.J.; Pfurtscheller, G; Vaughan, T.M. Brain-computer interfaces for communication and control. Clin. Neurophysiol. 2002, 113, 767-791.
91. Maggi, L.; Parini, S.; Piccini, L.; Panfili, G; Andreoni, G A four command BCI system based on the SSVEP protocol. In Proceedings of the 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS'06), New York, NY, USA, 30 August-3 September 2006; pp. 1264-1267.
92. Blankertz, B.; Dornhege, G; Krauledat, M.; Muller, K.R.; Kunzmann, V.; Losch, F.; Curio, G. The Berlin brain-computer interface: EEG-based communication without subject training. IEEE Trans. Neural Syst. Rehabil. Eng 2006, 14, 147-152.
93. Gao, X.; Xu, D.; Cheng, M.; Gao, S. A BCI-based environmental controller for the motion-disabled. IEEE Trans. Neural Syst. Rehabil. Eng. 2003, 11, 137-140.
94. Wang, Y.; Wang, Y.T.; Jung, T.P. Visual stimulus design for high-rate SSVEP BCI. Electron. Lett. 2010, 46, 1057-1058.
95. Krausz, G; Scherer, R.; Korisek, G; Pfurtscheller, G. Critical decision-speed and information transfer in the -Graz Brain-Computer Interface. Appl. Psychophysiol. Biofeedback 2003, 28, 233-240.
96. Rebsamen, B.; Cuntai, G.; Zhang, H.; Wang, C.; Teo, C.; Ang, M.H.; Burdet, E. A brain controlled wheelchair to navigate in familiar environments. IEEE Trans. Neural Syst. Rehabil. Eng. 2010, 18, 590-598.