A predictive speller controlled by a brain-computer interface based on motor imagery

ACM Transactions on Computer-Human Interaction

Volumn 19, Issue 3, 2012, Pages

  D'Albis, Tiziano ^a   Blatt, Rossella ^a   Tedesco, Roberto ^a   Sbattella, Licia ^a   Matteucci, Matteo ^a  

^a POLITECNICO DI MILANO   (Italy)

Author keywords

BCI; BMI; Brain computer interface; NLP; Speller

Indexed keywords

ASSISTIVE TECHNOLOGY; BCI; BMI; BRAIN RHYTHMS; BRAIN SIGNALS; COMMUNICATION RATE; CONTROL SIGNAL; INFORMATION TRANSFER RATE; INFORMATION TRANSFERS; LOW RATES; MOTOR IMAGERY; MOTOR IMPAIRMENTS; NATURAL LANGUAGE PROCESSING; NLP; SPELLER; TEXT PREDICTION; USER INTERFACE DESIGNS; VERBAL COMMUNICATIONS;

COMMUNICATION; NATURAL LANGUAGE PROCESSING SYSTEMS; USER INTERFACES;

BRAIN COMPUTER INTERFACE;

EID: 84869401066     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/2362364.2362368     Document Type: Article

References (61)

1. BAUER, G., GERSTENBRAND, F., AND RUMPL, E. 1979. Varieties of the locked-in syndrome. J. Neurol. 221, 2, 77-91.
2. BIRBAUMER, N., GHANAYIM, N., HINTERBERGER, T., IVERSEN, I., KOTCHOUBEY, B., KÜBLER, A., PERELMOUTER, J., TAUB, E., AND FLOR, H. 1999. A spelling device for the paralysed. Nature 398, 6725, 297-298.
3. BISHOP, C. 2006. Pattern Recognition and Machine Learning. Springer, New York.
4. BLANKERTZ, B., DORNHEGE, G., KRAULEDAT, M., SCHRÖDER, M., WILLIAMSON, J., MURRAY-SMITH, R., AND MÜLLER, K. 2006. The berlin brain-computer interface presents the novel mental typewriter hex-o-spell. In Proceedings of the 3rd International Brain-Computer Interface Workshop and Training Course. 108-109.
5. BLANKERTZ, B., KRAULEDAT, M., DORNHEGE, G., WILLIAMSON, J., MURRAY-SMITH, R., AND MULLER, K. 2007. A note on brain actuated spelling with the Berlin Brain-Computer Interface. Lecture Notes in Computer Science, vol. 4555, Springer, Berlin, 759.
6. BLANKERTZ, B., TOMIOKA, R., LEMM, S., KAWANABE, M., AND MULLER, K. 2008. Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Proces. Mag., 25, 1, 41-56.
7. BURG, J. 1975. Maximum Entropy Spectral Analysis. Stanford University. http://sep. www.stanford.edu/theses/sep06.
8. COHEN, J. 1960. A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20, 1, 37.
9. CURRAN, E. AND STOKES, M. 2003. Learning to control brain activity: A review of the production and control of EEG components for driving brain-computer interface (bci) systems. Brain Cogn. 51, 3, 326-336.
10. DAL SENO, B., MATTEUCCI, M., AND MAINARDI, L. T. 2010a. Online detection of P300 and error potentials in a bci speller. Comput. Intell. Neurosc. 2010, Article ID 307254.
11. DAL SENO, B., MATTEUCCI, M., AND MAINARDI, L. T. 2010b. The utility metric: A novel method to assess the overall performance of discrete brain-computer interfaces. IEEE Trans. Neural Syst. Rehabil. Eng. 18, 1, 20-28.
12. DONCHIN, E., SPENCER, K., AND WIJESINGHE, R. 2000. The mental prosthesis: Assessing the speed of a P300-based brain-computer interface. IEEE Trans. Rehabil. Eng. 8, 2, 174-179.
13. FARWELL, L. AND DONCHIN, E. 1988. Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysi. 70, 6, 510-523.
14. FUKUNAGA, K. 1990. Introduction to Statistical Pattern Recognition. Academic Press, Waltham, MA.
15. GALE, W. 1995. Good-Turing smoothing without tears. J. Quant. Ling.
16. GOLDBERG, D. 1989. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Boston, MA.
17. GRAIMANN, B., ALLISON, B., AND PFURTSCHELLER, G. 2011. Brain-Computer Interfaces: Revolutionizing Human-Computer Interaction. Springer Verlag, Berlin.
18. HOLLAND, J. 1992. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. The MIT Press, Cambridge, MA.
19. HOPCROFT, J., MOTWANI, R., AND ULLMAN, J. 2007. Introduction to Automata Theory, Languages, and Computation 3rd Ed. Prentice Hall, Upper Saddle River, NJ.
20. JANSEN, B. H., BOURNE, J. R., AND WARD, J. W. 1981. Autoregressive estimation of short segment spectra for computerized EEG analysis. IEEE Tran. Biomed. Eng. BME-28, 9, 630-638.
21. JASPER, H. 1958. The 10/20 international electrode system. EEG Clin. Neurophysio. 10, 371-375.
22. JEANNEROD, M. 1995. Mental imagery in the motor context. Neuropsychologia 33, 11, 1419-1432.
23. JURAFSKY, D. AND MARTIN, J. H. 2000. Speech and Language Processing. Prentice Hall, Upper Saddle River, NJ.
24. KALCHER, J., FLOTZINGER, D., NEUPER, C., GÖLLY, S., AND PFURTSCHELLER, G. 1996. Graz brain-computer interface II: Towards communication between humans and computers based on online classification of three different EEG patterns. Med. Biol. Eng. Comput. 34, 5, 382-388.
25. KATZ, S. 1987. Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Trans. Acous. Speech Signal Proces. 35, 3, 400-401.
26. KOLES, Z. 1991. The quantitative extraction and topographic mapping of the abnormal components in the clinical EEG. Electroencephalogr. Clin. Neurophysi. 79, 6, 440-447.
27. KOZELKA, J. AND PEDLEY, T. 1990. Beta and mu rhythms. J. Clin. Neurophysiol. 7, 2, 191-208.
28. KRUSIENSKI, D., MCFARLAND, D., AND WOLPAW, J. 2006. An evaluation of autoregressive spectral estimation model order for brain-computer interface applications. In Proceedings of the 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS'06). 1323-1326.
29. LEECH, G. 1992. 100 million words of English: The British National Corpus. Lang. Res. 28, 1, 1-13.
30. LEECH, G., RAYSON, P., AND WILSON, A. 2001. Word Frequencies in Written and Spoken English: Based on the British National Corpus. Longman, London.
31. LOTTE, F., CONGEDO, M., LÉCUYER, A., LAMARCHE, F., AND ARNALDI, B. 2007. A review of classification algorithms for EEG-based brain-computer interfaces. J. Neural Eng. 2, R1-R13.
32. MANNING, C. AND SCHÜTZE, H. 1999. Foundations of Statistical Natural Language Processing. The MIT Press, Cambridge, MA.
33. MCFARLAND, D., KRUSIENSKI, D., SARNACKI, W., AND WOLPAW, J. 2008. Emulation of computer mouse control with a noninvasive brain-computer interface. J. Neuraleng. 5, 101.
34. MCFARLAND, D., LEFKOWICZ, A., AND WOLPAW, J. 1997. Design and operation of an EEG-based braincomputer interface with digital signal processing technology. Behav. Res. Methods 29, 3, 337-345.
35. MCFARLAND, D., MCCANE, L., DAVID, S., AND WOLPAW, J. 1997. Spatial filter selection for EEG-based communication. Electroencephalogr. Clin. Neurophysiol. 103, 3, 386-394.
36. MCLACHLAN, G. 2004. Discriminant Analysis and Statistical Pattern Recognition. Wiley-IEEE, Press, Hoboken, NJ.
37. MIGLIORE, D., BLATT, R., MATTEUCCI, M., CERIANI, S., FONTANA, G., AND SENO, B. D. 2008. Brain control of a smart wheelchair. In Proceedings of International Conference on Inteligent Autonomous Systems. 221-228.
38. NEUPER, C., MÜLLER, G., KÜBLER, A., BIRBAUMER, N., AND PFURTSCHELLER, G. 2003. Clinical application of an EEG-based brain-computer interface: A case study in a patient with severe motor impairment. Clin. Neurophysio. 114, 3, 399-409.
39. NEUPER, C., SCHLÖGL, A., AND PFURTSCHELLER, G. 1999. Enhancement of left-right sensorimotor EEG differences during feedback-regulated motor imagery. J. Clin. Neurophysiol. 16, 4, 373.
40. OBERMAIER, B., MULLER, G., AND PFURTSCHELLER, G. 2003. "Virtual keyboard" controlled by spontaneous EEG activity. IEEE Trans. Neural Sys. Rehabil. Eng. 11, 4, 422-426.
41. PARDEY, J., ROBERTS, S., AND TARASSENKO, L. 1996. A review of parametric modelling techniques for EEG analysis. Med. Eng. Physics 18, 1, 2-11.
42. PFURTSCHELLER, G. AND LOPES DA SILVA, F. 1999. Event-related EEG/MEG synchronization and desynchronization: Basic principles. Clin. Neurophysiol. 110, 11, 1842-1857.
43. PFURTSCHELLER, G. AND NEUPER, C. 1997. Motor imagery activates primary sensorimotor area in humans. Neurosci. Lett. 239, 2-3, 65-68.
44. PFURTSCHELLER, G., NEUPER, C., MULLER, G., OBERMAIER, B., KRAUSZ, G., SCHLOGL, A., SCHERER, R., GRAIMANN, B., KEINRATH, C., SKLIRIS, D. WÖRTZ, M., SUPP, G., AND SCHRANK. C. 2003. Graz-BCI: state of the art and clinical applications. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 2, 1-4.
45. PIERCE, J. 1980. An Introduction to Information Theory. Dover Publications, Mineola, NY.
46. PLUM, F. AND POSNER, J. 1966. The Diagnosis of Stupor and Coma. Oxford University Press, New York, NY.
47. POLICH, J. 1997. On the relationship between EEG and P300: Individual differences, aging, and ultradian rhythms. Int. J. Psychophysiol. 26, 1-3, 299-317.
48. PREGENZER, M. AND PFURTSCHELLER, G. 1999. Frequency component selection for an EEG-based brain to computer interface. IEEE Trans. Rehabil. Eng. 7, 4, 413-419.
49. RAMOSER, H., MÜLLER-GERKING, J., AND PFURTSCHELLER, G. 2000. Optimal spatial filtering of single trial EEG during imagined handmovement. IEEE Trans. Rehabil. Eng. 8, 4, 441-446.
50. RYAN, D., FRYE, G., TOWNSEND, G., BERRY, D., MESA-G, S., GATES, N., AND SELLERS, E. 2011. Predictive spelling with a P300-based brain-computer interface: Increasing the rate of communication. Int. J. Hum.-Comput. Interac. 27, 1, 69-84.
51. SCHALK, G., MCFARLAND, D., HINTERBERGER, T., BIRBAUMER, N., AND WOLPAW, J. 2004. BCI2000: A general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 51, 6, 1034-1043.
52. SCHERER, R., MÜLLER, G., NEUPER, C., GRAIMANN, B., AND PFURTSCHELLER, G. 2004. An asynchronously controlled EEG-based virtual keyboard: Improvement of the spelling rate. IEEE Trans. Biomed. Eng. 51, 6, 979-984.
53. SPYERS-ASHBY, J., BAIN, P., AND ROBERTS S. J. 1998. A comparison of fast Fourier transform (FFT) and autoregressive (AR) spectral estimation techniques for the analysis of tremor data. J. Neurosc. Methods 83, 1, 35-43.
54. WANG, C., GUAN, C., AND ZHANG, H. 2005. P300 brain-computer interface design for communication and control applications. In Proceedings of the 27th IEEE-EMBS Annual International Conference of the Engineering in Medicine and Biology Society. 5400-5403.
55. WANG, T., DENG, J., AND HE, B. 2004. Classifying EEG-based motor imagery tasks by means of time-frequency synthesized spatial patterns. Clin. Neurophysiol. 115, 12, 2744-2753.
56. WOLPAW, J., BIRBAUMER, N., MCFARLAND, D., PFURTSCHELLER, G., AND VAUGHAN, T. 2002. Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 6, 767-791.
57. WOLPAW, J. AND MCFARLAND, D. 2004. Control of a two-dimensional movement signal by a noninvasive braincomputer interface in humans. In Proceedings of the National Academy of Sciences of the United States of America 101, 51, 17849.
58. WOLPAW, J., MCFARLAND, D., NEAT, G., AND FORNERIS, C. 1991. An EEG-based brain-computer interface for cursor control. Electroencephalog. Clin. Neurophysiol. 78, 3, 252-259.
59. WOLPAW, J., MCFARLAND, D., AND VAUGHAN, T. 2000. Brain-computer interface research at the Wadsworth Center. IEEE Trans. Rehabil. Eng. 8, 2, 222-226.
60. WONNACOTT, T. AND WONNACOTT, R. 1985. Introductory Statistics. Wiley, New York, NY.
61. YAN, T., JINGTIAN, T., AND ANDONG, G. 2008. Multi-class EEG classification for brain computer interface based on CSP. In Proceedings of the BMEI International Conference on BioMedical Engineering and Informatic. 469-472.