Brain-computer interfaces for multimodal interaction: A survey and principles

International Journal of Human-Computer Interaction

Volumn 28, Issue 5, 2012, Pages 292-307

  Gürkök, Hayrettin ^a   Nijholt, Anton ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84859643066     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2011.582022     Document Type: Article

References (108)

1. Allison, B. Z. and Polich, J. 2008. Workload assessment of computer gaming using a single-stimulus event-related potential paradigm. Biological Psychology, 77: 277-283.
2. Aslam, J. A. and Montague, M. 2001. "Models for metasearch". In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, 276-284. New York, NY: ACM.
3. Barea, R., Boquete, L., Mazo, M. and Lopez, E. 2002. System for assisted mobility using eye movements based on electrooculography. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 10: 209-218.
4. Bauer, G., Gerstenbrand, F. and Rumpl, E. 1979. Varieties of the locked-in syndrome. Journal of Neurology, 221(2): 77-91.
5. Belitski, A., Farquhar, J. and Desain, P. 2011. P300 audio-visual speller (Article 025022). Journal of Neural Engineering, 8(2)
6. Berger, H. 1929. Über das elektrenkephalogramm des menschen. Archiv für Psychiatrie und Nervenkrankheiten, 87(1): 527-570.
7. Betke, M. 1998. Camera-based interfaces and assistive software for people with severe motion impairments (Tech. Rep. BU-CS-2008-025), Boston, MA: Department of Computer Science, Boston University.
8. Bieger, J. and Molina, G. G. 2010. Light stimulation properties to influence brain activity: A brain-computer interface application (Tech. Rep. TN-2010-00315), Eindhoven, the Netherlands: Philips Research.
9. Brouwer, A.-M., van Erp, J. B. F., Aloise, F. and Cincotti, F. 2010. Tactile, visual and bimodal P300s: Could bimodal P300s boost BCI performance?. SRX Neuroscience, 2010: 967027
10. Campbell, A. T., Choudhury, T., Hu, S., Lu, H., Mukerjee, M. K., Rabbi, M. and Raizada, R. D. 2010. "NeuroPhone: Brain-mobile phone interface using a wireless EEG headset". In MobiHeld'10: Proceedings of the second ACM SIGCOMM workshop on networking, systems, and applications on mobile handhelds, 3-8. New York, NY: ACM.
11. Cassell, J., Sullivan, J., Prevost, S. and Churchill, E. 2000. Embodied conversational agents, Cambridge, MA: MIT Press.
12. Chanel, G., Kierkels, J. J., Soleymani, M. and Pun, T. 2009. Short-term emotion assessment in a recall paradigm. International Journal of Human-Computer Studies, 67: 607-627.
13. Chanel, G., Kronegg, J., Grandjean, D. and Pun, T. 2006. "Emotion assessment: Arousal evaluation using EEG's and peripheral physiological signals". In Multimedia content representation, classification and security, Edited by: Gunsel, B., Jain, A. K., Tekalp, A. M. and Sankur, B. 530-537. Berlin, Germany: Springer-Verlag.
14. Cincotti, F., Kauhanen, L., Aloise, F., Palomäki, T., Caporusso, N., Jylänki, P.,., del, R and Millán, J. 2004. Vibrotactile feedback for brain-computer interface operation. Computational Intelligence and Neuroscience, 2007: 048937
15. Cooper, R. J., Everdell, N. L., Enfield, L. C., Gibson, A. P., Worley, A. and Hebden, J. C. 2009. Design and evaluation of a probe for simultaneous EEG and near-infrared imaging of cortical activation. Physics in Medicine and Biology, 54: 2093-2102.
16. Daunizeau, J., Laufs, H. and Friston, K. J. 2010. "EEG-fMRI information fusion: Biophysics and data analysis". In EEG-fMRI: Physiological basis, technique, and applications, Edited by: Mulert, C. and Lemieux, L. 511-526. Berlin, Germany: Springer-Verlag.
17. Deuschl, G. and Eisen, A. 1999. Recommendations for the practice of clinical neurophysiology, 2nd, Amsterdam, the Netherlands: Elsevier.
18. Dumas, B., Lalanne, D. and Oviatt, S. 2009. "Multimodal interfaces: A survey of principles, models and frameworks". In Human machine interaction: Research results of the MMI program, Edited by: Lalanne, D. and Kohlas, J. 3-26. Berlin, Germany: Springer-Verlag.
19. Edlinger, G., Holzner, C., Groenegress, C., Guger, C. and Slater, M. 2009. "Goal-oriented control with brain-computer interface". In Foundations of augmented cognition. Neuroergonomics and operational neuroscience, Edited by: Schmorrow, D., Estabrooke, I. and Grootjen, M. 732-740. Berlin, Germany: Springer-Verlag.
20. Fabiani, M., Gratton, G. and Federmeier, K. D. 2007. "Event-related brain potentials: Methods, theory, and applications". In Handbook of psychophysiology, 3rd, Edited by: Cacioppo, J. T., Tassinary, L. G. and Berntson, G. G. 85-119. Cambridge, UK: Cambridge University Press.
21. Farwell, L. A. and Donchin, E. 1988. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology, 70: 510-523.
22. Fatourechi, M., Bashashati, A., Ward, R. K. and Birch, G. E. 2007. EMG and EOG artifacts in brain computer interface systems: A survey. Clinical Neurophysiology, 118: 480-494.
23. Fatourechi, M., Birch, G. E. and Ward, R. K. 2007. A self-paced brain interface system that uses movement related potentials and changes in the power of brain rhythms. Journal of Computational Neuroscience, 23(1): 21-37.
24. Ferrez, P. W. and del R. Millán, J. 2005. "You are wrong!: Automatic detection of interaction errors from brain waves". In IJCAI'05: Proceedings of the 19th International Joint Conference on Artificial intelligence, 1413-1418. San Francisco, CA: Morgan Kaufmann.
25. Ferrez, P. W. and del R. Millán, J. 2007. "Error-related EEG potentials in brain-computer interfaces". In Toward brain-computer interfacing, Edited by: Dornhege, G., del, J., Millán, R., Hinterberger, T., McFarland, D. J. and üller, K.-R. M. 291-301. Cambridge, MA: MIT Press.
26. Fink, A., Grabner, R. H., Benedek, M., Reishofer, G., Hauswirth, V., Fally, M.,. and Neubauer, A. C. 2009. The creative brain: Investigation of brain activity during creative problem solving by means of EEG and fMRI. Human Brain Mapping, 30: 734-748.
27. Förster, K., Biasiucci, A., Chavarriaga, R., del, R., Millán, J., Roggen, D. and Tröster, G. 2010. "On the use of brain decoded signals for online user adaptive gesture recognition systems". In Pervasive computing, Edited by: Floréen, P., Krüger, A. and Spasojevic, M. 427-444. Berlin, Germany: Springer.
28. Friston, K. J. 2009. Modalities, modes, and models in functional neuroimaging. Science, 326(5951): 399-403.
29. Furdea, A., Halder, S., Krusienski, D., Bross, D., Nijboer, F., Birbaumer, N. and Kübler, A. 2009. An auditory oddball (P300) spelling system for brain-computer interfaces. Psychophysiology, 46: 617-625.
30. Gevensleben, H., Holl, B., Albrecht, B., Vogel, C., Schlamp, D., Kratz, O.,. and Heinrich, H. 2009. Is neurofeedback an efficacious treatment for ADHD? A randomised controlled clinical trial. Journal of Child Psychology and Psychiatry, 50: 780-789.
31. Gloor, P. 1969. Hans Berger on the electroencephalogram of man. The fourteen original reports on the human encephalogram, Amsterdam, the Netherlands: Elsevier.
32. Groenegress, C., Holzner, C., Guger, C. and Slater, M. 2010. Effects of P300 based BCI use on reported presence in a virtual environment. Presence: Teleoperators and Virtual Environments, 19(1): 1-11.
33. Guger, C., Harkam, W., Hertnaes, C. and Pfurtscheller, G. 1999. "Prosthetic control by an EEG-based brain-computer interface (BCI)". In Proceedings of the 5th European Conference for Advancement of Assistive Technology (AAATE'99) Amsterdam, the Netherlands: IOS Press
34. Gunes, H., Piccardi, M. and Pantic, M. 2008. "From the lab to the real world: Affect recognition using multiple cues and modalities". In Affective computing: Focus on emotion expression, synthesis, and recognition, Edited by: Or, J. 185-218. Vienna, Austria: InTech Education and Publishing.
35. Gürkök, H., Poel, M. and Zwiers, J. 2010. "Classifying motor imagery in presence of speech". In IJCNN'10: Proceedings of the International Joint Conference on Neural Networks, 1235-1242. Piscataway, NJ: IEEE.
36. Halchenko, Y. O., Hanson, S. J. and Pearlmutter, B. A. 2005. "Multimodal integration: FMRI, MRI, EEG, MEG". In Advanced image processing in magnetic resonance imaging, Edited by: Landini, L., Positano, V. and Santarelli, M. 223-265. Boca Raton, FL: CRC Press.
37. Hassenzahl, M. 2004. "The thing and I: Understanding the relationship between user and product". In Funology: From usability to enjoyment, Edited by: Blythe, M. A., Overbeeke, K., Monk, A. F. and Wright, P. C. 31-42. Dordrecht, the Netherlands: Kluwer Academic.
38. Hauptmann, A. G. and McAvinney, P. 1993. Gestures with speech for graphic manipulation. International Journal of Man-Machine Studies, 38: 231-249.
39. Herdman, A. T., Lins, O., van Roon, P., Stapells, D. R., Scherg, M. and Picton, T. W. 2002. Intracerebral sources of human auditory steady-state responses. Brain Topography, 15(2): 69-86.
40. Hinterberger, T., Neumann, N., Pham, M., Kübler, A., Grether, A., Hofmayer, N.,. and Birbaumer, N. 2004. A multimodal brain-based feedback and communication system. Experimental Brain Research, 154: 521-526.
41. Holm, A., Lukander, K., Korpela, J., Sallinen, M. and Müller, K. M. I. 2009. Estimating brain load from the EEG. Scientific World Journal, 9: 639-651.
42. ISO 9241-210:2010. 2010. Ergonomics of human-system interaction -- Part 210: Human-centred design for interactive systems, Geneva, Switzerland: ISO.
43. Jackson, M. M. and Mappus, R. 2010. "Applications for brain-computer interfaces". In Brain-computer interfaces: Applying our minds to human-computer interaction, Edited by: Nijholt, A. and Tan, D. 89-103. London, UK: Springer-Verlag London.
44. Jaimes, A. and Sebe, N. 2007. Multimodal human-computer interaction: A survey. Computer Vision and Image Understanding, 108: 116-134.
45. Johnston, S., Boehm, S., Healy, D., Goebel, R. and Linden, D. 2010. Neurofeedback: A promising tool for the self-regulation of emotion networks. NeuroImage, 49(1): 1066-1072.
46. Klein, J., Moon, Y. and Picard, R. W. 2002. This computer responds to user frustration: Theory, design, and results. Interacting with Computers, 14: 119-140.
47. Kohlmorgen, J., Dornhege, G., Braun, M., Blankertz, B., Müller, K.-R., Curio, G.,. and Kincses, W. 2007. "Improving human performance in a real operating environment through real-time mental workload detection". In Toward brain-computer interfacing, Edited by: Dornhege, G., del, J., Millán, R., Hinterberger, T., McFarland, D. J. and üller, K.-R. M. 409-422. Cambridge, MA: MIT Press.
48. Kramer, A. F. and Weber, T. 2000. "Applications of psychophysiology to human factors". In Handbook of psychophysiology, 2nd, Edited by: Cacioppo, J. T., Tassinary, L. G. and Berntson, G. G. 794-814. New York, NY: Cambridge University Press.
49. Kreilinger, A., Kaiser, V., Breitwieser, C., Neuper, C. and Müller-Putz, G. R. 2011. Fusion of manual control and BCI using long term and short term quality measures. International Journal of Bioelectromagnetism, 13: 110-111.
50. Krepki, R., Blankertz, B., Curio, G. and Müller, K.-R. 2007. The Berlin brain-computer interface (BBCI)-Towards a new communication channel for online control in gaming applications. Multimedia Tools and Applications, 33(1): 73-90.
51. Kübler, A. and Birbaumer, N. 2008. Brain-computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients?. Clinical Neurophysiology, 119: 2658-2666.
52. Kübler, A. and Müller, K.-R. 2007. "An introduction to brain-computer interfacing". In Toward brain-computer interfacing, Edited by: Dornhege, G., del, J., Millán, R., Hinterberger, T., McFarland, D. J. and üller, K.-R. M. 1-25. Cambridge, MA: MIT Press.
53. Kübler, A., Nijboer, F. and Birbaumer, N. 2007. "Brain-computer interfaces for communication and motor control - perspectives on clinical applications". In Toward brain-computer interfacing, Edited by: Dornhege, G., del, J., Millán, R., Hinterberger, T., McFarland, D. J. and üller, K.-R. M. 373-391. Cambridge, MA: MIT Press.
54. Lalor, E. C., Kelly, S. P., Finucane, C., Burke, R., Smith, R., Reilly, R. B. and McDarby, G. 2005. Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment. EURASIP Journal on Applied Signal Processing, 2005(19): 3156-3164.
55. Larson, J. A., Raman, T., & Raggett, D. (2003). W3C multimodal interaction framework (Tech. Rep.). http://www.w3.org/TR/mmi-frameworkW3C
56. Law, E. L.-C., Roto, V., Hassenzahl, M., Vermeeren, A. P. and Kort, J. 2009. "Understanding, scoping and defining user experience: a survey approach". In CHI'09: Proceedings of the 27th international conference on Human factors in computing systems, 719-728. New York, NY: ACM.
57. Lebedev, M. A. and Nicolelis, M. A. 2006. Brain-machine interfaces: past, present and future. Trends in Neurosciences, 29: 536-546.
58. Leeb, R., Friedman, D., Müller-Putz, G. R., Scherer, R., Slater, M. and Pfurtscheller, G. 2007. Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic. Computational Intelligence and Neuroscience, 2007: 1-12.
59. Leeb, R., Sagha, H., Chavarriaga, R., del, R. and Millán, J. 2011. A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities (Article 025011). Journal of Neural Engineering, 8(2)
60. Li, Y., Nam, C. S., Shadden, B. B. and Johnson, S. L. 2011. A P300-based brain-computer interface: Effects of interface type and screen size. International Journal of Human-Computer Interaction, 27(1): 52-68.
61. Lin, C.-T., Chen, Y.-C., Huang, T.-Y., Chiu, T.-T., Ko, L.-W., Liang, S.-F.,. and Duann, J.-R. 2008. Development of wireless brain-computer interface with embedded multitask scheduling and its application on real-time driver's drowsiness detection and warning. IEEE Transactions on Biomedical Engineering, 55: 1582-1591.
62. Lotte, F., Fujisawa, J., Touyama, H., Ito, R., Hirose, M. and Lécuyer, A. 2009. "Towards ambulatory brain-computer interfaces: a pilot study with P300 signals". In ACE'09: Proceedings of the International Conference on Advances in Computer Entertainment Technology, 336-339. New York, NY: ACM.
63. Luck, S. J. 2005. An introduction to event-related potentials and their neural origins, Cambridge, MA: MIT Press.
64. Mandryk, R. L., Inkpen, K. M. and Calvert, T. W. 2006. Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour and Information Technology, 25: 141-158.
65. Martinez, P., Bakardjian, H. and Cichocki, A. 2007. Fully online multicommand brain-computer interface with visual neurofeedback using SSVEP paradigm. Computational Intelligence and Neuroscience, 2007: 13-13.
66. Merzagora, A. C., Izzetoglu, M., Polikar, R., Weisser, V., Onaral, B. and Schultheis, M. T. 2009. "Functional near-infrared spectroscopy and electroencephalography: A multimodal imaging approach". In Foundations of augmented cognition: Neuroergonomics and operational neuroscience, Edited by: Goebel, R., Siekmann, J. and Wahlster, W. 417-426. Berlin, Germany: Springer-Verlag.
67. Mills, K. M. and Alty, J. L. 1998. "Investigating the role of redundancy in multimodal input systems". In Gesture and sign language in human-computer interaction, Edited by: Wachsmuth, I. and Fröhlich, M. 159171Berlin, Germany: Springer-Verlag.
68. Mühl, C., Gürkök, H., Plass-Oude Bos, D., Thurlings, M. E., Scherffig, L., Duvinage, M.,. and Heylen, D. 2010. Bacteria hunt: Evaluating multi-paradigm BCI interaction. Journal on Multimodal User Interfaces, 4(1): 11-25.
69. Muller-Putz, G., Scherer, R., Neuper, C. and Pfurtscheller, G. 2006. Steady state somatosensory evoked potentials: suitable brain signals for braincomputer interfaces?. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 14(1): 30-37.
70. Murphy, R. R. 1996. Biological and cognitive foundations of intelligent sensor fusion. IEEE Transactions on Systems, Man, and Cybernetics, 26(1): 42-51.
71. Nacke, L., Drachen, A. and Goebel, S. 2010. Methods for evaluating gameplay experience in a serious gaming context. International Journal of Computer Science in Sport, 9(2)
72. Nam, C. S., Li, Y. and Johnson, S. 2010. Evaluation of P300-based brain-computer interface in real-world contexts. International Journal of Human-Computer Interaction, 26: 621-637.
73. Nikolaev, A. R. and Anokhin, A. P. 1998. EEG frequency ranges during perception and mental rotation of two-and three-dimensional objects. Neuroscience and Behavioral Physiology, 28: 670-677.
74. Nuray, R. and Can, F. 2006. Automatic ranking of information retrieval systems using data fusion. Information Processing and Management, 42: 595-614.
75. Oken, B., Salinsky, M. and Elsas, S. 2006. Vigilance, alertness, or sustained attention: physiological basis and measurement. Clinical Neurophysiology, 117: 1885-1901.
76. Oviatt, S. 1999. Ten myths of multimodal interaction. Communications of the ACM, 42(11): 74-81.
77. Oviatt, S. 2008. "Multimodal interfaces". In The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, 2nd, Edited by: Jacko, J. A. and Sears, A. 413-428. New York, NY: Erlbaum.
78. Oviatt, S., Cohen, P., Wu, L., Duncan, L., Suhm, B., Bers, J.,. and Ferro, D. 2000. Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions. Human-Computer Interaction, 15: 263-322.
79. Parra, L., Christoforou, C., Gerson, A., Dyrholm, M., Luo, A., Wagner, M.,. and Sajda, P. 2008. Spatiotemporal linear decoding of brain state. IEEE Signal Processing Magazine, 25(1): 107-115.
80. Pfurtscheller, G., Allison, B. Z., Brunner, C., Bauernfeind, G., Solis Escalante, T., Scherer, R.,. and Birbaumer, N. 2010. The hybrid BCI. Frontiers in Neuroprosthetics, 4: 30
81. Pfurtscheller, G., Brunner, C., Schlögl, A. and Lopes da Silva, F. H. 2006. Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage, 31(1): 153-159.
82. Pfurtscheller, G. and Lopes da Silva, F. H. 1999. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology, 110: 1842-1857.
83. Plass-Oude Bos, D., Reuderink, B., van de Laar, B., Gürkök, H., Mühl, C., Poel, M.,. and Heylen, D. 2010. "Brain-computer interfacing and games". In Brain-computer interfaces: Applying our minds to human-computer interaction, Edited by: Nijholt, A. and Tan, D. 149-178. London, UK: Springer-Verlag London.
84. Qian, M., Aguilar, M., Zachery, K., Privitera, C., Klein, S., Carney, T. and Nolte, L. 2009. Decision-level fusion of EEG and pupil features for single-trial visual detection analysis. IEEE Transactions on Biomedical Engineering, 56: 1929-1937.
85. Regan, D. 1977. Steady-state evoked potentials. Journal of the Optical Society of America, 67: 1475-1489.
86. Salvaris, M. and Sepulveda, F. 2009. Visual modifications on the P300 speller BCI paradigm (Article 046011). Journal of Neural Engineering, 6(4)
87. Savran, A., Ciftci, K., Chanel, G., Mota, J. C., Viet, L. H., Sankur, B.,. and Rombaut, M. 2006. "Emotion detection in the loop from brain signals and facial images". In Proceedings of the 2nd International Summer Workshop on Multimodal Interfaces, 69-80. Zagreb, Croatia: Faculty of Electrical Engineering and Computing, University of Zagreb.
88. Schalk, G., Wolpaw, J. R., McFarland, D. J. and Pfurtscheller, G. 2000. EEG-based communication: presence of an error potential. Clinical Neurophysiology, 111: 2138-2144.
89. Scherer, R., Schloegl, A., Lee, F., Bischof, H., Janša, J. and Pfurtscheller, G. 2007. The self-paced Graz brain-computer interface: Methods and applications (Article 79826). Computational Intelligence and Neuroscience, 2007
90. Schnakers, C., Perrin, F., Schabus, M., Hustinx, R., Majerus, S., Moonen, G.,. and Laureys, S. 2009. Detecting consciousness in a total locked-in syndrome: An active eventrelated paradigm. Neurocase, 15: 271-277.
91. Sellers, E. W. and Donchin, E. 2006. A P300-based brain-computer interface: Initial tests by ALS patients. Clinical Neurophysiology, 117: 538-548.
92. Serby, H., Yom-Tov, E. and Inbar, G. 2005. An improved P300-based brain-computer interface. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 13(1): 89-98.
93. Sharma, R., Pavlovic, V. and Huang, T. 1998. Toward multimodal human-computer interface. Proceedings of the IEEE, 86: 853-869.
94. Shibasaki, H. and Hallett, M. 2006. What is the Bereitschaftspotential?. Clinical Neurophysiology, 117: 2341-2356.
95. Solovey, E. T., Girouard, A., Chauncey, K., Hirshfield, L. M., Sassaroli, A., Zheng, F.,. and Jacob, R. J. 2009. "Using fNIRS brain sensing in realistic HCI settings: Experiments and guidelines". In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, 157-166. New York, NY: ACM.
96. Stanford, T. R. and Stein, B. E. 2007. Superadditivity in multisensory integration: Putting the computation in context (Article 787792). NeuroReport, 18(8)
97. Tangermann, M., Krauledat, M., Grzeska, K., Sagebaum, M., Blankertz, B., Vidaurre, C. and Müller, K.-R. 2008. "Playing pinball with non-invasive BCI". In Advances in neural information processing systems 21, 1641-1648. Cambridge, MA: MIT Press.
98. Tolba, A. S., El-Baz, A. H. and El-Harby, A. A. 2006. Face recognition: A literature review. International Journal of Signal Processing, 2: 88-103.
99. Turk, M. and Robertson, G. 2000. Perceptual user interfaces [Introduction]. Communications of the ACM, 43(3): 32-34.
100. van Gerven, M., Farquhar, J., Schaefer, R., Vlek, R., Geuze, J., Nijholt, A.,. and Desain, P. 2009. The brain-computer interface cycle (Article 041001). Journal of Neural Engineering, 6
101. van de Laar, B., Reuderink, B., Plass-Oude Bos, D. and Heylen, D. 2010. Evaluating user experience of actual and imagined movement in BCI gaming. International Journal of Gaming and Computer-Mediated Simulations, 2(4): 33-47.
102. Wang, Y.-T., Wang, Y. and Jung, T.-P. 2011. A cell-phone-based brain-computer interface for communication in daily life (Article 025018). Journal of Neural Engineering, 8(2)
103. Wechsung, I. and Naumann, A. 2009. "Evaluating a multimodal remote control: The interplay between user experience and usability". In 2009 International Workshop on Quality of Multimedia Experience, 19-22. Piscataway, NJ: IEEE.
104. Wolpaw, J., McFarland, D., Vaughan, T. and Schalk, G. 2003. The Wadsworth Center brain-computer interface (BCI) research and development program. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11(2): 1-4.
105. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G. and Vaughan, T. M. 2002. Brain-computer interfaces for communication and control. Clinical Neurophysiology, 113: 767-791.
106. Zander, T. O., Gaertner, M., Kothe, C. and Vilimek, R. 2011. Combining eye gaze input with a brain-computer interface for touchless human-computer interaction. International Journal of Human-Computer Interaction, 27(1): 38-51.
107. Zander, T. O., Kothe, C., Welke, S. and Roetting, M. 2009. "Utilizing secondary input from passive brain-computer interfaces for enhancing human-machine interaction". In Foundations of augmented cognition: Neuroergonomics and operational neuroscience, Edited by: Goebel, R., Siekmann, J. and Wahlster, W. 759-771. Berlin, Germany: Springer-Verlag.
108. Zeng, Z., Pantic, M. and Huang, T. S. 2009. "Emotion recognition based on multimodal information". In Affective information processing, Edited by: Tao, J. and Tan, T. 241-265. London, UK: Springer-Verlag.