Two brains, one game: Design and evaluation of a multiuser bci video game based on motor imagery

IEEE Transactions on Computational Intelligence and AI in Games

Volumn 5, Issue 2, 2013, Pages 185-198

  Bonnet, Laurent ^a   Lotte, Fabien ^b   Lécuyer, Anatole ^a  

^a INRIA   (France)

^b UNIVERSITÉ BORDEAUX 1   (France)

Author keywords

Brain computer interface (BCI); evaluation; game design; multiplayer games

Indexed keywords

COLLABORATIVE TASKS; DESIGN AND EVALUATIONS; EVALUATION; GAME DESIGN; GAMING EXPERIENCES; MENTAL ACTIVITY; MULTIPLAYER GAMES; SUBJECTIVE EXPERIENCES;

EXPERIMENTS; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER GRAPHICS; MOTIVATION;

BRAIN COMPUTER INTERFACE;

EID: 84879396274     PISSN: 1943068X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCIAIG.2012.2237173     Document Type: Article

References (45)

1. J. Wolpaw, N. Birbaumer, D. McFarland, G. Pfurtscheller, and T. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, no. 6, pp. 767-791, 2002. (Pubitemid 34621187)
2. A. Lécuyer, F. Lotte, R. Reilly, R. Leeb, M. Hirose, and M. Slater, "Brain-computer interfaces, virtual reality and videogames," IEEE Computer, vol. 41, no. 10, pp. 66-72, Oct. 2008.
3. F. Lotte, "Brain-computer interfaces for 3D games: Hype or hope?," presented at the Found. Digit. Games, Bordeaux, France, Jun. 2011.
4. F. Nijboer, N. Birbaumer, and A. Kübler, "The influence of psychological state and motivation on brain-computer interface performance in patients with amyotrophic lateral sclerosis a longitudinal study," Front. Neurosci., vol. 21, no. 4, 2010, DOI: 10.3389/fnins.2010.00055.
5. R. Leeb, F. Lee, C. Keinrath, R. Scherer, H. Bischof, and G. Pfurtscheller, "Brain-computer communication: Motivation, aim, and impact of exploring a virtual apartment," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 15, no. 4, pp. 473-482, Dec. 2007. (Pubitemid 350274168)
6. R. Ron-Angevin and A. Daz-Estrella, "Brain-computer interface: Changes in performance using virtual reality techniques," Neurosci. Lett., vol. 449, no. 2, pp. 123-127, 2009.
7. Emotiv, Apr. 2012 [Online]. Available: http://www.emotiv.com/re- searchers/
8. Neurosky-research, Apr. 2012 [Online]. Available: http://www.neu-rosky. com/Academics/Research.aspx
9. A. Nijholt, D. P.-O. Bos, and B. Reuderink, "Turning shortcomings into challenges: Brain-computer interfaces for games," Entertain. Comput., vol. 1, no. 2, pp. 85-94, 2009.
10. F. Lotte, Y. Renard, and A. Lécuyer, "Self-paced brain-computer interaction with virtual worlds: A quantitative and qualitative study, "out of the lab"," presented at the 4th Int. Brain-Computer Interface Workshop Training Course, Graz, Austria, 2008.
11. D. P.-O. Bos, M. Poel, and A. Nijholt, "A study in user-centered design and evaluation of mental tasks for BCI," in Advances in Multimedia Modeling, ser. Lecture Notes in Computer Science, K.-T. Lee, W.-H. Tsai, H.-Y. Liao, T. Chen, J.-W. Hsieh, and C.-C. Tseng, Eds. Berlin, Germany: Springer-Verlag, 2011, vol. 6524, pp. 122-134.
12. E. Lalor, S. P. Kelly, C. Finucane, R. Burke, R. B. Reilly, and G. McDarby, "Brain-computer interface based on the steady-state VEP for immersive gaming control," Biomedizinsche Tecknik, vol. 49, pp. 63-64, 2004.
13. G. Pfurtscheller and C. Neuper, "Motor imagery and direct brain-computer communication," Proc. IEEE, vol. 89, no. 7, pp. 1123-1134, Jul. 2001. (Pubitemid 33766616)
14. R. Scherer, M. Proll, B. Allison, and G. Müller-Putz, "New input modalities for modern game design and virtual embodiment," in Proc. IEEE Virtual Reality Workshops, Mar. 2012, pp. 163-164.
15. g.Tec Medical Engineering GmbH, "Press release: Intendix-soci: g.tec introduces mind-controlled computer gaming at cebit 2012," Austria, Mar. 2012.
16. L. George and A. Lécuyer, "An overview of research on "passive", brain-computer interfaces for implicit human-computer interaction," presented at the Int. Conf. Appl. Bionics Biomech.Workshop W1, Brain-Computer Interfacing and Virtual Reality, Venise, Italy, 2010.
17. C. Muhl, H. Gürkök, D. P.-O. Bos, M. Thurlings, L. Scherffig, M. Duvinage, A. Elbakyan, S. Kang, M. Poel, and D. Heylen, "Bacteria hunt: A multimodal, multiparadigm BCI game," in Proc. Enterface Workshop, 2009, pp. 41-62.
18. A. Lécuyer, F. Lotte, R. Reilly, R. Leeb, M. Hirose, and M. Slater, "Brain-computer interfaces, virtual reality, and videogames," Computer, vol. 41, no. 10, pp. 66-72, Oct. 2008.
19. D. P.-O. Bos, B. Reuderink, B. van de Laar, H. Gürkök, C. Mühl, M. Poel, A. Nijholt, and D. Heylen, "Brain-computer interfacing and games," in Brain-Computer Interfaces, ser. Human-Computer Interaction, D. Tan and A. Nijholt, Eds. London, U.K.: Springer-Verlag, 2010, pp. 149-178.
20. A. Nijholt, "Towards multimodal, multi-party, and social brain-computer interfacing," in Proc. 4th Int. ICST Conf. Intell. Technol. Interactive Entertain., Genoa, Italy, 2012, pp. 12-17.
21. M. Obbink, H. Gürkök, D. P.-O. Bos, G. Hakvoort, M. Poel, and A. Nijholt, "Social interaction in a cooperative brain-computer interface game," in Proc. 4th Int. ICST Conf. Intell. Technol. Interactive Entertain., Genoa, Italy, 2012, pp. 183-192.
22. B. Blankertz, M. Krauledat, G. Dornhege, J. Williamson, R. Murray-Smith, and K.-R. Mller, "A note on brain actuated spelling with the Berlin braincomputer interface," in Universal Access in Human-Computer Interaction. Ambient Interaction, ser. Lecture Notes in Computer Science, C. Stephanidis, Ed. Berlin, Germany: Springer-Verlag, 2007, vol. 4555, pp. 759-768, DOI: 10.1007/978-3-540-73281-5-83.
23. J. Wolpaw, N. Birbaumer, W. Heetderks, D. McFarland, P. Peckham, G. Schalk, E. Donchin, L. Quatrano, C. Robinson, and T. Vaughan, "Brain-computer interface technology: A review of the first international meeting," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164-173, Jun. 2000. (Pubitemid 30437005)
24. C. Neuper and G. Pfurtscheller, "Neurofeedback training for BCI control," in Brain-Computer Interfaces, ser. The Frontiers Collection, B. Graimann, G. Pfurtscheller, and B. Allison, Eds. Berlin, Germany: Springer-Verlag, 2010, pp. 65-78.
25. A. Barbero and M. Grosse-Wentrup, "Biased feedback in brain-computer interfaces," J. NeuroEng. Rehabil., vol. 7, no. 1, p. 34, 2010.
26. F. Nijboer, A. Furdea, I. Gunst, J. Mellinger, D. J. McFarland, N. Bir-baumer, and A. Kübler, "An auditory brain-computer interface (BCI)," J. Neurosci. Methods, vol. 167, no. 1, pp. 43-50, 2008. (Pubitemid 350186060)
27. S. Kleih, F. Nijboer, S. Halder, and A. Kübler, "Motivation modulates the p300 amplitude during BCI use," Clin. Neurophysiol., vol. 121, pp. 1023-1031, 2010.
28. D. P.-O. Bos, H. Gürkök, B. v. van der, F. Nijboer, and A. Nijholt, "User experience evaluation in BCI: Mind the gap!," Int. J. Bioelec-tromagn., vol. 13, no. 1, pp. 48-49, Jul. 2011.
29. B. van de Laar, H. Gürkök, D. P.-O. Bos, F. Nijboer, and A. Nijholt, "Perspectives on user experience evaluation of brain-computer interfaces," in Universal Access in Human-Computer Interaction. Users Diversity, ser. Lecture Notes in Computer Science, C. Stephanidis, Ed. Berlin, Germany: Springer-Verlag, 2011, vol. 6766, pp. 600-609.
30. A. Lécuyer, "Using eyes, hands, and brain for 3D interaction with virtual environments: A perception-based approach," University of Rennes 1, Rennes, France, Jun. 2010.
31. F. De Vico Fallani, V. Nicosia, R. Sinatra, L. Astolfi, F. Cincotti, D. Mattia, C. Wilke, A. Doud, V. Latora, B. He, and F. Babiloni, "Defecting or not defecting: How to read human behavior during cooperative games by EEG measurements," PLoS ONE, vol. 5, no. 12, 2010, e14187.
32. L. Astolfi, J. Toppi, F. De Vico Fallani, G. Vecchiato, S. Salinari, D. Mattia, F. Cincotti, and F. Babiloni, "Neuroelectrical hyperscanning measures simultaneous brain activity in humans," Brain Topography, vol. 23, pp. 243-256, 2010.
33. Y. Renard, F. Lotte, G. Gibert, M. Congedo, E. Maby, V. Delannoy, O. Bertrand, and A. Lécuyer, "Openvibe: An open-source software platform to design, test and use brain-computer interfaces in real and virtual environments," Presence, Teleoper. Virtual Environ., vol. 19, no. 1, pp. 35-53, 2010.
34. Ogre3d-open source 3d graphics engine, Apr. 2012 [Online]. Available: http://www.ogre3d.org/
35. H. Ramoser, J. Muller-Gerking, and G. Pfurtscheller, "Optimal spatial filtering of single trial EEG during imagined hand movement," IEEE Trans. Rehabil. Eng., vol. 8, no. 4, pp. 441-446, Dec. 2000. (Pubitemid 32178931)
36. F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B. Arnaldi, "A review of classification algorithms for EEG-based brain-computer interfaces," J. Neural Eng., vol. 4, pp. R1-R13, 2007. (Pubitemid 46603810)
37. B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K. Müller, "Optimizing spatial filters for robust EEG single-trial analysis," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 41-56, Jan. 2008.
38. A. Schlogl, F. Lee, H. Bischof, and G. Pfurtscheller, "Characterization of four-class motor imagery eeg data for the BCI-competition 2005," J. Neural Eng., vol. 2, no. 4, p. L14, 2005.
39. K. K. Ang, Z. Y. Chin, C. Wang, C. Guan, and H. Zhang, "Filter bank common spatial pattern algorithm on BCI competition iv datasets 2a and 2b," Front. Neurosci., vol. 6, no. 39, 2012, DOI: 10.3389/fnins. 2012.00039.
40. G. Pfurtscheller, C. Neuper, G. Muller, B. Obermaier, G. Krausz, A. Schlogl, R. Scherer, B. Graimann, C. Keinrath, D. Skliris, M. Wortz, G. Supp, and C. Schrank, "Graz-BCI: State of the art and clinical applications," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 1-4, Jun. 2003.
41. C. Neuper, R. Scherer, M. Reiner, and G. Pfurtscheller, "Imagery of motor actions: Differential effects of kinesthetic and visual motor mode of imagery in single-trial EEG," Cogn. Brain Res., vol. 25, no. 3, pp. 668-677, 2005. (Pubitemid 41774433)
42. A. Kübler, D. Mattia, H. George, B. Doron, and C. Neuper, "How much learning is involved in BCI-control?," presented at the Brain-Computer Interface (BCI) Meeting, 2010, poster.
43. D. A. Harrison, K. H. P. ans Joanne, H. Gavin, and A. T. Florey, "Time, teams, and task performance: Changing effects of surface-and deep-level diversity on group functioning," Acad. Manage. J., vol. 45, no. 5, pp. 1029-1045, 2002.
44. E. Salas, N. Cooke, and M. Rosen, "On teams, teamwork, and team performance: Discoveries and developments," Human Factors, J. Human Factors Ergonom. Soc., vol. 50, no. 3, pp. 540-547, 2008. (Pubitemid 352029816)
45. G. Pfurtscheller and C. Neuper, "Motor imagery and direct brain-computer communication," Proc. IEEE, vol. 89, no. 7, pp. 1123-1134, Jul. 2001. (Pubitemid 33766616)