Electroencephalogram and physiological signal analysis for assessing flow in games

IEEE Transactions on Computational Intelligence and AI in Games

Volumn 5, Issue 2, 2013, Pages 164-175

  Berta, Riccardo ^a   Bellotti, Francesco ^a   De Gloria, Alessandro ^a   Pranantha, Danu ^a   Schatten, Carlotta ^a,b  

^a UNIVERSITY OF GENOA   (Italy)

^b UNIVERSITY OF HILDESHEIM   (Germany)

Author keywords

Electroencephalogram (EEG); games; passive brain computer interface (BCI); user adaptivity; user tracking

Indexed keywords

ADAPTIVITY AND PERSONALIZATION; ELECTRO-ENCEPHALOGRAM (EEG); GAMES; PERIPHERAL NERVOUS SYSTEM; PHYSIOLOGICAL SIGNALS; SPECTRAL CHARACTERIZATION; USER TRACKING; USER-ADAPTIVITY;

ELECTROENCEPHALOGRAPHY; FREQUENCY BANDS; SPECTRUM ANALYZERS; SUPPORT VECTOR MACHINES;

BRAIN COMPUTER INTERFACE;

EID: 84879357199     PISSN: 1943068X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCIAIG.2013.2260340     Document Type: Article

References (67)

1. A. Nijholt and D. Tan, "Brain-computer interfacing for intelligent systems," IEEE Intell. Syst., vol. 23, no. 3, pp. 72-79, May-Jun. 2008. (Pubitemid 351751949)
2. J. B. F. van Erp, F. Lotte, and M. Tangermann, "Brain-computer interfaces: Beyond medical applications," IEEE Computer, vol. 45, no. 4, pp. 26-34, Apr. 2012.
3. F. Lotte, "Brain-computer interfaces for 3D games: Hype or hope?," in Proc. Int. Conf. Found. Digital Games, 2011, pp. 325-327.
4. D. Coyle, J. Garcia, A. Satti, and T. M. McGinnity, "EEG-based continuous control of a game using a 3 channel motor imagery BCI," in Proc. IEEE Symp. Comput. Intell. Cogn. Algorithms Mind Brain, Apr. 2011, DOI: 10.1109/CCMB.2011.5952128.
5. G. Pires, M. Torres, N. Casaleiro, U. Nunes, and M. Castelo-Branco, "Playing Tetris with non-invasive BCI," in Proc. IEEE 1st Int. Conf. Serious Games Appl. Health, Nov. 2011, DOI: 10.1109/SeGAH.2011. 6165454.
6. A. Satti, D. H. Coyle, and G. Prasad, "Self-paced brain-controlled wheelchair methodology with shared and automated assistive control," in Proc. IEEE Symp. Comput. Intell. Cogn. Algorithms Mind Brain, 2011, DOI: 10.1109/CCMB.2011.5952123.
7. T. O. Zander and C. Kothe, "Towards passive brain-computer interfaces: Applying brain-computer interface technology to human-machine systems in general," J. Neural Eng., vol. 8, no. 2, 2011, 025005.
8. C. Mühl, A. Nijholt, B. Allison, S. Dunne, and D. K. J. Heylen, "Affective brain-computer interfaces (aBCI 2011)," in Proceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII2011), Part II, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, Oct. 2011, vol. 6975, pp. 9-19.
9. A. Girouard, E. T. Solovey, L. M. Hirshfield, K. Chauncey, A. Sassaroli, S. Fantini, and R. J. K. Jacob, "Distinguishing difficulty levels with non-invasive brain activity measurements," in INTERACT 2009. Uppsala, Sweden: Springer-Verlag, 2009.
10. G. Chanel, C. Rebetez, M. Bétrancourt, and T. Pun, "Emotion assessment from physiological signals for adaptation of game difficulty," IEEE Trans. Syst. Man Cybern. A, Syst. Humans, vol. 41, no. 6, pp. 1052-1063, Nov. 2011.
11. M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. New York, NY, USA: Harper & Row, 1990.
12. P. Sweetser and P. Wyeth, "GameFlow: A model for evaluating player enjoyment in games," ACM Comput. Entertain., vol. 3, no. 3, Jul. 2005, DOI: 10.1145/1077246.1077253.
13. K. Jegers, "Pervasive game flow: Understanding player enjoyment in pervasive gaming," ACM Comput. Entertain., vol. 5, Jan.1, 2007, DOI: 10.1145/1236224.1236238. (Pubitemid 46579508)
14. F. Bellotti, R. Berta, A. De Gloria, and L. Primavera, "Adaptive experience engine for serious games," IEEE Trans. Comput. Intell. AI Games, vol. 1, no. 4, pp. 264-280, Dec. 2009.
15. Y. T. Chiang, C. Y. Cheng, and S. S. J. Lin, "The effects of digital games on undergraduate players' flow experiences and affect," in Proc. 2nd IEEE Int. Conf. Digital Game Intell. Toy Enhanced Learn., 2008, pp. 157-159.
16. P. Brunner, L. Bianchi, C. Guger, F. Cincotti, and G. Schalk, "Current trends in hardware and software for brain-computer interfaces," J. Neural Eng., vol. 8, no. 2, 2011, 025001.
17. T. W. Malone, "What makes computer games fun?," Byte, vol. 6, pp. 258-277, 1981.
18. T. W. Malone and M. R. Lepper, "Making learning fun: A taxonomy of intrinsic motivations for learning," in Aptitude, Learning and Instruction III: Conative and Affective Process Analyses, R. E. Snow and M. J. Farr, Eds. Hillsdale, NJ, USA: Erlbaum, 1987.
19. M. Chen and S. Johnson, "Measuring flow in a computer game simulating a foreign language environment," 2004 [Online]. Available: http://www.markdangerchen.net/pubs/flow-in-game-simu-lating-fle.pdf
20. B. Cowley, D. Charles, M. Black, and R. Hickey, "Toward an understanding of flow in video games," Comput. Entertain., vol. 6, no. 2, 2008, DOI: 10.1145/1371216.1371223.
21. J. Chen, "Flow in games (and everything else)," Commun. ACM, vol. 50, no. 4, pp. 31-34, Apr. 2007. (Pubitemid 46494524)
22. D. O'Broin, "Using a criteria-based user model for facilitating flow in serious games," in Proc. 3rd Int. Conf. Games Virtual Worlds Serious Appl., 2010, pp. 63-69.
23. R. Lopes and R. Bidarra, "Adaptivity challenges in games and simulations: A survey," IEEE Trans. Comput. Intell. AI Games, vol. 3, no. 2, pp. 85-99, Jun. 2011.
24. C. Liu, P. Agrawal, N. Sarkar, and S. Chen, "Dynamic difficulty adjustment in computer games through real-time anxiety-based affective feedback," Int. J. Human-Comput. Interaction, vol. 25, no. 6, pp. 506-529, Aug. 2009.
25. L. F. Nicolas-Alonso and J. Gomez-Gil, "Brain computer interfaces, a review," Sensors, vol. 12, pp. 1211-1279, 2012.
26. S. Li, "Mind reading is on the market," Los Angeles Times, Aug. 8, 2010 [Online]. Available: http://articles.latimes.com/2010/aug/08/business/ la-fi-mind-reader-20100808
27. F. Nijboer, B. Z. Allison, S. Dunne, D. Plass-Oude Bos, A. Nijholt, and P. Haselager, "A preliminary survey on the perception of marketability of brain-computer interfaces and initial development of a repository of BCI companies," in Proc. 5th Int. Conf. Brain-Computer Interfaces, 2011, pp. 344-347.
28. E. Pellouchoud, M. E. Smith, L. McEvoy, and A. Gevins, "Mental effort related EEG modulation during video game play: Comparison between juvenile epileptic and normal control subjects," Epilepsia, vol. 40, no. Suppl. 4, pp. 38-43, 1990.
29. C. Sheikholeslami, H. Yuan, E. J. He, X. Bai, L. Yang, and B. He, "A high resolution EEG study of dynamic brain activity during video game play," in Proc. 29th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2007, pp. 2489-2491.
30. L. Derbali, P. Chalfoun, and C. Frasson, "A theoretical and empirical approach in assessing motivational factors: From serious games to an ITS," in Proc. Int. Florida Artif. Intell. Res. Soc. Conf., 2011, pp. 513-518.
31. L. E. Nacke, S. Stellmach, and C. Lindley, "Electroencephalographic assessment of player experience: A pilot study in affective ludology," Simul. Gaming, vol. 41, 2010, DOI: 10.1177/1046878110378140.
32. F. Babiloni, A. Tocci, F. De Vico Fallani, F. Cincotti, D. Mattia, L. Bianchi, S. Salinari, M. Marciani, A. Colosimo, and L. Astolfi, "High resolution EEG hyperscanning during a card game," in Proc. 29th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc, Aug. 23-26, 2007, pp. 4957-4960.
33. B.-S. Shim, S.-W. Lee, and J.-H. Shin, "Implementation of a 3-dimen-sional game for developing balanced brainwave," in Proc. ACIS Int. Conf. Softw. Eng. Res. Manage. Appl, 2007, pp. 751-758. (Pubitemid 351165610)
34. Q. Wang, O. Sourina, and M. K. Nguyen, "EEG-based "Serious" games design for medical applications," inProc. Int. Conf. Cyberworlds, Oct. 20-22, 2010, pp. 270-276.
35. J. H. Brockmyer, C. M. Fox, K. A. Curtiss, E. McBroom, K. M. Burkhart, and J. N. Pidruzny, "The development of the game engagement questionnaire: A measure of engagement in video game-playing," J. Exp. Social Psychol, vol. 45, no. 4, pp. 624-634, Jul. 2009.
36. K. Crowley, A. Sliney, I. Pitt, and D. Murphy, "Evaluating a brain-computer interface to categorise human emotional response," in Proc. 10th IEEE Int. Conf. Adv. Learn. Technol, Jul. 2010, pp. 276-278.
37. R. Oostenveld and P. Praamstra, "The five percent electrode system for high-resolution EEG and ERP measurements," Clin. Neurophysiol, vol. 112, pp. 713-719, 2001. (Pubitemid 32245646)
38. M. Fatourechia, A. Bashashatia, R. Warda, and G. Bircha, "EMG and EOG artifacts in brain computer interface systems: A survey," Clin. Neurophysiol, vol. 118, no. 3, pp. 480-494, Mar. 2007.
39. C. A. Joyce, I. Gorodnitsky, and M. Kautas, "Automatic removal of eye movement and blink artifacts from EEG data using blind component separation," Psychophysiology, vol. 41, pp. 313-325, 2004 (Pubitemid 38524104)
40. A. Nijholt, D. Oude Bos, and B. Reuderink, "Turning shortcomings into challenges: Brain-computer interfaces for games," Entertain. Comput., vol 1, no. 2, pp. 85-94, 2009.
41. D. Plass-Oude Bos, B. Reuderink, B. Laar, H. Gürkök, C. Mühl, M. Poel, A. Nijholt, and D. Heylen, "Brain-computer interfacing and games," in Brain-Computer Interfaces, D. S. Tan and A. Nijholt, Eds. London, U.K.: Springer-Verlag, 2010, pp. 149-178.
42. N. Bianchi-Berthouze, W. Kim, and D. Patel, "Does body movement engage you more in digital game play? And why?," in Affective Computing and Intelligent Interactions, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2007, vol. 4738, pp. 102-113.
43. R. Oostenveld, P. Fries, E. Maris, and J.-M. Schoffelen, "FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data," in Comput. Intell. Neurosci., Jan. 2011, Article ID 156869.
44. K. Abuhassan, D. Coyle, and L. P. Maguire, "Investigating the neural correlates of pathological cortical networks in Alzheimer's disease using heterogeneous neuronal models," IEEE Trans. Biomed. Eng., vol. 59, no. 3, pp. 890-896, Mar. 2012.
45. K. K. Ang, Z. Y. Chin, C. Wang, C Guan, and H. Zhang, "Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b,"Front. Neurosci., vol. 6, Mar. 2012, DOI: 10.3389/fnins.2012. 00039.
46. C J. C. Burges, "A tutorial on support vector machines for pattern recognition,"Data Mining Knowl. Disc, vol. 2, pp. 121-167, 1998. (Pubitemid 128695475)
47. M. Zhong, F. Lotte, M. Girolami, and A. Lécuyer, "Classifying EEG for brain computer interfaces using Gaussian processes," Pattern Recognit. Lett, vol. 29, no. 3, pp. 354-359, 2008. (Pubitemid 350250917)
48. A. Rakotomamonjy and V. Guigue, "BCI competition III: Dataset II-ensemble of SVMs for BCI P300 speller," IEEE Trans. Biomed. Eng., vol. 55, no. 3, pp. 1147-1154, Mar. 2008. (Pubitemid 351301245)
49. D. Garrett, D. A. Peterson,C W. Anderson, and M. H. Thaut, "Comparison of linear, nonlinear, and feature selection methods for EEG signal classification," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 141-144, Jun. 2003. (Pubitemid 36935042)
50. H. Sun, Y. Xiang, Y. Sun, H. Zhu, and J. Zeng, "On-line EEG classification for brain-computer interface based on CSP and SVM," in Proc. Int. Congr. Image Signal Process., 2010, pp. 4105-4108.
51. C.-C Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, 2011, DOI: 10.1145/1961189.1961199.
52. R. Fletcher, Practical Methods of Optimization. New York, NY, USA: Wiley, 1987.
53. M. Anthony and S. B. Holden, "Cross-validation for binary classification by real-valued functions: Theoretical analysis," in Proc. Conf. Comput. Learn. Theory, 1998, pp. 218-229.
54. P. Putman, J. van Peer, I. Maimari, and S. van der Werff, "EEG theta/beta ratio in relation to fear-modulated response-inhibition, attentional control, and affective traits," Biol. Psychol., vol. 83, pp. 73-78, 2010.
55. N. Jauovec, "Differences in cognitive processes between gifted, intelligent, creative, and average individuals while solving complex problems: An EEG study," Intelligence, vol. 28, no. 3, pp. 213-237, Sep. 2000.
56. Y. W. Chen and C. J. Lin, "Combining SVMs with various feature selection strategies," Feature Extraction, Found. Appl., vol. 207, pp. 315-324, 2006.
57. M. Toscani, T. Marzi, S. Righi, M. P. Viggiano, and S. Baldassi, "Alpha waves: A neural signature of visual suppression," Exp. Brain Res., vol. 3-4, no. 207, pp. 213-219, 2010.
58. S. Sanei and J. A. Chambers, EEG Signal Processing. Chichester, U.K.: Wiley, 2007.
59. H. Steinmetz, J. Volkmann, L. Jäncke, and H.-J. Freund, "Anatomical left-right asymmetry of language-related temporal cortex is different in left-and right-handers," Ann. Neurol., vol. 29, pp. 315-319, 1991.
60. I. Taylor and M. M. Taylor, Psycholinguistics: Learning and Using Language. Englewood Cliffs, NJ, USA: Prentice-Hall, 1990.
61. L. Jiang, H. Zhang, and Z. Cai, "A novel Bayes model: Hidden naive Bayes," IEEE Trans. Knowl. Data Eng., vol. 21, no. 10, pp. 1361-1371, Oct. 2009.
62. N. Friedman, D. Geiger, and M. Goldszmidt, "Bayesian network classifiers," Mach. Learn., vol. 29, no. 2-3, pp. 131-163, 1997. (Pubitemid 127510036)
63. L. Jiang and H. Zhang, "Weightily averaged one-dependence estimators," in Proc. 9th Pacific Rim Int. Conf. Artif. Intell., 2006, pp. 970-974. (Pubitemid 44531893)
64. M. Chaouachi, I. Jraidi, and C. Frasson, "Modeling mental workload using EEG features for intelligent systems," in User Modeling, Adaptation and Personalization, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2011, vol. 6787, pp. 50-61.
65. M. Obbink, H. Gürkök, D. Plass-Oude Bos, G. Hakvoort, M. Poel, and A. Nijholt, "Social interaction in a cooperative brain-computer interface game," in Proc. 4th Int. ICST Conf. Intell. Technol. Interactive Entertain., 2011, pp. 183-192.
66. D. J. Krusienski, M. Grosse-Wentrup, D. Coyle, F. Galan, K. J. Miller, E. Forney, and C. W. Anderson, "Critical issues in state-of-the-art brain-computer interface signal processing," J. Neural Eng., vol. 8, 2011, 025002.
67. B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K.-R. Muller, "Optimizing spatial filters for robust EEG single-trial analysis," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 41-56, Jan. 2008.