Dynamic difficulty using brain metrics of workload

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2014, Pages 3797-3806

  Afergan, Daniel ^a   Peck, Evan M ^a   Solovey, Erin T ^b   Jenkins, Andrew ^a   Hincks, Samuel W ^a   Brown, Eli T ^a   Chang, Remco ^a   Jacob, Robert J K ^a  

^a TUFTS UNIVERSITY   (United States)

^b DREXEL UNIVERSITY   (United States)

Author keywords

BCI; Dynamic difficulty; FNIRS; Near infrared spectroscopy; Passive brain computer interface; UAV; Workload

Indexed keywords

BRAIN COMPUTER INTERFACE; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; MOTION PLANNING; UNMANNED AERIAL VEHICLES (UAV);

BASE-LINE CONDITIONS; BCI; FNIRS; FUNCTIONAL NEAR-INFRARED SPECTROSCOPY (FNIRS); HUMAN-COMPUTER SYSTEMS; LABORATORY STUDIES; PHYSIOLOGICAL SIGNALS; WORKLOAD;

FUNCTIONAL NEUROIMAGING;

EID: 84900451984     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556288.2557230     Document Type: Conference Paper

References (44)

1. Allison, B., and Polich, J. Workload assessment of computer gaming using a single-stimulus event-related potential paradigm. Biological Psychology 77 (2008), 277-283
2. Ayaz, H., Shewokis, P. A., Bunce, S., Izzetoglu, K., Willems, B., and Onaral, B. Optical brain monitoring for operator training and mental workload assessment. NeuroImage 59, 1 (2012), 36-47
3. Ayaz, H., Shewokis, P. A., Bunce, S., and Onaral, B. An optical brain computer interface for environmental control. In IEEE EMBC 2011 (2011), 6327-6330
4. Ayaz, H., Willems, B., Bunce, S., Shewokis, P. A., Izzetoglu, M., Hah, S., Deshmukh, A., and Onaral, B. Cognitive workload assessment of air traffic controllers using optical brain imaging sensors. Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations (2010), 21-31
5. Baddeley, A. Working memory: Looking back and looking forward. Nature Reviews Neuroscience 4, 10 (2003), 829-39
6. Bederson, B. Interfaces for Staying in the Flow. Ubiquity (2004)
7. Bunce, S. C., Izzetoglu, K., Ayaz, H., Shewokis, P., Izzetoglu, M., Pourrezaei, K., and Onaral, B. Implementation of fNIRS for monitoring levels of expertise and mental workload. In Foundations of Augmented Cognition. Directing the Future of Adaptive Systems. Springer Berlin Heidelberg, 2011, 13-22
8. Chanel, G., Rebetez, C., Betrancourt, M., and Pun, T. Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. In Proc. Entertainment and Media in the Ubiquitous Era, ACM Press (2008), 13-17
9. Chang, C., and Lin, C. LIBSVM: A library for support vector machines. Transactions on Intelligent Systems and Technology (2011), 1-39
10. Csikszentmihalyi, M. Flow: The Psychology of Optimal Experience. HarperCollins, 1991
11. Cui, X., Bray, S., and Reiss, A. L. Speeded near infrared spectroscopy (NIRS) response detection. PLOS ONE 5, 11 (2010)
12. Cummings, M., and How, J. The Impact of HumanAutomation Collaboration in Decentralized Multiple Unmanned Vehicle Control. Proc. IEEE 100, 3 (2012), 660-671
13. Cutrell, E., and Tan, D. BCI for passive input in HCI. In Proc. CHI 2008, ACM Press (2008)
14. Donmez, B., Nehme, C., and Cummings, M. L. Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 40, 6 (2010), 1180-1190
15. Fairclough, S., Gilleade, K., Ewing, K. C., and Roberts, J. Capturing user engagement via psychophysiology: Measures and mechanisms for biocybernetic adaptation. International Journal of Autonomous and Adaptive Communications Systems 6, 1 (2013), 63-79
16. Giakoumis, D., Vogiannou, A., Kosunen, I., Moustakas, K., Tzovaras, D., and Hassapis, G. Identifying Psychophysiological Correlates of Boredom and Negative Mood Induced During HCI. Bio-inspired Human-Machine Interfaces and Healthcare Applications (2010), 3-12
17. Girouard, A., Solovey, E. T., and Hirshfield, L. M. Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements. INTERACT 2009 (2009), 440-452
18. Griner, A. Human-RRT Collaboration in UAV Mission Path Planning. Master's Thesis, Massachusetts Institute of Technology (2012)
19. Hirshfield, L., Gulotta, R., and Hirshfield, S. This is your brain on interfaces: Enhancing usability testing with functional near-infrared spectroscopy. In Proc. CHI 2011, ACM Press (2011)
20. Hirshfield, L. M., Solovey, E. T., Girouard, A., Kebinger, J., Jacob, R. J. K., Sassaroli, A., and Fantini, S. Brain Measurement for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload with Functional Near Infrared Spectroscopy. In Proc. CHI 2009, ACM Press (2009)
21. Huppert, T., and Hoge, R. A temporal comparison of BOLD, ASL, and NIRS hemodynamic responses to motor stimuli in adult humans. NeuroImage 29, 2 (2006), 368-382
22. Izzetoglu, K., Ayaz, H., and Menda, J. Applications of Functional Near Infrared Imaging: Case Study on UAV Ground Controller. In Foundations of Augmented Cognition. Springer Berlin Heidelberg, 2011, 608-617
23. Jacob, R. J. K., Leggett, J. J., Myers, B. A., and Pausch, R. Interaction Styles and Input/Output Devices. Behaviour and Information Technology 12, 2 (1993), 69-79
24. Jegers, K. Pervasive game flow: Understanding player enjoyment in pervasive gaming. Computers in Entertainment (CIE) 5, 1 (2007)
25. Luu, S., and Chau, T. Decoding subjective preference from single-trial near-infrared spectroscopy signals. Journal of Neural Engineering 6 (2008)
26. Nacke, L., and Lindley, C. Flow and immersion in first-person shooters: Measuring the player's gameplay experience. In Proceedings of the 2008 Conference on Future Play: Research, Play, Share, ACM Press (2008), 81-88
27. Owen, A. M., McMillan, K. M., Laird, A. R., and Bullmore, E. N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping 25, 1 (2005), 46-59
28. Peck, E., Yuksel, B., Ottley, A., Jacob, R. J. K., and Chang, R. Using fNIRS Brain Sensing to Evaluate Information Visualization Interfaces. In Proc. CHI 2013, ACM Press (2013)
29. Peck, E. M., Afergan, D., and Jacob, R. J. K. Investigation of fNIRS brain sensing as input to information filtering systems. Augmented Human 2013 (2013)
30. Pekrun, R., Goetz, T., Daniels, L. M., Stupnisky, R. H., and Perry, R. P. Boredom in achievement settings: Exploring controlvalue antecedents and performance outcomes of a neglected emotion. Journal of Educational Psychology 102, 3 (2010), 531-549
31. Prinzel, L. J., Freeman, F. G., Scerbo, M. W., Mikulka, P. J., and Pope, A. T. Effects of a Psychophysiological System for Adaptive Automation on Performance, Workload, and the Event-Related Potential P300 Component. Human Factors: The Journal of the Human Factors and Ergonomics Society 45, 4 (2003), 601-613
32. Qin, H., Rau, P., and Salvendy, G. Effects of different scenarios of game difficulty on player immersion. Interacting with Computers 22, 3 (2010), 230-239
33. Rani, P. Maintaining optimal challenge in computer games through real-time physiological feedback mechanical engineering. Pulse (2005)
34. Sassaroli, A., Zheng, F., Hirshfield, L. M., Girouard, A., Solovey, E. T., Jacob, R. J. K., and Fantini, S. Discrimination of Mental Workload Levels in Human Subjects with Functional Near-Infrared Spectroscopy. Journal of Innovative Optical Health Sciences 1, 2 (2008), 227-237
35. Solovey, E. T., Girouard, A., Chauncey, K., Hirshfield, L. M., Sassaroli, A., Zheng, F., Fantini, S., and Jacob, R. J. K. Using fNIRS Brain Sensing in Realistic HCI Settings: Experiments and Guidelines. In Proc. UIST 2009, ACM Press (2009), 157-166
36. Solovey, E. T., Girouard, A., Jacob, R. J., Lalooses, F., Chauncey, K., Weaver, D., Parasi, M., Scheutz, M., Sassaroli, A., Fantini, S., and Schermerhorn, P. Sensing cognitive multitasking for a brain-based adaptive user interface. In Proc. CHI 2011, ACM Press (2011)
37. Solovey, E. T., Schermerhorn, P., Scheutz, M., Sassaroli, A., Fantini, S., and Jacob, R. Brainput: Enhancing Interactive Systems with Streaming fNIRS Brain Input. In Proc. CHI 2012, ACM Press (2012)
38. Strangman, G., Culver, J. P., Thompson, J. H., and Boas, D. A. A Quantitative Comparison of Simultaneous BOLD fMRI and NIRS Recordings during Functional Brain Activation. NeuroImage 17, 2 (2002), 719-731
39. Stripling, R., Coyne, J., Cole, A., Afergan, D., Barnes, R. L., Rossi, K. A., Reeves, L. M., and Schmorrow, D. D. Automated SAF adaptation tool (ASAT). In Foundations of Augmented Cognition. Springer Berlin Heidelberg, 2007, 346-353
40. Tai, K., and Chau, T. Single-trial classification of NIRS signals during emotional induction tasks: Towards a corporeal machine interface. Journal of Neuroengineering and Rehabilitation 6 (2009), 39
41. Tan, D., and Nijholt, A. Brain-Computer Interfaces and Human-Computer Interaction. In Brain-Computer Interfaces. Springer London, 2010, 3-19
42. Vidaurre, C., Kawanabe, M., von Bünau, P., Blankertz, B., and Müller, K. R. Toward unsupervised adaptation of LDA for brain-computer interfaces. IEEE Transactions on Biomedical Engineering 58, 3 (2011), 587-97
43. Wilson, G. F., and Russell, C. A. Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding. Human Factors: The Journal of the Human Factors and Ergonomics Society 49, 6 (2007), 1005-1018
44. Zander, T. O., Kothe, C., Welke, S., and Rötting, M. Utilizing secondary input from passive brain-computer interfaces for enhancing human-machine interaction. In Foundations of Augmented Cognition, Neuroergonomics and Operational Neuroscience, Springer Berlin Heidelberg (2009), 759-771.