Using fNIRS brain sensing to evaluate information visualization interfaces

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2013, Pages 473-482

  Peck, Evan M ^a   Yuksel, Beste F ^a   Ottley, Alvitta ^a   Jacob, Robert J K ^a   Chang, Remco ^a  

^a TUFTS UNIVERSITY   (United States)

Author keywords

BCI; Brain sensing; Evaluation; FNIRS; Visualization

Indexed keywords

BCI; EVALUATION; FNIRS; FUNCTIONAL NEAR-INFRARED SPECTROSCOPY (FNIRS); INFORMATION VISUALIZATION; MASSIVELY PARALLELS; PERFORMANCE MEASURE; SENSING TECHNOLOGY;

FLOW VISUALIZATION; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; INFORMATION SYSTEMS; SURVEYS; VISION; VISUALIZATION;

FUNCTIONAL NEUROIMAGING;

EID: 84877976411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2470654.2470723     Document Type: Conference Paper

References (40)

1. Anderson, E., Potter, K., Matzen, L., Shepherd, J., Preston, G., and Silva, C. A User Study of Visualization Effectiveness Using EEG and Cognitive Load. In EuroVis 2011, vol. 30, Wiley Online Library (2011), 791-800.
2. Ayaz, H., Shewokis, P. a., Bunce, S., Izzetoglu, K., Willems, B., and Onaral, B. Optical brain monitoring for operator training and mental workload assessment. NeuroImage 59, 1 (2012), 36-47.
3. Bertini, E., Perer, A., Plaisant, C., and Santucci, G. BEyond time and errors: novel evaLuation methods for Information Visualization. BELIV (2010), 4441-4444.
4. Causse, M., and Hurter, C. The physiological users response as a clue to assess visual variables effectiveness. Human Centered Design (2009), 167-176.
5. Chance, B., Anday, E., Nioka, S., Zhou, S., Hong, L., Worden, K., Li, C., Murray, T., Ovetsky, Y., Pidikiti, D., and Thomas, R. A novel method for fast imaging of brain function, non-invasively, with light. Optics express 2, 10 (1998), 411-23.
6. Cleveland, W. S., and McGill, R. Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods. Journal of the American Statistical Association 79, 387 (1984), 531-554.
7. De Waard, D. The measurement of drivers' mental workload. PhD thesis, 1996.
8. Dell, N., Vaidyanathan, V., Medhi, I., Cutrell, E., and Thies, W. Yours is Better! Participant Response Bias in HCI. In ACM CHI 2012 (2012), 1321-1330.
9. D'Esposito, M., Zarahn, E., and Aguirre, G. Event-Related Functional MRI: Implications for Cognitive Psychology. Psychological bulletin 125, 1 (1999), 155-164.
10. Fairclough, S. H. Fundamentals of Physiological Computing. Interacting with Computers 21 (2009), 133-145.
11. Girouard, A., Solovey, E., Hirshfield, L., Chauncey, K., Sassaroli, A., Fantini, S., and Jacob, R. J. Distinguishing difficulty levels with non-invasive brain activity measurements. Human-Computer Interaction INTERACT 2009 (2009), 440-452.
12. Girouard, A., Solovey, E. T., Hirshfield, L. M., Peck, E. M., Chauncey, K., Sassaroli, A., Fantini, S., and Jacob, R. J. From Brain Signals to Adaptive Interfaces : using fNIRS in HCI. 2010, 221-237.
13. Hart, S. G., and Staveland, L. E. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human mental workload (1988), 139-183.
14. Heer, J., and Bostock, M. Crowdsourcing graphical perception: using mechanical turk to assess visualization design. ACM CHI 2010 (2010), 203-212.
15. Hirshfield, L. M., Gulotta, R., Hirshfield, S., Hincks, S., Russel, M., Ward, R., Williams, T., and Jacob, R. J. K. This is Your Brain on Interfaces : Enhancing Usability Testing with Functional Near-Infrared Spectroscopy. In ACM CHI 2011 (2011), 373-382.
16. Hirshfield, L. M., Solovey, E. T., Girouard, A., Kebinger, J., Jacob, R. J. K., Sassaroli, A., and Fantini, S. Brain Measurement for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload with Functional Near Infrared Spectroscopy. In ACM CHI 2009 (2009), 2185-2194.
17. Huang, W., Eades, P., and Hong, S.-H. Measuring effectiveness of graph visualizations: A cognitive load perspective. IEEE Transactions on Information Visualization 8, 3 (2009), 139-152.
18. Hullman, J., Adar, E., and Shah, P. Benefitting InfoVis with visual difficulties. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2213-22.
19. Lloyd-Fox, S., Blasi, A., and Elwell, C. E. Illuminating the developing brain: the past, present and future of functional near infrared spectroscopy. Neuroscience and biobehavioral reviews 34, 3 (Mar. 2010), 269-84.
20. Moroney, W. F., Biers, D. W., Eggemeier, F. T., and Mitchell, J. A. A Comparison of Two Scoring Procedures with the NASA Task Load Index in a Simulated Flight Task. National Aerospace and Electronics (1992), 734-740.
21. Owen, A. M., McMillan, K. M., Laird, A. R., and Bullmore, E. N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Human Brain Mapping 25, 1 (2005), 46-59.
22. Paas, F., Tuovinen, J. E., Tabbers, H., and Van Gerven, P. W. M. Cognitive Load Measurement as a Means to Advance Cognitive Load Theory. Educational Technology 38, 1 (2003), 63-71.
23. Paas, F. G., and Van Merriënboer, J. J. The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Human Factors: The Journal of the Human Factors and Ergonomics Society, 35 (1993), 737-743.
24. Presacco, A., Goodman, R., Forrester, L., and Contreras-Vidal, J. Neural decoding of treadmill walking from noninvasive electroencephalographic signals. Journal of Neurophysiology 106, 4 (2011), 1875-87.
25. Ramnani, N., and Owen, A. M. Anterior Prefrontal Cortex: Insights into Function from Anatomy and Neuroimaging. Nature reviews: Neuroscience 5, 3 (2004), 184-94.
26. Riche, N. Beyond system logging: Human logging for evaluating information visualization. In BELIV (2010).
27. Rowe, J. B., Toni, I., Josephs, O., Frackowiak, R. S., and Passingham, R. E. The prefrontal cortex: response selection or maintenance within working memory? Science 288, 5471 (2000), 1656-60.
28. Simkin, D., and Hastie, R. An Information-Processing Analysis of Graph Perception. Journal of the American Statistical Association 82, 398 (1987), 454-465.
29. Solovey, E., Schermerhorn, P., Scheutz, M., Sassaroli, A., Fantini, S., and Jacob, R. Brainput: Enhancing Interactive Systems with Streaming fNIRS Brain Input. In ACM CHI 2012 (2012), 2193-2202.
30. Solovey, E. T., Girouard, A., Chauncey, K., Hirshfield, L. M., Sassaroli, A., Zheng, F., Fantini, S., and Jacob, R. J. K. Using fNIRS Brain Sensing in Realistic HCI Settings: Experiments and Guidelines. In ACM UIST 2009 (2009), 157-166.
31. Solovey, E. T., Lalooses, F., Chauncey, K., Weaver, D., Scheutz, M., Sassaroli, A., Fantini, S., Schermerhorn, P., and Jacob, R. J. K. Sensing Cognitive Multitasking for a Brain-Based Adaptive User Interface. In ACM CHI 2011 (2011), 383-392.
32. Spence, I. Visual psychophysics of simple graphical elements. Journal of Experimental Psychology: Human Performance and Perception 16 (1990), 683-692.
33. Spence, I. No Humble Pie: The Origins and Usage of a Statistical Chart. Journal of Educational and Behavioral Statistics 30, 4 (2005), 353-368.
34. Spence, I., and Lewandowsky, S. Displaying proportions and percentages. Applied Cognitive Psychology 5 (1991), 71-77.
35. Strangman, G., Culver, J. P., Thompson, J. H., and Boas, D. a. A Quantitative Comparison of Simultaneous BOLD fMRI and NIRS Recordings during Functional Brain Activation. NeuroImage 17, 2 (2002), 719-731.
36. Villringer, A., and Chance, B. Non-invasive optical spectroscopy and imaging of human brain function. Trends in Neurosciences 20, 10 (1997), 435-42.
37. Wickens, C., and Hollands, J. Engineering Psychology and Human Performance. Prentice-Hall, Upper Saddle River, NJ, 1999.
38. Wigdor, D., Shen, C., Forlines, C., and Balakrishnan, R. Perception of elementary graphical elements in tabletop and multi-surface environments. ACM CHI 2007 (2007), 473-482.
39. Wolf, M., Ferrari, M., and Quaresima, V. Progress of near-infrared spectroscopy and topography for brain and muscle clinical applications. Journal of Biomedical Optics 12, 6 (2012), 062104.
40. Yeh, Y., and Wickens, C. D. Dissociation of Performance and Subjective Measures of Workload. Human Factors: The Journal of the Human Factors and Ergonomics Society 30, 1 (1988), 111-120.