Automatic classification of eye activity for cognitive load measurement with emotion interference

Computer Methods and Programs in Biomedicine

Volumn 110, Issue 2, 2013, Pages 111-124

  Chen, Siyuan ^a,b   Epps, Julien ^a,b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b CSIRO   (Australia)

Author keywords

Blink; Cognitive load; Eye activity; Eye movement; Fixation; Physiological measures; Pupil; Saccade

Indexed keywords

BLINK; COGNITIVE LOADS; EYE ACTIVITIES; PHYSIOLOGICAL MEASURES; PUPIL;

MEASUREMENTS; NITROGEN FIXATION; PSYCHOPHYSIOLOGY;

EYE MOVEMENTS;

ADULT; ARITHMETIC; AROUSAL; ARTICLE; AUTOMATIC COGNITIVE LOAD MEASUREMENT SYSTEM; AUTOMATION; COGNITION; CONTROLLED STUDY; EMOTION; EYE FIXATION; EYE MOVEMENT; EYELID REFLEX; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PREDICTION; PUPIL; RESPONSE TIME; SACCADIC EYE MOVEMENT; TASK PERFORMANCE; VISUAL STIMULATION;

ADULT; BLINKING; COGNITION; EMOTIONS; EYE MOVEMENTS; FEMALE; HUMANS; MALE; MIDDLE AGED; MODELS, STATISTICAL; NORMAL DISTRIBUTION; PUPIL; REACTION TIME; SACCADES; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS; YOUNG ADULT;

EID: 84875885850     PISSN: 01692607     EISSN: 18727565     Source Type: Journal    
DOI: 10.1016/j.cmpb.2012.10.021     Document Type: Article

References (45)

1. Collie A., Darby D., Maruff P. Computerised cognitive assessment of athletes with sports related head injury. British Journal of Sports Medicine 2001, 35:297-302.
2. Spaulding W.D., Fleming S.K., Reed D., Sullivan M., Storzbach D., Lam M. Cognitive functioning in schizophrenia: implications for psychiatric rehabilitation. Schizophrenia Bulletin 1999, 25:275-289.
3. Brandt J., Butters N., Ryan C., Bayog R. Cognitive loss and recovery in long-term alcohol abusers'. Archives of General Psychiatry 1983, 40:435-442.
4. Petersen R.C., Smith G.E., Waring S.C., Ivnik R.J., Tangalos E.G., Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Archives of Neurology 1999, 56:303-308.
5. Sands L.P., Yaffe K., Covinsky K., Chren M.-M., Counsell S., Palmer R., Fortinsky R., Landefeld C.S. Cognitive screening predicts magnitude of functional recovery from admission to 3months after discharge in hospitalized elders. The Journals of Gerontology: Series A 2003, 58:37-45.
6. Wilson G.F., Eggemeier F.T. Psychophysiological assessment of workload in multi-task environments. Multiple-task Performance 1991, 329-360. Taylor & Francis Ltd., London. D.L. Damos (Ed.).
7. Chen S., Epps J., Ruiz N., Chen F. Eye activity as a measure of human mental effort in HCI. Proceedings of the 2011 Intelligent User Interface 2011, 315-318.
8. Marshall S.P. Identifying cognitive state from eye metrics. Aviation, Space and Environmental Medicine 2007, 78:165-175.
9. Klingner J., Tversky B., Hanrahan P. Effects of visual and verbal presentation on cognitive load in vigilance, memory and arithmetic tasks. Psychophysiology 2011, 48:323-332.
10. Haapalainen E., Kim S., Forlizzi J.F., Dey A.K. Psycho-physiological measures for assessing cognitive load. Proceedings of the UbiComp' 2010 2010, 301-310.
11. Veltman J.A., Gaillard A.W.K. Physiological workload reactions to increasing levels of task difficulty. Ergonomics 1998, 41:656-669.
12. Van Orden K.F., Limbert W., Makeig S., Jung T.P. Activity correlates of workload during a visuospatial memory task. Human Factors: The Journal of the Human Factors and Ergonomics Society 2001, 43:111-121.
13. de Greef T., Lafeber H., Oostendorp H., Lindenberg J. Eye movement as indicators of mental workload to trigger adaptive automation. Foundations of Augmented Cognition, Neuroergonomics and Operational Neuroscience 2009, 219-228. Springer. D. Schmorrow, I. Estabrooke, M. Grootjen (Eds.).
14. Picard R.W., Vyzas E., Healey J. Toward machine intelligence: analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001, 23:1175-1191.
15. Kim J., Andre E. Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis and Machine Intelligence 2008, 30:2067-2083.
16. Larsen R.J., Fredrickson B.L. Measurement issues in emotion research. Well-being: The Foundations of Hedonic psychology, 1999, 40-60. Russell Sage Foundation, NY. D. Kahneman, E. Diener, N. Schwarz (Eds.).
17. Irwin D.E., Thomas L.E. Eyeblinks and cognition. Tutorials in Visual Cognition 2010, 121-141. Psychology Press, Talyor & Francis Group, New York, London. V. Coltheart (Ed.).
18. Beatty J. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin 1982, 91:276-292.
19. Tanaka Y., Yamaoka K. Blink activity and task difficulty. Perceptual and Moto Skills 1993, 55-66.
20. Kramer A.F. Physiological metrics of mental workload: a review of recent progress. Multiple-task Performance 1991, 279-328. Taylor & Francis Ltd, London. D.L. Damos (Ed.).
21. Bradley M.M., Miccoli L., Escrig M.A., Lang P.J. The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology 2008, 45:602-607.
22. Partala T., Surakka V. Pupil size variation as an indication of affective processing. International Journal of Human-Computer Studies 2003, 59:185-198.
23. Stanners R.F., Coulter M., Sweet A.W., Murphy P. The pupillary response as an indicator of arousal and cognition. Motivation and Emotion 1979, 3:319-340.
24. Ponder E., Kennedy E.P. On the act of blinking. Experimental Physiology 1927, 18:89-110.
25. Salvucci D.D., Goldberg J.H. Identifying fixations and saccades in eye-tracking protocols. Proceedings of the 2000 Symposium on Eye Tracking Research and Applications 2000, 71-78.
26. Duchowski A.T. Eye Tracking Methodology: Theory and Practice 2003, Springer. 1st ed.
27. Jacob R.J.K., Karn K.S. Eye tracking in human-computer interaction and usability research: ready to deliver the promises. The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research 2003, Oxford, England. Hyona, Radach, Deubel (Eds.).
28. Byrne E.A., Parasuraman R. Psychophysiology and adaptive automation. Biological Psychology 1996, 42:249-268.
29. Ahern S., Beatty J. Pupillary responses during information processing vary with scholastic aptitude test scores. Science 1979, 205:1289-1292.
30. Piquado T., Isaacowitz D., Wingfield A. Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology 2010, 47:560-569.
31. Lang P.J., Bradley M.M., Cuthbert B.N. International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual, Technical Report A-8 2008, University of Florida.
32. Seeingmachines, (October 2010). http://www.seeingmachines.com/.
33. Nakayama M., Shimizu Y. Frequency analysis of task evoked pupillary response and eye-movement. Proceedings of the 2004 Symposium on Eye Tracking Research and Applications 2004, 71-76.
34. Grauman K., Betke M., Gips J., Bradski G.R. Communication via eye blinks - detection and duration analysis in real time. Abstracts of the IEEE Computer Vision and Pattern Recognition Conference, vol. 2 2001, 1010-1017.
35. Paas F., Tuovinen J.E., Tabbers H., Van Gerven P.W.M. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist 2003, 38:63-71.
36. Cattapan-Ludewig K., Hilti C.C., Ludewing S., Vollenweider F.X., Feldon J. Rapid visual information processing in schizophrenic patients: the impact of cognitive load and duration of stimulus presentation. Neuropsychobiology 2005, 52:130-134.
37. Laxmisan A., Hakimzada F., Sayan O.R., Green R.A., Zhang J., Patel V.L. The multitasking clinician: decision-making and cognitive demand during and after team handoffs in emergency care. International Journal of Medical Informatics 2007, 76:801-811.
38. Dror I. A novel approach to minimize error in the medical domain: cognitive neuroscientific insights into training. Medical Teacher 2011, 33:34-38.
39. Beuscart-Zephir M.C., Brender J., Beuscart R., Menager-Depriester I. Cognitive evaluation: how to assess the usability of information technology in healthcare. Computer Methods and Programs in Biomedicine 1997, 54:19-28.
40. Aharonson V., Korczyn A.D. Human-computer interaction in the administration and analysis of neuropsychological tests. Computer Methods and Programs in Biomedicine 2004, 73:43-53.
41. Schuller B., Müller R., Eyben F., Gast J., Hörnler B., Wöllmer M., Rigoll G., Höthker A., Konosu H. Being bored? Recognising natural interest by extensive audiovisual integration for real-life application. Image and Vision Computing 2009, 27(12):1760-1774.
42. Schulz C.M., Schneider E., Fritz L., Vockeroth J., Hapfelmeier A., Wasmaier M., Kochs E.F., Schneider G. Eye tracking for assessment of workload: a pilot study in an anaesthesia simulator environment. British Journal of Anaesthesia 2011, 106:44-50.
43. Palinko O., Kun A. Exploring the influence of light and cognitive load on pupil diameter in driving simulator studies. Proceedings of the 6th International Driving Symposium on Human Factors in Driver Assessment 2011.
44. Causse M., Pavard B., Senard J., Demonet J., Pastor J. Positive and negative emotion induction through avatars and its impact on reasoning performance: cardiovascular and pupillary correlates. StudiaPsychologica 2012, 54:37-51.
45. Mitchell R.L.C., Phillips L.H. The psychological, neurochemical and functional neuroanatomical mediators of the effects of positive and negative mood on executive functions. Neuropsychologia 2007, 45:617-629.