Capturing and evaluating blinks from video-based eyetrackers

Behavior Research Methods

Volumn 45, Issue 3, 2013, Pages 656-663

  Jiang, Xianta ^a,b   Tien, Geoffrey ^b   Huang, Da ^b   Zheng, Bin ^c   Atkins, M Stella ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b SIMON FRASER UNIVERSITY   (Canada)

^c UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Blinks; Computer vision; Eyetracking; Image guided tasks; Mental workload; Video processing

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; BLINKING; COMPUTER SIMULATION; DIFFERENTIAL THRESHOLD; EYELID; HUMAN; PHYSIOLOGY; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BLINKING; COMPUTER SIMULATION; DIFFERENTIAL THRESHOLD; EYELIDS; HUMANS; MODELS, BIOLOGICAL; ROC CURVE; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 84881603167     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-012-0294-x     Document Type: Article

References (26)

1. Andreassi, J. L. (2000). Human behavior and physiological response (4th ed.). Mahwah, NJ: Erlbaum.
2. Benedetto, S., Pedrotti, M., Minin, L., Baccino, T., Re, A., & Montanari, R. (2011). Driver workload and eye blink duration. Transportation Research Part F, 14, 199-208. doi: 10. 1016/j. trf. 2010. 12. 001.
3. Blumenthal, T. D., Cuthbert, B. N., Filion, D. L., Hackley, S., Lipp, O. V., & van Boxtel, A. (2005). Committee report: Guidelines for human startle eyeblink electromyographic studies. Psychophysiology, 42, 1-15. doi: 10. 1111/j. 1469-8986. 2005. 00271. x.
4. Bradski, G., & Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV Library Retrieved from http://ebookee. org/Learning-OpenCV-Computer-Vision-with-the-OpenCV-Library_192365. html.
5. Caffier, P. P., Erdmann, U., & Ullsperger, P. (2003). Experimental evaluation of eye-blink parameters as a drowsiness measure. European Journal of Applied Physiology, 89, 319-325.
6. Deuschl, G., & Goddemeier, C. (1998). Spontaneous and reflex activity of facial muscles in dystonia, parkinson's disease, and in normal subjects. Journal of Neurology, Neurosurgery and Psychiatry, 64, 320-324.
7. Evinger, C., Manning, K. A., & Sibony, P. A. (1991). Eyelid movements mechanisms and normal data. Investigative Ophthalmology and Visual Science, 32, 387-401.
8. Fogarty, J., Baker, R. S., & Hudson, S. E. (2005). Case studies in the use of ROC curve analysis for sensor-based estimates in human computer interaction. Waterloo, British Columbia: Paper presented at Graphics Interface 2005.
9. Grauman, K., Betke, M., Gips, J., & Bradski, G. R. (2001). Communication via eye blinks-detection and duration analysis in real time. Kauai, HI: Paper presented at the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
10. Haak, M., Bos, S., Panic, S., & Rothkrantz, L. J. M. (2009). Detecting stress using eye blinks and brain activity from EEG signals. Prague, Czech Republic: Paper presented at the Driver Car Interaction & Interface 2009.
11. Kong, X., & Wilson, G. (1998). A new EOG-based eyeblink detection algorithm. Behavior Research Methods, 30, 713-719. doi: 10. 3758/bf03209491.
12. Lalonde, M., Byrns, D., Gagnon, L., Teasdale, N., & Laurendeau, D. (2007). Real-time eye blink detection with GPU-based SIFT tracking. Regina, SK: Paper presented at the Fourth Canadian Conference on Computer and Robot Vision.
13. Marshall, S. P. (2007). Identifying cognitive state from eye metrics. Aviation, Space, and Environmental Medicine, 78(5 Suppl), B165-B175.
14. Mitalis, S., & Druss, F. (1985). An optoelectronic motion-sensing eye blink detector. Behavior Research Methods, 17, 385-387. doi: 10. 3758/bf03200946.
15. Moriyama, T., Kanade, T., Cohn, J., Xiao, J., Ambadar, Z., Gao, J., & Imanur, M. (2002). Automatic recognition of eye blinking in spontaneously occurring behavior. Quebec City: Paper presented at the 16th International Conference on Pattern Recognition (ICPR 2002).
16. Pedrotti, M., Lei, S., Dzaack, J., & Rötting, M. (2011). A data-driven algorithm for offline pupil signal preprocessing and eyeblink detection in low-speed eye-tracking protocols. Behavior Research Methods, 43, 372-383. doi: 10. 3758/s13428-010-0055-7.
17. Ryu, K., & Myung, R. (2005). Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. International Journal of Industrial Ergonomics, 35, 991-1009. doi: 10. 1016/j. ergon. 2005. 04. 005.
18. Schiffman, H. R. (2000). Sensation and perception: An integrated approach (5th ed.). New York, NY: Wiley.
19. Smith, P., Shah, M., & Lobo, N. D. V. (2000). Monitoring head/eye motion for driver alertness with one camera. Barcelona, Spain: Paper presented at the International Conference on Pattern Recognition (ICPR 2000).
20. Sukno, F. M., Pavani, S.-K., Butakoff, C., & Frangi, A. F. (2009). Automatic assessment of eye blinking patterns through statistical shape models. In M. Fritz, B. Schiele, & J. H. Piater (Eds.), Computer vision systems, Lecture Notes in Computer Science, vol. 5815 (pp. 33-42). Heidelberg: Springer. doi: 10. 1007/978-3-642-04667-4_4.
21. Tien, G., Atkins, M. S., Zheng, B., & Swindells, C. (2010). Measuring situation awareness of surgeons in laparoscopic training. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (pp. 149-152). New York, NY: ACM.
22. Veltman, J. A., & Gaillard, A. W. K. (1996). Physiological indices of workload in a simulated flight task. Biological Psychology, 42, 323-342. doi: 10. 1016/0301-0511(95)05165-1.
23. Veltman, J. A., & Gaillard, A. W. K. (1998). Physiological workload reactions to increasing levels of task difficulty. Ergonomics, 41, 656-669. doi: 10. 1080/001401398186829.
24. Wu, J., & Trivedi, M. M. (2008). Simultaneous eye tracking and blink detection with interactive particle filters. EURASIP Journal on Advances in Signal Processing, 2008(823695), 1-17. doi: 10. 1155/2008/823695.
25. Zheng, B., Jiang, X., Tien, G., Meneghetti, A., Panton, N., & Atkins, M. S. (2012). Workload assessment of surgeons: Correlation between NASA TLX and blinks. Surgical Endoscopy, 26, 2746-2750.
26. Zheng, B., Tien, G., Atkins, S. M., Swindells, C., Tanin, H., Meneghetti, A., & Panton, M. (2011). Surgeon's vigilance in the operating room. American Journal of Surgery, 201, 667-671.