A real-time eye tracking system for predicting and preventing postcompletion errors

Human-Computer Interaction

Volumn 26, Issue 3, 2011, Pages 205-245

  Ratwani, Raj M ^a   Trafton, J Gregory ^b  

^a GEORGE MASON UNIVERSITY   (United States)

^b NAVAL RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERROR PREDICTION; ERROR PRONES; EYE-TRACKING; PREDICTIVE VALUES; PROCEDURAL ERRORS; REAL-TIME EYE TRACKING; RECEIVER OPERATING CHARACTERISTICS;

EYE MOVEMENTS; FORECASTING; REAL TIME SYSTEMS;

ERRORS;

EID: 80052400863     PISSN: 07370024     EISSN: None     Source Type: Journal    
DOI: 10.1080/07370024.2011.601692     Document Type: Article

References (63)

1. Altmann, E. M., & Trafton, J. G. (2002). Memory for goals: An activation-based model. Cognitive Science, 26, 39-83.
2. Altmann, E. M., & Trafton, J. G. (2007). Timecourse of recovery from task interruption: Data and a model. Psychonomics Bulletin and Review, 14, 1079-1084.
3. Baars, B. J. (1992). The many uses of error: Twelve steps to a unified framework. In B. J. Baars (Ed.), Experimental slips and human errors: Exploring the architecture of volition (pp. 3-34). New York, NY: Plenum.
4. Barber, C., & Stanton, N. A. (1996). Human error identification techniques applied to public technology: Predictions copared with observed use. Applied Ergonomics, 27, 119-131. (Pubitemid 26106582)
5. Boehm-Davis, D. A., & Remington, R. (2009). Reducing the disruptive effects of interruption: A cognitive framework for analysing the costs and benefits of intervetion strategies. Accident Analysis and Prevention, 41, 1124-1129.
6. Burke, M., Hornof, A., Nilsen, E., & Gorman, N. (2005). High-cost banner blindness: Ads increase perceived workload, hinder visual search, and are forgotten. ACM Transactions on Computer-Human Interaction, 12, 423-445. (Pubitemid 43892806)
7. Byrne, M. D. (2008). Preventing postcompletion errors: How much cue is enough? In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the Thirtieth Annual Conference of the Cognitive Science Society (pp. 351-356). Austin, TX: Cognitive Science Society.
8. Byrne, M. D., & Bovair, S. (1997). A working memory model of a common procedural error. Cognitive Science, 21(1), 31-61. (Pubitemid 127160252)
9. Byrne, M. D., & Davis, E. M. (2006). Task structure and postcompletion error in the execution of a routine procedure. Human Factors, 48, 627-638. (Pubitemid 46036192)
10. Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., & Shneiderman, B. (2004). Determining causes and severity of end-user frustration. International Journal of Human-Computer Interaction, 17, 333-356.
11. Chou, C. D., & Funk, K. (1990). Management of multiple tasks: Cockpit task management errors. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics (pp. 470-474). New York, NY: IEEE.
12. Chung, P. H., & Byrne, M. D. (2008). Cue effectiveness in mitigating postcompletion errors in a routine procedural task. International Journal of Human-Computer Studies, 66, 217-232. (Pubitemid 351726243)
13. Cooper, R. P., & Shallice, T. (2000). Contention scheduling and the control of routine activities. Cognitive Neuropsychology, 17, 297-338. (Pubitemid 30321682)
14. Czerwinski, M., Cutrell, E., & Horovitz, E. (2000). Instant messaging: Effects of relevance and time. Proceedings of CHI 2000 Conference. New York, NY: ACM.
15. Dehais, F., Causse, M., & Pastor, J. (2008). Embedded eye tracker in real aircraft: new perspectives on pilot/aircraft interaction monitoring. ICRAT 2008.
16. De Santis, A., & Iacoviello, D. (2009). Robust real time eye tracking for computer interface for disabled people. Computer Methods and Programs in Biomedicine, 96, 1-11.
17. Dodhia, R. M., & Dismukes, R. K. (2009). Interruptions create prospective memory tasks. Applied Cognitive Psychology, 23, 73-89.
18. Donmez, B., Boyle, L., & Lee, J. D. (2007). Safety implications of providing real-time feedback to distracted drivers. Accident Analysis and Prevention, 39, 581-590. (Pubitemid 46659840)
19. Eichele, T., Debener, S., Calhoun, V. D., Specht, K., Engel, A. K., Hugdahl, K., : : : Ullsperger, M. (2008). Prediction of human errors by maladapative changes in even-related brain networks. Proceedings of the National Academy of Sciences, 105, 6173-6178. (Pubitemid 351758418)
20. Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27, 861-874.
21. Gray, W. D. (2000). The nature and processing of errors in interactive behavior. Cognitive Science, 24, 205-248.
22. Gray, W. D. (2004). Errors in interactive behavior. In W. S. Bainbridge (Ed.), Encyclopedia of human-computer interaction (pp. 230-235). Great Barrington, MA: Berkshire.
23. Heiner, A., & Asokan, N. (2008). Using salience differentials to making visual cues noticeable. Proceedings of the 1st Conference on Usability, Psychology, and Security. New York, NY: ACM.
24. Hodgetts, H. M., & Jones, D. M. (2006a). Contextual cues aid recovery from interruption: The role of associative activation. Journal of Experimental Psychology: Learning, Memory & Cognition, 32, 1120-1132. (Pubitemid 44343921)
25. Hodgetts, H. M., & Jones, D. M. (2006b). Interruption of the Tower of London task: Support for a goal activation approach. Journal of Experimental Psychology: General, 135, 103-115. (Pubitemid 43283740)
26. Ji, Q., Zhu, Z., & Lan, P. (2004). Real-time nonintrusive monitoring and prediction of driver fatigue. IEEE Transactions on Vehicular Technology, 53, 1052-1068.
27. Just, M. A., & Carpenter, P. A. (1976). Eye fixations and cognitive processes. Cognitive Psychology, 8, 441-480.
28. Kirwan, B. (1992a). Human error identification in human reliability assessment. Part 1: Overview of approaches. Applied Ergonomics, 23, 299-318.
29. Kirwan, B. (1992b). Human error identification in human reliability assessment. Part 2: Detailed comparison of techniques. Applied Ergonomics, 23, 371-381. (Pubitemid 23024412)
30. Koppel, R., Metlay, J. P., Coehn, A., Abaluck, B., Localio, A. R., Kimmel, S. E., & Strom, B. L. (2005). Role of computerized physician order entry systems in facilitating medication errors. Journal of American Medical Association(293), 1197-1203. (Pubitemid 40327905)
31. Li, S. Y. W., Blandford, A., Cairns, P., & Young, R. M. (2008). The effect of interruptions on postcompletion and other procedural errors: An account based on the activation-based goal memory model. Journal of Experimental Psychology: Applied, 14, 314-328.
32. Li, S. Y. W., Cox, A. L., Blandford, A., Cairns, P., & Abeles, A. (2006). Further investigations into post-completion error: The effects of interruption position and duration. Proceedings of the Twenty-Eighth Annual Meeting of the Cognitive Science Society. Mahwah, NJ: Erlbaum.
33. Loukopoulos, L. D., Dismukes, R. L., & Barshi, I. (2001). Cockpit interruptions and distractions: A line observation study. In R. Jensen (Ed.), Proceediings of the 11th International Symposium on Aviation Psychology. Columbus: Ohio State University Press.
34. Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user's guide. Mahwah, NJ: Erlbaum.
35. Marshall, P. (2007). Indentifying cognitive state from eye metrics. Aviation, Space and Environmental Medicine, 78(1), B165-B175.
36. Monk, C. A., Trafton, J. G., & Boehm-Davis, D. A. (2008). The effect of interruption duration and demand on the resumpting suspended goals. Journal of Experimental Psychology: Applied, 14, 299-313.
37. Norman, D. A. (1981). Categorization of action slips. Psychological Review, 88(1), 1-15.
38. National Transportation and Safety Board. (2005). Railraod accident report. Washington, DC: Author.
39. Peng, C.-Y. J., Lee, K. L., & Ingersoll, G. M. (2002). An introduction to logistic regression analysis and reporting. The Journal of Educational Research, 96, 3-14.
40. Perrow, C. (1999). Normal accidents: Living with high-risk technologies. Princeton, NJ: Princeton University Press.
41. Pompei, F. J., Sharon, T., Buckley, S. J., & Kemp, J. (2002). An automobile-integrated system for assessing and reacting to driver cognitive load. In Proceedings of Convergence 2002 (pp. 411-416). Piscataway, NJ: IEEE SAE.
42. Rasmussen, J. (1982). Human errors: A taxonomy for describing human malfunction in industrial installations. Journal of Occupational Accidents, 4, 311-335.
43. Rasmussen, J., & Jensen, A. (1974). Mental procedures in real-life tasks: A case study of electronic troubleshooting. Ergonomics, 17, 293-307.
44. Ratwani, R. M., McCurry, J. M., & Trafton, J. G. (2008). Predicting postcompletion errors using eye movements. In M. Czerwinski, A. M. Lund, & D. S. Tan (Eds.), Proceedings of the 2008 Conference on Human Factors in Computing Systems, CHI 2008 (pp. 539-542). New York, NY: ACM.
45. Ratwani, R. M., & Trafton, J. G. (2008). Spatial memory guides task resumption. Visual Cognition, 16, 1001-1010.
46. Ratwani, R. M., & Trafton, J. G. (2009). Developing a predictive model of postcompletion errors. Proceedings of the 31st Annual Meeting of the Cognitive Science Society. Red Hook, NY: Curran.
47. Ratwani, R. M., & Trafton, J. G. (2010a). A generalized model for predicting postcompletion errors. Topics in Cognitive Science, 2, 154-167.
48. Ratwani, R. M., & Trafton, J. G. (2010b). Single operator, multiple robots: An eye movement based theoretic model of operator situation awareness. Proceedings of the 5th ACM/IEEE Conference on Human Robot Interaction. New York, NY: ACM.
49. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 85, 618-660.
50. Reason, J. (1990). Human error. New York, NY: Cambridge University Press.
51. Schnell, T., & Wu, T. (2000). Applying eye tracking as an alternative approach for activation of controls and functions in aircraft. Proceedings of the 5th International Conference on Human Interaction with Complex Systems. New York, NY: ACM.
52. Sellen, A. J., & Norman, D. A. (1992). The psychology of slips. In B. J. Baars (Ed.), Experimental slips and human error: Exploring the architecture of volition (pp. 317-339). New York, NY: Plenum.
53. Shappell, S. A., & Wiegmann, D. A. (2001). Applying reason: The human factors analysis and classification system (HFACS). Human Factors and Aerospace Safety, 1(1), 59-86.
54. Stanton, N. A., & Stevenage, S. V. (1998). Learning to predict human error: Issues of acceptability, reliability and validity. Ergonomics, 41, 1737-1756. (Pubitemid 28497654)
55. Swets, J. A. (ed.) (1964). Signal detection and recognition by human observers. New York, NY: Wiley.
56. Swets, J. A. (1986a). Form of empirical ROCs in discrimination and diagnostic tasks: Implications for theory and measurement of performance. Psychological Bulletin, 99, 181-198.
57. Swets, J. A. (1986b). Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychological Bulletin, 99(1), 100-117.
58. Swets, J. A. (1992). The science of choosing the right decision threshold in high-stakes diagnostics. American Psychologist, 47, 522-532.
59. Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics (4th ed.). Needham Heights, MA: Allyn & Bacon.
60. Trafton, J. G., Altmann, E. M., & Brock, D. P. (2005). Huh, what was I doing? How people use environmental cues after an interruption. Proceedings of the 49th. Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: HFES.
61. Trafton, J. G., Altmann, E. M., Brock, D. P., & Mintz, F. E. (2003). Preparing to resume an interrupted task: Effects of prospective goal encoding and retrospective rehearsal. International Journal of Human-Computer Studies, 58, 583-603.
62. Trafton, J. G., Altmann, E. M., & Ratwani, R. M. (2009). A memory for goals model of sequence errors. 9th International Conference on Cognitive Modeling-ICCM2009.
63. Wilson, G. F., & Russell, C. A. (2003). Operator functional state classification using multiple psychophysiological features in an air traffic control task. Human Factors, 45, 381-389. (Pubitemid 37509591)