Formal detection of attentional tunneling in human operator-automation interactions

IEEE Transactions on Human-Machine Systems

Volumn 44, Issue 3, 2014, Pages 326-336

  Régis, Nicolas ^a   Dehais, Frédéric ^a   Rachelson, Emmanuel ^a   Thooris, Charles ^a,b   Pizziol, Sergio ^c   Causse, Mickaël ^a   Tessier, Catherine ^c  

^a INSTITUT SUPÉRIEUR DE L'AÉRONAUTIQUE ET DE L'ESPACE   (France)

^b Secure IC ^*  (United States)

^c ONERA   (France)

Author keywords

Attentional tunneling; cognitive state inference; fuzzy neural networks; human factors; human robot interaction

Indexed keywords

ARTIFICIAL INTELLIGENCE; COGNITIVE SYSTEMS; FUZZY NEURAL NETWORKS; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; LEARNING SYSTEMS;

ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM; CLASSIFICATION PERFORMANCE; CLASSIFICATION RULES; COGNITIVE STATE; FORMAL APPROACH; INFORMATION SOURCES; PSYCHO-PHYSIOLOGICAL; VISUAL ATTENTION;

RAILROAD TUNNELS;

EID: 84901354834     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/THMS.2014.2307258     Document Type: Article

References (51)

1. D. Crundall, G. Underwood, and P. Chapman, "Driving experience and the functional field of view," Perception, vol. 28, no. 9, pp. 1075-1087, 1999.
2. L. C. Thomas and C. D. Wickens, "Eye-tracking and individual differences in off-normal event detection when flying with a synthetic vision system display," in Human Factors Ergonom. Soc. Annu. Meet. Proc., 2004, vol. 48, pp. 223-227.
3. L. J. Williams, "Tunnel vision induced by a foveal load manipulation," Human Factors, vol. 27, no. 2, pp. 221-227, 1985. (Pubitemid 15060752)
4. S. Plainis, I. J. Murray, and K. Chauhan, "Raised visual detection thresholds depend on the level of complexity of cognitive foveal loading," Perception, vol. 30, no. 10, pp. 1203-1212, 2001. (Pubitemid 33596678)
5. E. A. Newby and I. Rock, "Inattentional blindness as a function of proximity to the focus of attention," Perception, vol. 27, pp. 1025-1040, 1998. (Pubitemid 128445394)
6. C. D. Wickens, "Attentional tunneling and task management," presented at the 13th Int. Symp. Aviation Psychol., Dayton, OH, USA, 2005.
7. L. J. Williams, "Visual field tunneling in aviators induced by memory demands," J. Gen. Psychol., vol. 122, no. 2, pp. 225-235, 1995.
8. F. Dehais, C. Tessier, L. Christophe, and F. Reuzeau, "The perseveration syndrome in the pilot's activity: Guidelines and cognitive countermeasures," Human Error, Safety Syst. Develop., Berlin, Heidelberg: Springer, 2010, pp. 68-80.
9. F. Dehais, M. Causse, and S. Tremblay, "Mitigation of conflicts with automation," Human Factors, vol. 53, no. 5, pp. 448-460, 2011.
10. F. Dehais, C. Tessier, and L. Chaudron, "GHOST: experimenting conflicts countermeasures in the pilot's activity," in Proc. 18th Int. Joint Conf. Artif. Intell., 2003, vol. 18, pp. 163-168.
11. F. Dehais, S. Mercier, and C. Tessier, "Conflicts in human operator-unmanned vehicles interactions," Proc. Eng. Psychol. Cogn. Ergonom., pp. 498-507, 2009.
12. G. F. Wilson and C. Russell, "Operator functional state classification using neural networks with combined physiological and performance features," Proc. Human Factors Ergonom. Soc. Annu. Meet., vol. 43, pp. 1099-1102, 1999.
13. M. S. John, D. A. Kobus, J. G. Morrison, and D. Schmorrow, "Overview of the DARPA augmented cognition technical integration experiment," Int. J. Human-Comput. Interact., vol. 17, no. 2, pp. 131-149, 2004. (Pubitemid 39055291)
14. H. P. Bahrick, P. M. Fitts, and R. E. Rankin, "Effect of incentives upon reactions to peripheral stimuli," J. Exp. Psychol., vol. 44, no. 6, pp. 400-406, 1952.
15. S. Easterbrook, "Handling conflict between domain descriptions with computer-supported negotiation," Knowl. Acquisition, vol. 3, no. 3, pp. 255-289, 1991.
16. G. Weltman, G. H. Egstrom, and R. A. Christianson, "A system for underwater ergometry," in Proc. AIAA/USN 2nd Marine Syst. ASW Conf., 1966.
17. Y. F. Tsai, E. Viirre, C. Strychacz, B. Chase, and T. P. Jung, "Task performance and eye activity: predicting behavior relating to cognitive workload," Aviation, Space, Environ. Med., vol. 78, Suppl. 1, pp. B176-B185, 2007. (Pubitemid 46717225)
18. L. Cowen, L. J. Ball, and J. Delin, "An eyemovement analysis ofwebpage usability," in Proc. People Comput. XVI: Memorable Yet Invisible. New York, NY, USA: Springer, 2002, pp. 317-335.
19. E. Cox, "Fuzzy fundamentals," IEEE Spectrum, vol. 29, no. 10, pp. 58-61, Oct. 1992. (Pubitemid 23585927)
20. R. L. Mandryk and M. S. Atkins, "A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies," Int. J. Human-Comput. Studies, vol. 65, no. 4, pp. 329-347, 2007. (Pubitemid 46216840)
21. S. Pizziol, F. Dehais, and C. Tessier, "Toward human operator's 'state' assessment," in Proc. 1st Autom. Command Control Syst., Barcelona, Spain, 2011, pp. 99-106.
22. J. Friedman, T. Hastie, and R. Tibshirani, The Elements of Statistical Learning. New York, NY, USA: Spinger, 2008.
23. L. M. Bergasa, J. Nuevo, M. A. Sotelo, R. Barea, and M. E. Lopez, "Realtime system for monitoring driver vigilance," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
24. M. Codispoti, M. M. Bradley, and P. J. Lang, "Affective reactions to briefly presented pictures," Psychophysiology, vol. 38, no. 3, pp. 474-478, 2001. (Pubitemid 32422290)
25. J. S. R. Jang and C. T. Sun, "Neuro-fuzzy modeling and control," Proc. IEEE, vol. 83, no. 3, pp. 378-406, Mar. 1995.
26. A. Riid and E. Rüstern, "Transparent fuzzy systems and modeling with transparency protection," in Proc. IFAC Symp. Artif. Intell. Real Time Control, 2000, pp. 229-234.
27. L. A. Zadeh, "Fuzzy logic = Computing with words," IEEE Trans. Fuzzy Syst., vol. 4, no. 2, pp. 103-111, May 1996. (Pubitemid 126780540)
28. M. Causse, B. Baracat, J. Pastor, and F. Dehais, "Reward and uncertainty favor risky decision-making in pilots: evidence from cardiovascular and oculometric measurements," Appl. Psychophysiol. Biofeedback, vol. 36, no. 4, pp. 231-242, 2011.
29. M. Causse, J. M. Sénard, J. F. Démonet, and J. Pastor, "Monitoring cognitive and emotional processes through pupil and cardiac response during dynamic versus logical task," Appl. Psychophysiology Biofeedback, vol. 35, no. 2, pp. 115-123, 2010.
30. M. Causse, F. Dehais, P. Péran, U. Sabatini, and J. Pastor, "The effects of emotion on pilot decision-making:Aneuroergonomic approach to aviation safety," Transp. Res. C, Emerging Technol., vol. 33, pp. 272-281, 2013.
31. F. Dehais, E. A. Sisbot, R. Alami, and M. Causse, "Physiological and subjective evaluation of a human-robot object hand-over task," Appl. Ergonom., vol. 42, pp. 785-791, 2011.
32. R. M. Warner and S. R. Strowman, "Cardiovascular reactivity and positive/negative affect during conversations," J. Behavioral Med., vol. 18, no. 2, pp. 141-159, 1995.
33. G. Parati, J. P. Saul, M. Di Rienzo, and G. Mancia, "Spectral analysis of blood pressure and heart rate variability in evaluating cardiovascular regulation: a critical appraisal," Hypertension, vol. 25, no. 6, pp. 1276-1286, 1995.
34. B. Pomeranz, R. J. Macaulay, M. A. Caudill, I. Kutz, D. Adam, D. Gordon, K. M. Kilborn, A. C. Barger, D. C. Shannon, and R. J. Cohen, "Assessment of autonomic function in humans by heart rate spectral analysis," Amer. J. Physiol.-Heart Circ. Physiol., vol. 248, no. 1, pp. H151-H153, 1985. (Pubitemid 15170666)
35. T. Aubert, J. Corjon, F. Gautreault, M. Laurent, M. Causse, and F. Dehais, "Improving situation awareness of a single human operator interacting with multiple unmanned vehicles: first results," presented at the Human Operating Unmanned Systems, Toulouse, France, 2010.
36. T. Beigbeder, R. Coughlan, C. Lusher, J. Plunkett, E. Agu, and M. Claypool, "The effects of loss and latency on user performance in unreal tournament 2003 ®," in Proc. 3rd ACM SIGCOMM Workshop Netw. Syst. Support Games, 2004, pp. 144-151. (Pubitemid 40062757)
37. M. A. Bonner and G. F. Wilson, "Heart rate measures of flight test and evaluation," Int. J. Aviation Psychol., vol. 12, no. 1, pp. 63-77, 2002. (Pubitemid 37110130)
38. J. Vila, P. Guerra, M. Á. Munõz, C. Vico, M. I. Viedma-del Jesuś, L. C. Delgado, P. Perakakis, E. Kley, J. L. Mata, and S. Rodríguez, "Cardiac defense: From attention to action," Int. J. Psychophysiol., vol. 66, no. 3, pp. 169-182, 2007. (Pubitemid 350180124)
39. S. Folkman, "Personal control and stress and coping processes: A theoretical analysis," J. Pers. Social Psychol., vol. 46, no. 4, pp. 839-852, 1984.
40. M. Sugeno and G. Kang, "Structure identification of fuzzy model," Fuzzy Sets Syst., vol. 28, no. 1, pp. 15-33, 1988.
41. A. Riid, R. Isotamm, and E. Rüstern, "Transparency analysis of first-order Takagi-Sugeno systems," in Proc. 10th Int. Symp. Syst. Model. Control, 2001, pp. 165-170.
42. J. V. De Oliveira, "Semantic constraints for membership function optimization," IEEE Trans. Syst., Man Cybern. A, Syst., Humans, vol. 29, no. 1, pp. 128-138, Jan. 1999.
43. R. Yager and D. Filev, "Generation of fuzzy rules by mountain clustering," J. Intell. Fuzzy Syst., vol. 2, no. 3, pp. 209-219, 1994.
44. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
45. V. N. Vapnik, "An overview of statistical learning theory," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 988-999, Sep. 1999.
46. A. J. Smola and B. Schölkopf, "A tutorial on support vector regression," Statist. Comput., vol. 14, no. 3, pp. 199-222, 2004. (Pubitemid 39063488)
47. V. N. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 2000.
48. S. P. Marshall, "Method and apparatus for eye tracking and monitoring pupil dilation to evaluate cognitive activity," Google Patents, 2000.
49. A. Minassian, E. Granholm, S. Verney, and W. Perry, "Pupillary dilation to simple versus complex tasks and its relationship to thought disturbance in schizophrenia patients," Int. J. Psychophysiol., vol. 52, no. 1, pp. 53-62, 2004. (Pubitemid 38328523)
50. R. Parasuraman and M. Rizzo, Neuroergonomics: The Brain at Work. New York, NY, USA: Oxford Univ. Press, 2007.
51. S. W. Brown, "Time perception and attention: The effects of prospective versus retrospective paradigms and task demands on perceived duration," Perception Psychophys., vol. 38, no. 2, pp. 115-124, 1985.