Optical brain imaging to enhance UAV operator training, evaluation, and interface development

Journal of Intelligent and Robotic Systems: Theory and Applications

Volumn 61, Issue 1-4, 2011, Pages 423-443

  Menda, Justin ^a   Hing, James T ^b   Ayaz, Hasan ^a   Shewokis, Patricia A ^a   Izzetoglu, Kurtulus ^a   Onaral, Banu ^a   Oh, Paul ^b  

^a DREXEL UNIVERSITY   (United States)

^b Drexel University   (United States)

Author keywords

fNIR; Optical brain imaging; UAV pilot interface; UAV safety; UAV Training

Indexed keywords

FNIR; OPTICAL BRAIN IMAGING; UAV PILOT INTERFACE; UAV SAFETY; UAV TRAINING;

HUMAN ENGINEERING; INFRARED SPECTROSCOPY; PERSONNEL TRAINING; UNMANNED AERIAL VEHICLES (UAV);

BRAIN;

EID: 79951517537     PISSN: 09210296     EISSN: 15730409     Source Type: Journal    
DOI: 10.1007/s10846-010-9507-7     Document Type: Conference Paper

References (34)

1. Schmidt, J., Parker, R.: Development of a UAV mishap factors database. In: Association of Unmanned Vehicle Systems, pp. 310-315. Washington, DC (1995)
2. CE Rash PA Leduc SD Manning 2006 Human factors in U.S. military unmanned aerial vehicle accidents Human Factors of Remotely Operated Vehicles 7 117 131 10.1016/S1479-3601(05)07009-8 (Pubitemid 43583941)
3. Manning, S., et al.: The role of human causal factors in US army unmanned aerial vehicle accidents, USAARL Report No. 2004-11. U.A.A.R. Laboratory, Editor. Fort Rucker, AL (2004)
4. Shappell, S., Wiegmann, D.: The Human Factors Analysis and Classification System-HFACS. Office of Aviation Medicine, Washington, DC (2000)
5. Hart, S.G., Staveland, L.E.: Development of the NASA-TLX (Task Load Index): results of the experimental and theorectical research. Human Mental Workload, pp. 139-183 (1988)
6. Izzetoglu, M., et al.: Functional brain imaging using near infrared technology for cognitive activity assessment. In: IEEE Engineering in Medicine and Biology Magazine, Special issue on on the Role of Optical Imaging in Augmented Cognition, pp. 38-46 (2007) (Pubitemid 350194208)
7. Weibel, R.E., Hansman, R.J.: Safety Considerations for Operation of Unmanned Aerial Vehicles in the National Airspace System. MIT International Center for Air Transportation, Cambridge (2005)
8. Oh, P.Y., Valavanis, K., Woods, R.: UAV workshop on civilian applications and commercial opportunities. In: IEEE International Conference on Robotics and Automation. Pasedena, CA (2008)
9. Dixon, S.R., Wickens, C.D.: Control of Multiple-UAVs: a workload analysis. In: International Symposium on Aviation Psychology. Dayton, OH (2003)
10. DB Kaber E Onal MR Endley 2000 Design of automation for telerobots and the effect on performance, operator situation awareness, and subjective workload Hum. Factors Ergon. Manuf. 10 4 409 430 10.1002/1520-6564(200023)10:4<409:: AID-HFM4>3.0.CO;2-V
11. R Murphy 2004 Human-robot interaction in rescue robotics IEEE Trans. Syst. Man Cybern. 34 2 138 153 10.1109/TSMCC.2004.826267 2110478
12. Endlesy, M.R.: Design and evaluation for situation awareness enhancements. In: Proceedings of the Human Factors Society 32nd Annual Meeting. Santa Monica, CA (1988)
13. Izzetoglu, K.: Neural correlates of cognitive workload and anesthetic depth: fNIR spectroscopy investigation in humans. In: Biomedical Engineering. Drexel University (2008)
14. DF Dinges JW Powell 1985 Microcomputer analyses of performace on a portable, simple visual RT task during sustained operations Behav. Res. Meth. Instrum. Comput. 17 652 655
15. RC Oldfield 1971 The assessment and analysis of handedness: the Edinburgh inventory Neuropsychologia 9 1 97 113 10.1016/0028-3932(71)90067-4
16. M Izzetoglu, et al. 2007 Functional brain imaging using near-infrared technology IEEE Eng. Med. Biol. Mag. 26 4 38 46 10.1109/MEMB.2007.384094 (Pubitemid 350194208)
17. K Izzetoglu, et al. 2004 Functional optical brain imaging using near-infrared during cognitive tasks Int. J. Hum.-Comput. Interact. 17 2 211 231 10.1207/s15327590ijhc1702-6
18. H Ayaz, et al. 2006 Registering fNIR data to brain surface image using MRI templates Conf. Proc. IEEE Eng. Med. Biol. Soc. 1 2671 2674 10.1109/IEMBS.2006.260835 (Pubitemid 46520458)
19. Green, W.E., Oh, P.Y.: An aerial robot prototype for situational awareness in closed quarters. In: IEEE International Conference on Intelligent Robots and Systems. Las Vegas, NV (2003)
20. T Fong C Thorpe 2001 Vehicle teleoperation interfaces Auton. Robots 11 1 9 18 0983.68555 10.1023/A:1011295826834 (Pubitemid 32650933)
21. JYC Chen EC Haas MJ Barnes 2007 Human performance issues and user interface design for teleoperated robots IEEE Trans. Syst. Man Cybern., Part C Appl. Rev. 37 6 1231 1245 10.1109/TSMCC.2007.905819 (Pubitemid 350130715)
22. Van Erp, J.B.F.: Controlling unmanned vehicles: the human factors solution. In: RTO Meeting Proceedings 44 (RTO-MP-44) B8.1-B8.12 (2000)
23. Glumm, M., Kilduff, P., Masley, A.: A Study on the Effects of Lens Focal Length on Remote Driver Performance. Tech. Rep. ARL-TR-25. Army Research Laboratory (1992)
24. WS Kim B Hannaford AK Fejczy 1992 Force-reflection and shared compliant control in operating telemanipulators with time delay IEEE Trans. Robot. Autom. 8 2 176 185 10.1109/70.134272
25. JT Hing PY Oh 2009 Development of an unmanned aerial vehicle piloting system with integrated motion cueing for training and pilot evaluation J. Intell. Robot. Syst. 54 3 19 10.1007/s10846-008-9252-3
26. K Izzetoglu, et al. 2004 Functional optical brain imaging using near-infrared during cognitive tasks Int. J. Hum.-Comput. Interact. 17 2 211 227 10.1207/s15327590ijhc1702-6 (Pubitemid 39055295)
27. Ayaz, H., et al.: Assessment of Cognitive Neural Correlates for a Functional Near Infrared-Based Brain Computer Interface System. Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience, pp. 699-708 (2009)
28. A Kelly H Garavan 2005 Human functional neuroimaging of brain changes associated with practice Cerebral Cortex 15 1089 1102 10.1093/cercor/bhi005 (Pubitemid 41373603)
29. J Milton S Small A Solodkin 2004 On the road to automatic: dynamic aspects in the development of expertise Clin. Neurophysiol. 21 134 143 10.1097/00004691-200405000-00002 (Pubitemid 40238532)
30. MH Beauchamp, et al. 2003 Dynamic functional changes associated with cognitive skill learning of an adapted version of the Tower of London task NeuroImage 20 1649 1660 10.1016/j.neuroimage.2003.07.003 (Pubitemid 37468271)
31. Drury, J.L., et al.: Comparing situation awareness for two unmanned aerial vehicle human interface approaches. In: Proceedings of the SSRR 2006 Conference, Gaithersburg, MD (2006)
32. JL Drury SD Scott 2008 Awareness in unmanned aerial vehicle operations The International C2 Journal 2 1 1 10
33. Cooper, J., Goodrich, M.A.: Towards combining UAV and sensor operator roles in UAVenabled visual search. Proceedings of ACM/IEEE International Conference on Human-Robot Interaction, pp. 351-358. Amsterdam, The Netherlands (2008)
34. Ayaz, H., et al.: Cognitive workload assessment of air traffic controllers using optical brain imaging sensors. In: Marek, T., Karwowski, W., Rice, V. (eds.) Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations, pp. 21-31. CRC Press Taylor & Francis Group (2010)