Combining electrodermal responses and cardiovascular measures for probing adaptive automation during simulated flight

Applied Ergonomics

Volumn 40, Issue 6, 2009, Pages 1026-1040

  Haarmann, Andrea ^a   Boucsein, Wolfram ^a   Schaefer, Florian ^a  

^a UNIVERSITY OF WUPPERTAL   (Germany)

Author keywords

Adaptive automation; Heart rate variability; Skin conductance

Indexed keywords

ELECTRODES; ERGONOMICS; FLIGHT SIMULATORS; HEART;

ADAPTIVE AUTOMATION; ADAPTIVE CONTROL; DIFFERENT STAGES; ELECTRODERMAL RESPONSE; EXPERIMENTAL SUBJECTS; HEART RATE VARIABILITY; SIMULATED FLIGHT; SKIN CONDUCTANCE;

AUTOMATION;

ADULT; ARTICLE; CARDIOVASCULAR FUNCTION; CONTROLLED STUDY; CYBERNETICS; ELECTRODERMAL RESPONSE; FEMALE; FLIGHT; HEART RATE; HEART RATE VARIABILITY; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PSYCHOPHYSIOLOGY; RECORDING; SIMULATOR; TASK PERFORMANCE; WORKLOAD; ADAPTATION; AIRCRAFT; ALGORITHM; ANALYSIS OF VARIANCE; ATTENTION; AVIATION; BIOENGINEERING; CARDIOVASCULAR SYSTEM; COMPARATIVE STUDY; COMPUTER INTERFACE; COMPUTER SIMULATION; DEVICES; ELECTROCARDIOGRAPHY; PERCEPTION;

ADAPTATION, PHYSIOLOGICAL; ADULT; AIRCRAFT; ALGORITHMS; ANALYSIS OF VARIANCE; ATTENTION; AVIATION; CARDIOVASCULAR SYSTEM; COMPUTER SIMULATION; ELECTROCARDIOGRAPHY; FEMALE; GALVANIC SKIN RESPONSE; HEART RATE; HUMAN ENGINEERING; HUMANS; MALE; PERCEPTION; USER-COMPUTER INTERFACE; WORKLOAD;

EID: 68049139257     PISSN: 00036870     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.apergo.2009.04.011     Document Type: Article

References (72)

1. Allanson J., and Fairclough S.H. A research agenda for physiological computing. Interact. Comput. 16 (2004) 857-878
2. Antelmi I., De Paula R.S., Shinzato A.R., Peres C.A., Mansur A.J., and Grupi C.J. Influence of age, gender, body mass index, and functional capacity on heart rate variability in a cohort of subjects without heart disease. Am. J. Cardiol. 93 (2004) 381-385
3. Backs R.W. A comparison of factor analytic methods of obtaining cardiovascular autonomic components for the assessment of mental workload. Ergonomics 41 (1998) 733-745
4. Bailey N.R., Scerbo M.W., Freeman F.G., Mikulka P.J., and Scott L.A. A Comparison of a Brain-based Adaptive System and a Manual Adaptable System for Invoking Automation. NASA technical report (2004), NASA Langley Research Center, Hampton, Virginia
5. Bartenwerfer H. Einige praktische Konsequenzen aus der Aktivierungstheorie. Z. Exp. Angew. Psychol. 16 (1969) 195-222
6. Berntson G.G., Bigger J.T., Eckberg D.L., Grossman P., Kaufmann P.G., Malik M., Nagaraja H.N., Porges S.W., Saul J.P., Stone P.H., and van der Molen M.W. Heart rate variability: origins, methods, and interpretive caveats. Psychophysiology 34 (1997) 623-648
7. Bibian S., Ries C.R., Huzmezan M., and Dumont G.A. Clinical anesthesia and control engineering: terminology, concepts and issues. European Control Conference. Cambridge, UK, September 1-4, 2003. (2003). Available via: http://www.ece.ubc.ca/∼huzmezan/docs/ECC03_ADD.pdf
8. Boucsein W. Electrodermal Activity (1992), Plenum Press, New York
9. Boucsein W., and Backs R.W. Engineering psychophysiology as a discipline: historical and theoretical aspects. In: Backs R.W., and Boucsein W. (Eds). Engineering Psychophysiology. Issues and Applications (2000), Lawrence Erlbaum Associates, Mahwah, N.J. 3-30
10. Boucsein W., and Backs R.W. The psychophysiology of emotion, arousal, and personality: methods and models. In: Duffy V.G. (Ed). Handbook of Digital Human Modeling (2009), Taylor & Francis/CRC Press, Boca Raton 35-1-35-18
11. Boucsein W., Haarmann A., and Schaefer F. The usability of cardiovascular and electrodermal measures for adaptive automation during a simulated IFR flight mission. Psychophysiology 42 (2005) S26
12. Byrne E.A., and Parasuraman R. Psychophysiology and adaptive automation. Biol. Psychol. 42 (1996) 249-268
13. Comstock J.R.J., and Arnegard R.J. The Multi-Attribute Test Battery for Human Operator Workload and Strategic Behavior Research (No. 104174) (1992), National Aeronautics and Space Administration
14. Cox D.J., Kovatchev B.P., Morris J.B., Phillips C., Hill R.J., and Merkel L. Electroencephalographic and psychometric differences between boys with and without attention-deficit/hyperactivity disorder (ADHD): a pilot study. Appl. Psychophysiol. Biofeedback 23 (1998) 179-188
15. Critchley H.D. Electrodermal responses: what happens in the brain. Neuroscientist 8 (2002) 132-142
16. De Waard D., and Mulder L.J.M. Can cardiovascular indices be used to adapt the ambulance dispatch worker's task?. In: Pikaar R.N., Koningsveld E.A.P., and Settels P.J.M. (Eds). Proceedings IEA 2006 Congress: Meeting Diversity in Ergonomics (2006), Elsevier, Amsterdam
17. Eilers K., Nachreiner F., and Hänecke K. Entwicklung und Überprüfung einer Skala zur Erfassung subjektiv erlebter Anstrengung (The development and testing of a scale to validation for recording subjectively experienced effort). Z. Arbeitswiss. 40 (1986) 215-224
18. Endsley M.R. Automation and situation awareness. In: Parasuraman R., and Mouloua M. (Eds). Automation and Human Performance: Theory and Applications (1996), Lawrence Erlbaum Associates, Hillsdale, N.J. 163-181
19. Fahrenberg J., and Wientjes C.J.E. Recording methods in applied environments. In: Backs R.W., and Boucsein W. (Eds). Engineering Psychology: Issues and Applications (2000), Lawrence Erlbaum Associates, Mahwah, N.J. 111-136
20. Fairclough, S.H., 2007. Psychophysiological inference and physiological computer games. Workshop of the International Conference on Advances in Computer Entertainment Technology (ACE). BrainPlay '07: Playing with your brain. Brain-computer interfaces and games. Online document: http://hmi.ewi.utwente.nl/brainplay07_files/brainplay07.pdf#page=11, pp. 19-24.
21. Fairclough S., Venables L., and Tattersall A.J. The use of autonomic measures for biocybernetic adaptation. Psychophysiology 42 Suppl. 1 (2005) S25
22. Fowles D.C., Christi M.J., Edelberg R., Grings W.W., Lykken D.T., and Venables P.H. Publication recommendations for electrodermal measurements. Psychophysiology 18 (1981) 232-239
23. Freeman F.G., Mikulka P.J., Prinzel L.J., and Scerbo M.W. Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biol. Psychol. 50 (1999) 61-76
24. Freeman F.G., Mikulka P.J., Scerbo M.W., Prinzel L.J., and Clouatre K. Evaluation of a psychophysically controlled adaptive automation system, using performance on a tracking task. Appl. Psychophysiol. Biofeedback 25 (2000) 103-115
25. Haarmann, A., 2007. Der Einsatz psychophysiologischer Variablen bei der adaptiven Automatisierung am Beispiel einer Flugsimulationsaufgabe (Application of psychophysiological measures for adaptive automation during simulated flight). Doctoral thesis. University of Wuppertal.
26. Hadley, J., Mikulka, P.J., Freeman, F.G., Scerbo, M.W., Prinzel III, L.J., 1997. Psychophysiological evaluation of a biocybernetic system for adaptive automation. In: Paper Presented at the 9th Symposium on Aviation Psychology, Columbus, Ohio.
27. Hadley G.A., Prinzel III L.J., Freeman F.G., and Mikulka P.J. Behavioral, subjective, and psychophysiological correlates of various schedules of short-cycle automation. In: Scerbo M.W., and Mouloua M. (Eds). Automation Technology and Human Performance: Current Research and Trends (1999), Lawrence Erlbaum Associates, Mahwah, N.J. 139-143
28. Halder S., Bensch M., Mellinger J., Bogdan M., Kübler A., Birbaumer N., and Rosenstiel W. Online artifact removal for brain-computer interfaces using support vector machines and blind source separation. Comput. Intell. Neurosci. (2007) 10 pp. (online document)
29. Hart S.G., and Staveland L.E. Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock P.A., and Meshkati N. (Eds). Human Mental Workload (1988) 139-183 North-Holland, Amsterdam
30. Hart S.G., and Wickens C.D. Workload assessment and prediction. In: Booher H.R. (Ed). MANPRINT: an Approach to Systems Integration (1990), Van Nostrand Reinhold, New York 257-296
31. Hugdahl K. Psychophysiology. The Mind-Body Perspective (1995), Harvard University Press, Cambridge pp. 167-196
32. Isshiki H., and Yamamoto Y. Instrument for monitoring arousal level using electrodermal activity. Instrumentation and Measurement Technology Conference, 10-12 May 1994. IMTC/94. Conference Proceedings. 10th Anniversary. Advanced Technologies in I. & M., 1994. IEEE vol. 2 (1994) pp. 975-978
33. Junker A., Berg C., Schneider P., and McMillan G. Evaluation of the Cyberlink™ Interface as an Alternative Human Operator Controller (AL/CF-TR-1995-0011). Technical Report (November 1995), Wright-Patterson Air Force Base, Armstrong Laboratory, Ohio
34. Kellar M.A., Folen R.A., Cowings P.S., Toscano W.B., and Hisert G.L. Autogenic-feedback training improves pilot performance during emergency flying conditions. NASA Tech. Mem. 104005 (1993), NASA-Ames Research Center, Moffett Field, CA
35. Kuikkaniemi, K., Kosunen, I., 2007. Progressive system architecture for building emotionally adaptive games. Workshop of the International Conference on Advances in Computer Entertainment Technology (ACE). BrainPlay '07: Playing with your brain. Brain-computer interfaces and games. Online document: http://hmi.ewi.utwente.nl/brainplay07_files/brainplay07.pdf#page=11, pp. 33-35.
36. Laufer L., and Nemeth B. Skin Signals Betray a Gamer's Moves (2007). Online document: www.newscientist.com/blog/technology/2007/08/skin-signals-betray-gamers-moves.html
37. Lenneman J.K., and Backs R.W. The validity of factor analytically derived cardiac autonomic components for mental workload assessment. In: Backs R.W., and Boucsein W. (Eds). Engineering Psychophysiology: Issues and Applications (2000), Lawrence Erlbaum Associates, Mahwah, N.J. 161-175
38. Levy M.N. Neural control of cardiac function. Baillieres Clin. Neurol 6 (1997) 227-244
39. Lubar J.F. Discourse on the development of EEG diagnostics and biofeedback for attention-deficit/hyperactivity disorders. Biofeedback Self Regul. 16 (1991) 201-225
40. Lubar J.F., Swartwood M.O., Swartwood J.N., and O'Donnell P.H. Evaluation of the effectiveness of EEG neurofeedback training for ADHD in a clinical setting as measured by changes in T.O.V.A. scores, behavioral ratings, and WISC-R performance. Biofeedback Self Regul. 20 (1995) 83-99
41. Manzey D. Psychophysiologie mentaler Beanspruchung. In: Rösler F. (Ed). Enzyklopädie der Psychologie. Themenbereich C: Theorie und Forschung. Serie I: Biologische Psychologie, Band 5: Ergebnisse und Anwendungen der Psychophysiologie (1998), Hogrefe, Göttingen 799-864
42. Metz S., and Hoffman B. Mind operated devices. Cogn. Technol. 2 (1997) 69-72
43. Mikulka, P., Hadley, G., Freeman, F., Scerbo, M., 1999. The effects of a biocybernetic system on vigilance decrement. In: Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting, 1410.
44. Morrison J.G., and Gluckman J.P. Definitions and prospective guidelines for the application of adaptive automation. In: Mouloua M., and Parasuraman P. (Eds). Human Performance in Automated Systems: Current Research and Trends (1994), Lawrence Erlbaum Associates, Hillsdale, N.J. 256-263
45. Mulder L.J.M., Van Roon A., Veldman H., Laumann K., Burov O., Quispel L., and Hoogeboom P. How to use cardiovascular state changes in adaptive automation. In: Hockey G.R.J., Gaillard A.W.K., and Burov O. (Eds). Operator Functional State (2003), IOS Press, Amsterdam 260-272
46. Nishimura C., and Nagumo J.I. Feedback control of the level of arousal using skin potential level as an index. Ergonomics 28 (1985) 905-913
47. Obrist P.A. Cardiovascular Psychophysiology (1981), Plenum Press, New York
48. Offenloch K., and Zahner G. Computer aided physiological assessment of the functional state of pilots during simulated flight. NATO Advisory Group for Aerospace Research and Development Conference Proceedings 490 (1990) pp. 9-1-9-9
49. O'Hanlon J.F. Boredom: practical consequences and a theory. Acta Psychol. 49 (1981) 53-82
50. Parasuraman R. Adaptive automation matched to human mental workload. In: Hockey G.R.J., Gaillard A.W.K., and Burov O. (Eds). Operator Functional State (2003), IOS Press, Amsterdam 177-193
51. Parente M.A., and Parente R. Mind-operated devices: mental control of a computer using biofeedback. Cyberpsychol. Behav. 9 (2006) 1-4
52. Pope A.T., and Bogart E.H. Identification of hazardous awareness states in monitoring environments. SAE Trans.: J. Aerosp. 101 (1992) 449-457
53. Pope A.T., Bogart E.H., and Bartolome D.S. Biocybernetic system evaluates indices of operator engagement in automated task. Biol. Psychol. 40 (1995) 187-195
54. Prinzel III L.J., Parasuraman R., Freeman F.G., Scerbo M.W., Mikulka P.J., and Pope A.T. Three Experiments Examining the Use of Electroencephalogram, Event-related Potentials, and Heart-rate Variability for Real-time Human-centered Adaptive Automation Design. NASA/TP-2003-212442 (2003), NASA Langley Research Center, Hampton, Virginia pp. 1-62
55. Prinzel III L.J., Pope A.T., and Freeman F.G. Application of Physiological Self-regulation and Adaptive Task Allocation Techniques for Controlling Operator Hazardous States of Awareness (2001), NASA Langley Research Center, Hampton, Virginia pp. 1-17
56. Prinzel III L.J., Pope A.T., and Freeman F.G. Physiological Self-regulation and Adaptive Automation. NASA technical report (2007), NASA Langley Research Center, Hampton, Virginia
57. Richter P., Debitz U., and Schulze F. Diagnostik von Arbeitsanforderungen und kumulativen Beanspruchungsfolgen am Beispiel eines Call Centers (Diagnostic of job demands and cumulating strain consequences in call center jobs). Z. Arbeitswiss. 1-2 (2002) 67-75
58. Scallen S.F., Hancock P.A., and Duley J.A. Pilot performance and preference for short cycles of automation in adaptive function allocation. Appl. Ergon. 26 (1995) 397-403
59. Scerbo M.W., Freeman F.G., and Mikulka P.J. A biocybernetic system for adaptive automation. In: Backs R.W., and Boucsein W. (Eds). Engineering Psychophysiology. Issues and Applications (2000), Lawrence Erlbaum Associates, Mahwah, N.J. 241-253
60. Scerbo M.W., Freeman F.G., Mikulka P.J., Parasuraman R., Di Nocera F., and Prinzel III L.J. The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology (2001), NASA Langley Research Center, Hampton, Virginia pp. 1-66
61. Schwilden H., Stoeckel H., and Schüttler J. Closed-loop feedback control of Propofol anaesthesia by quantitative EEG analysis in humans. Br. J. Anaesth. 62 (1989) 290-296
62. Simanski, O., Kähler, R., Pohl, B., Hofmockel, R., Friedrich, R., Lampe, B.P., 2003. Measurement and control of neuromuscular blockade and depth of anaesthesia. In: Proceedings of the 7th European Control Conference, Cambridge (UK), 2003.
63. Streitberg B., Röhmel J., Herrmann W.M., and Kubicki S. COMSTAT rule for vigilance classification based on spontaneous EEG activity. Neuropsychobiology 17 (1987) 105-117
64. Van Dellen H.J., Aasman J., Mulder L.J.M., and Mulder G. Time domain versus frequency domain measures of heart-rate variability. In: Orlebeke J.F., Mulder G., and van Doornen L.J.P. (Eds). Psychophysiology of Cardiovascular Control (1985), Plenum Press, New York 353-374
65. Veltman H.J.A., and Gaillard A.W.K. Physiological indices of workload in a simulated flight task. Biol. Psychol. 42 (1996) 323-342
66. Veltman H.J.A., and Jansen C. The adaptive operator. In: Vincenzi D.A., Mouloua M., and Hancock P.A. (Eds). Human performance, situation awareness and automation: Current research and trends vol. II (2004), Lawrence Erlbaum Associates, Mahwah, N.J. 7-10
67. Wallin B.G. Sympathetic nerve activity underlying electrodermal and cardiovascular reactions in man. Psychophysiology 18 (1981) 470-476
68. Wilson G.F. An analysis of mental workload in pilots during flight using multiple psychophysiological measures. Int. J. Aviat. Psychol. 12 (2002) 3-18
69. Wilson G.F., and Eggemeier F.T. Psychophysiological assessment of workload in multi-task environments. In: Damos D.L. (Ed). Multiple-task Performance (1991), Taylor & Francis, London, Washington, D.C. 329-360
70. Wientjes C.J.E. Respiration in psychophysiology: methods and applications. Biol. Psychol. 34 (1992) 179-203
71. Wright N., and McGown A. Vigilance on the civil flight deck: incidence of sleepiness and sleep during long-haul flights and associated changes in physiological parameters. Ergonomics 44 (2001) 82-116
72. Yamamoto Y., and Isshiki H. Instrument for controlling drowsiness using galvanic skin reflex. Med. Biol. Eng. Comput. 30 (1992) 562-564