Classifying human operator functional state based on electrophysiological and performance measures and fuzzy clustering method

Cognitive Neurodynamics

Volumn 7, Issue 6, 2013, Pages 477-494

  Zhang, Jian Hua ^a   Peng, Xiao Di ^a   Liu, Hua ^a   Raisch, Jörg ^b,c   Wang, Ru Bin ^a  

^a EAST CHINA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^c MAX PLANCK INSTITUTE FOR DYNAMICS OF COMPLEX TECHNICAL SYSTEMS   (Germany)

Author keywords

Feature extraction; Fuzzy c means algorithm; Operator functional state; Pattern classification; Psychophysiological measures

Indexed keywords

ADULT; ARTICLE; AUTOMATION; CLASSIFICATION; CLINICAL EFFECTIVENESS; CONTROLLED STUDY; EXPERIMENTAL STUDY; FEASIBILITY STUDY; FUZZY SYSTEM; HUMAN; HUMAN EXPERIMENT; MALE; MAN MACHINE INTERACTION; NONLINEAR SYSTEM; NORMAL HUMAN; OPERATOR; OPERATOR FUNCTIONAL STATE; PSYCHOPHYSIOLOGY; TASK PERFORMANCE; UNCERTAINTY;

EID: 84888129634     PISSN: 18714080     EISSN: 18714099     Source Type: Journal    
DOI: 10.1007/s11571-013-9243-3     Document Type: Article

References (58)

1. Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum, New York
2. Chen Z, Cao J, Cao Y et al (2008) An empirical EEG analysis in brain death diagnosis for adults. Cogn Neurodyn 2:257-271
3. Comstock JR, Arnegard RJ (1992) The multi-attribute task battery for human operator workload and strategic behavior research. NASA Tech, Memo
4. Conway G (2005) Effects of workload, effort and fatigue on complex performance: application and tests of compensatory control theory, PhD dissertation, University of Leeds, UK
5. Conway G (2006) Noise and cyclic loading effects on performance and operator functional state. In: Proceedings of the HFES conference, San Francisco, CA, pp 1435-1438
6. De Waard D (1996) The measurement of driver's mental workload, PhD dissertation, University of Groningen, The Netherlands
7. Fahrenberg J, Wientjes CWJ (2000) Recording Methods in Applied Environments. In: Backs RW, Boucsein W (eds) Engineering psychology: issues and applications. Erlbaum, Mahwah, pp 111-136
8. Freedman FG, Mikulka PJ, Prinzel LJ, Scerbo MW (1999) Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biol Psychol 50:61-76
9. Gao J, Hu J, Tung W-W (2011) Complexity measures of brain wave dynamics. Cogn Neurodyn 5:171-182
10. Gevins A, Smith ME (1999) Detecting transient cognitive impairment with EEG pattern recognition methods. Aviat Space Environ Med 70:1018-1024
11. Gevins A, Smith ME (2003) Neurophysiological measures of cognitive workload during human-computer interactions. Theor Issues Ergon Sci 4:113-131
12. Gevins A, Smith ME, McEvoy L, Yu D (1997) High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cereb Cortex 7:374-385
13. Gevins A, Smith ME, Leong H, Mcevoy L, Whitfield S, Du R, Rush G (1998) Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum Factors 40:79-91
14. Helton WS, Warm JS, Tripp LD, Matthews G, Parasuraman R, Hancock PA (2010) Cerebral lateralization of vigilance: a function of task difficulty. Neuropsychologia 48:1683-1688
15. Hockey GRJ (2003) Operator functional state: the assessment and prediction of human performance degradation in complex tasks. IOS Press, US
16. Hockey GRJ (2005) Operator functional state: the prediction of breakdown in human performance. In: Duncan J, McLeod P, Phillips L (eds) Speed, control and age: in honor of Patrick rabbit. Oxford University Press, Oxford, pp 373-394
17. Hockey GRJ, Wastell DG, Sauer J (1998) Effects of sleep deprivation and user-interface on complex performance: a multilevel analysis of compensatory control. Hum Factors 40:233-253
18. Hockey GRJ, Nickel P, Roberts AC, Roberts MH (2009) Sensitivity of candidate markers of psychophysiological strain to cyclical changes in manual control load during simulated process control. Appl Ergon 40:1011-1018
19. Izso L, Lang E (2000) Heart period variability as mental effort monitor in human computer interaction. Behav Inf Tech 19:297-306
20. Jasper HH (1958) Report of the committee on methods of clinical examination in electroencephalography. Electroencephalogr Clin Neurophysiol 10:370-375
21. Jung T-P, Makeig S, Stensmo M, Sejnowski TJ (1997) Estimating alertness from the EEG power spectrum. IEEE Trans Biomed Eng 44(1):60-69
22. Kristjansson SD, Stern JA, Brown TB, Rohrbaugh JW (2009) Detecting phasic lapses in alertness using pupillometric measures. Appl Ergon 40:978-986
23. Lin C-T, Ko L-W, Chung I-F, Huang T-Y, Chen Y-C, Jung T-P, Liang S-F (2006) Adaptive EEG-based alertness estimation system by using ICA-based fuzzy neural networks. IEEE Trans Circuits Syst I 53(11):2469-2475
24. Lin C-T, Chung I-F, Ko L-W, Chen Y-C, Liang S-F, Duann J-R (2007) EEG-based assessment of driver cognitive responses in a dynamic virtual-reality driving environment. IEEE Trans Biomed Eng 54(7):1349-1352
25. Lin C-T, Ko L-W, Shen T-K (2009) Computational intelligent brain computer interaction and its applications on driving cognition. IEEE Computational Intelligence Magazine pp 33-46
26. Lorenz B (2002) Detection and prediction of an automation-induced state of impaired operator competence. In: Proceedings of NATO ARW on Operator Functional State, II Ciocco
27. Lorenz B, Parasuraman R (2003) Human operator functional state in automated systems: the role of compensatory control strategies. In: Hockey GRJ, Gaillard AWK, Burov O (eds) Operator functional state: the assessment and prediction of human performance degradation in complex tasks. IOS, Amsterdam, pp 224-237
28. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Ann Rev Neurosci 24:167-202
29. Mulder G, Mulder LJM, Meijman TF, Veldman JBP, van Roon AM (2000) Psychophysiological approach to working conditions. In: Backs RW, Boucsein W (eds) Engineering psychophysiology: issues and applications. Erlbaum, Mahwah, pp 139-159
30. Nickel P, Nachreiner F (2003) Sensitivity and diagnosticity of the 0.1 Hz component of heart rate variability as an indicator of mental workload. Hum Factors 45:575-590
31. Nickel P, Roberts AC, Hockey GRJ (2005) Assessment of high risk operator functional state markers in dynamical systems-preliminary results and implications. In: Proceedings of human factors and ergonomics Society Europe chapter annual meeting 2005, Turin, Italy, Oct 26-28 2005
32. Nickel P, Hockey GRJ, Roberts AC, Roberts MH (2006) Markers of high risk operator functional state in adaptive control of process automation. In: Proceedings of IEA
33. Nikolaev AR, Ivanitskii GA, Ivanitskii AM (1998) Reproducible EEG alpha-patterns in psychological task solving. Hum Physiol 24:261-268
34. Onton J, Delorme A, Makeig S (2005) Frontal midline EEG dynamics during working memory. Neuroimage 27:341-356
35. Parasuraman R, de Visser E, Clarke E, McGarry WR, Hussey E, Shaw T, Thompson JC (2009) Detecting threat-related intentional actions of others: effects of image quality, response mode and target cuing on vigilance. J Exp Psychol Appl 15(4):275-290
36. Parsuraman R, Masalonis AJ, Hancock PA (2000) Fuzzy signal detection theory: basic postulates and formulas for analyzing human and machine performance. Hum Factors 42:636-659
37. Pattyn N, Neyt X, Henderickx D, Soetens E (2008) Psychophysiological investigation of vigilance decrement: boredom or cognitive fatigue? Physiol Behav 93:369-378
38. Pockett S, Whalen S, McPhail AVH, Freeman WJ (2007) Topography, independent component analysis and dipole source analysis of movement related potentials. Cogn Neurodyn 1:327-340
39. Pope AT, Bogart EH, Bartolome DS (1995) Biocybernetic system evaluates indices of operator engagement in automated task. Biol Psychol 40:187-195
40. Qin P-P, Zhang J-H (2012) Analysis of operator functional state in human-machine systems based on a LSSVM regression modeling approach (in Chinese). Space Med Med Eng 25(1):35-41
41. Royall DR, Lauterbach EC, Cummings JL, Reeve A, Rummans TA, Kaufer DI, LcFrance WC Jr, Coffey CE (2002) Executive control function: a review of its promise and challenges for clinical research. J Neuropsychiatry Clin Neurosci 14(4):377-405
42. Russell CA, Wilson GF (1998) Air traffic controller functional state classification using neural networks. In: Proceedings of the artificial neural networks in engineering conference, vol 8, pp 649-654
43. Scerbo MW, Freeman FG, Mikulka P (2003) A brain-based system for adaptive automation. Theor Issues Ergon Sci 4:200-219
44. Schacter DL (1977) EEG theta waves and psychological phenomena: a review and analysis. Biol Psychol 5:47-82
45. Schiff SJ (2011) Neural control engineering: the emerging intersection between control theory and neuroscience. MIT Press, Cambridge
46. Smith ME, Gevins A, Brown H, Karnik A, Du R (2001) Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Hum Factors 43:366-380
47. Tattersall AJ, Hockey GRJ (1995) Level of operator control and changes in heart rate variability during simulated flight maintenance. Hum Factors 37:682-698
48. Werner G (2012) From brain states to mental phenomena via phase space transitions and renormalization group transformation: proposal of a theory. Cogn Neurodyn 6:199-202
49. Wilson GF (1999) Operator functional state classification using neural networks with combined psychological and performance measures. In: Proceedings of the 43rd HFES annual meeting, pp 1099-1102
50. Wilson GF, Eggemerier FT (1991) Physiological measures of workload in multi-task environments. In Damos DL (ed) Multiple-task performance. Taylor and Francis, London, pp 329-360
51. Wilson GF, Fisher F (1991) The use of cardiac and eye blink measures to determine flight segment in F4 crews. Aviat Space Environ Med 62:959-961
52. Wilson GF, Fisher F (1995) Cognitive task classification based upon topographic EEG data. Biol Psychol 40:239-250
53. Yang S, Zhang J (2012) An adaptive human-machine control system based on multiple fuzzy predictive models of operator functional state. Biol Signal Process Control (in press)
54. Zadeh LA (1973) An outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybernetics 3:28-44
55. Zhang Q, Lee M (2012) Analyzing the dynamics of emotional scene sequence using recurrent neuro-fuzzy network. Cogn Neurodyn published online: 17 August 2012, doi: 10.1007/s11571-012-9216-y
56. Zhang J-H, Mahfouf M, Linkens DA (2007) Adaptive fuzzy model of operator functional state in human-machine system: a preliminary study. In: Proceedings of the IASTED international conference, 555-017
57. Zhang J-H, Wang X-Y, Mahfouf M, Linkens DA (2008a) Use of heart rate variability analysis for quantitatively assessing operator's mental workload. In: Proceedings of the BMEI, pp 668-672
58. Zhang J-H, Wang X-Y, Mahfouf M, Linkens DA (2008b) Fuzzy Logic based identification of operator functional states using multiple physiological and performance measures. In: Proceedings of the BMEI, pp 570-574