Adaptive training using an artificial neural network and EEG metrics for within- and cross-task workload classification

NeuroImage

Volumn 59, Issue 1, 2012, Pages 48-56

  Baldwin, Carryl L ^a   Penaranda, B N ^a  

^a GEORGE MASON UNIVERSITY   (United States)

Author keywords

Adaptive training; Artificial neural network; Working memory; Workload classification

Indexed keywords

ACCURACY; ADAPTIVE TRAINING; ADULT; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NEUROPHYSIOLOGY; PRIORITY JOURNAL; SIMULATION; TASK PERFORMANCE; TRAINING; WORKING MEMORY; WORKLOAD;

ADOLESCENT; ADULT; BRAIN; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MALE; MENTAL PROCESSES; MIDDLE AGED; NEURAL NETWORKS (COMPUTER); TASK PERFORMANCE AND ANALYSIS; TEACHING; WORKLOAD; YOUNG ADULT;

EID: 80054090545     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2011.07.047     Document Type: Article

References (57)

1. Allen J.J.B., Coan J.A., Nazarian M. Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion. Biol. Psychol. 2004, 67:183-218.
2. Antonenko P., Paas F., Grabner R., van Gog T. Using electroencephalography to measure cognitive load. Educ. Psychol. Rev. 2010, 22:425-438.
3. Antonenko P.D., Niederhauser D.S. The influence of leads on cognitive load and learning in a hypertext environment. Comput. Hum. Behav. 2010, 26:140-150.
4. Ash I.K., Wiley J. The nature of restructuring in insight: an individual-differences approach. Psychon. Bull. Rev. 2006, 13:66-73.
5. Baddeley A.D., Hitch G. Working memory. The Psychology of Learning and Motivation 1974, 47-89. Academic Press, Orlando, FL. G.H. Bower (Ed.).
6. Baldwin C.L., Coyne J.T. Dissociable aspects of mental workload: examinations of the P300 ERP component and performance assessments. Psychologia 2005, 48:102-119.
7. Baldwin, C.L., Coyne, J.T., Christensen, J., in press. EEG metrics of workload and learner engagement. In: Fafrowicz, M., Marek, T., Karwowski, W., Schmorrow, D. (Eds.), Neuroadaptive Systems: Theory and Applications. Taylor & Francis/CRC Press.
8. Brainard D.H. The psychophysics toolbox. Spat. Vis. 1997, 10:433-436. 10, 433-436.
9. Brookings J.B., Wilson G.F., Swain C.R. Psychophysiological responses to changes in workload during simulated air traffic control. Biol. Psychol. 1996, 42:361-377.
10. Brumback C.R., Low K.A., Gratton G., Fabiani M. Putting things into perspective: individual differences in working-memory span and the integration of information. Exp. Psychol. 2005, 52:21-30.
11. Carpenter P.A., Miyake A., Just M.A. Language comprehension: sentence and discourse processing. Annu. Rev. Psychol. 1995, 46:91-100. Annual Reviews, US.
12. Coan J.A., Allen J.J.B. Frontal EEG asymmetry as a moderator and mediator of emotion. Biol. Psychol. 2004, 67:7-50.
13. Coan J.A., Allen J.J.B., McKnight P.E. A capability model of individual differences in frontal EEG asymmetry. Biol. Psychol. 2006, 72:198-207.
14. Comstock J.R., Arnegard R.J. The Multi-attribute Task Battery for Human Operator Workload and Strategic Behavior Research 1992, NASA Langley Research Center, Hampton, VA.
15. Conway A.R.A., Cowan N., Bunting M.F., Therriault D.J., Minkoff S.R.B. A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence 2002, 30:163-184.
16. Conway A.R.A., Engle R.W. Individual differences in working memory capacity: more evidence for a general capacity theory. Memory 1996, 4:577-590.
17. Daneman M., Carpenter P.A. Individual differences in working memory and reading. J. Verbal Learn. Verbal Behav. 1980, 19:450-466.
18. Daneman M., Carpenter P.A. Individual differences in integrating information between and within sentences. J. Exp. Psychol. Learn. Mem. Cogn. 1983, 9:561-584.
19. Davidson R.J. What does the prefrontal cortex "do" in affect: perspectives on frontal EEG asymmetry research. Biol. Psychol. 2004, 67:219-234.
20. Davidson R.J., Chapman J.P., Chapman L.J., Henriques J.B. Asymmetrical brain electrical activity discriminates between psychometrically-matched verbal and spatial cognitive tasks. Psychophysiology 1990, 27:528-543.
21. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Meth. 2004, 134:9-21.
22. Engle R.W., Tuholski S.W., Laughlin J.E., Conway A.R.A. Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. J. Exp. Psychol. Gen. 1999, 128:309-331.
23. Fairclough, S.H., Gilleade, K., Ewing, K.C., Roberts, J., in press. Capturing user engagement via psychophysiology: measures and mechanisms for biocybernetic adaptation. International Journal of Autonomous and Adaptive Communications Systems. doi:. doi:10.1016/j.ijpsycho.2011.07.012.
24. Fairclough S.H., Venables L., Tattersall A. The influence of task demand and learning on the psychophysiological response. Int. J. Psychophysiol. 2005, 56:171-184.
25. Freeman F.G., Mikulka P.J., Prinzel L.J., Scerbo M.W. Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biol. Psychol. 1999, 50:61-76.
26. Friedman N.P., Miyake A. The reading span test and its predictive power for reading comprehension ability. J. Mem. Lang. 2004, 51:136-158.
27. Gevins A., Smith M., McEvoy L., Yu D. High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cereb. Cortex 1997, 7:374-385.
28. Gevins A., Smith M.E. Detecting transient cognitive impairment with EEG pattern recognition methods. Aviat. Space Environ. Med. 1999, 70:1018-1024.
29. Gevins A., Smith M.E. Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. Cereb. Cortex 2000, 10:829-839.
30. Gevins A., Smith M.E. Neurophysiological measures of cognitive workload during human-computer interaction. Theor. Issues Ergon. Sci. 2003, 4:113-131.
31. Gevins A., Smith M.E. Electroencephalography (EEG) in neuroergonomics. Neuroergonomics: The Brain at Work 2007, 15-31. Oxford University Press, Oxford. R. Parasuraman, M. Rizzo (Eds.).
32. Gevins A., Smith M.E., Leong H., McEvoy L., Whitfield S., Du R., Rush G. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum. Factors 1998, 40:79-91.
33. Isreal J.B., Wickens C.D., Chesney G.L., Donchin E. The event-related brain potential as an index of display-monitoring workload. Hum. Factors 1980, 22:211-224.
34. Kahneman D. Attention and Effort 1973, Prentice Hall, Englewood Cliffs, NJ.
35. Kane M.J., Bleckley M.K., Conway A.R.A., Engle R.W. A controlled-attention view of working-memory capacity. J. Exp. Psychol. Gen. 2001, 130:169-183.
36. Kleiner M., Brainard D., Pelli D. What's new in Psychtoolbox-3?. Perception 2007, 36. ECVP Abstract Supplement.
37. Kramer A.F. Physiological metrics of mental workload: a review of recent progress. Multiple-task Performance 1991, 279-328. Taylor & Francis, London. D.L. Damos (Ed.).
38. Lavie N. Distracted and confused?: Selective attention under load. Trends Cogn. Sci. 2005, 9:75-82.
39. Oberauer K. Binding and inhibition in working memory: individual and age differences in short-term recognition. J. Exp. Psychol. Gen. 2005, 134:368-387.
40. Paas F., Tuovinen J.E., Tabbers H., van Gerven P.W.M. Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 2003, 38:63-71.
41. Parasuraman R., Cosenzo K.A., De Visser E. Adaptive automation for human supervision of multiple uninhabited vehicles: effects on change detection, situation awareness, and mental workload. Mil. Psychol. 2009, 21:270-297.
42. Parasuraman R., Mouloua M., Molloy R. Effects of adaptive task allocation on monitoring of automated systems. Hum. Factors 1996, 38:665-679.
43. Parasuraman R., Rizzo M. Neuroergonomics: The Brain at Work 2007, Oxford University Press Oxford.
44. Pelli D.G. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 1997, 10:437-442.
45. Penaranda N., Baldwin C.L. More can be less: selecting EEG features for an artificial neural network-based workload classification. Applied Human Factors and Ergonomics Conference, Miami, FL 2010.
46. Riding R.J., Grimley M., Dahraei H., Banner G. Cognitive style, working memory and learning behaviour and attainment in school subjects. Br. J. Educ. Psychol. 2003, 73:149-169.
47. Russell C.A., Wilson G.F. Applications of artificial neural networks for air traffic controller functional state classification 2001, Wright-Patterson AFB: United States Air Force Research Laboratory, Dayton, Ohio.
48. Smith M.E., McEvoy L.K., Gevins A. Neurophysiological indices of strategy development and skill acquisition. Cogn. Brain Res. 1999, 7:389-404.
49. Sternberg S. The discovery of processing stages: extensions of Donders' method. Acta Psychol. 1969, 30:276-315.
50. Sweller J. Cognitive load during problem solving: effects on learning. Cogn. Sci.: Multidisciplinary J. 1988, 12:257-285.
51. Thorndyke P.W., Hayes-Roth B. Differences in spatial knowledge acquired from maps and navigation. Cogn. Psychol. 1982, 14:560-589.
52. Unsworth N., Engle R.W. Simple and complex memory spans and their relation to fluid abilities: evidence from list-length effects. J. Mem. Lang. 2006, 54:68-80.
53. Unsworth N., Heitz R.P., Schrock J.C., Engle R.W. An automated version of the operation span task. Behav. Res. Meth. 2005, 37:498-505.
54. Wilson G.F., Russell C.A. Operator functional state classification using multiple psychophysiological features in an air traffic control task. Hum. Factors 2003, 45:381-389.
55. Wilson G.F., Russell C.A. Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Hum. Factors 2003, 45:635-643.
56. Wilson G.F., Russell C.A. Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Hum. Factors 2007, 49:1005-1018.
57. Zhu F.F., Maxwell J.P., Hu Y., Zhang Z.G., Lam W.K., Poolton J.M., Masters R.S.W. EEG activity during the verbal-cognitive stage of motor skill acquisition. Biol. Psychol. 2010, 84:221-227.