Decision-level fusion of EEG and pupil features for single-trial visual detection analysis

IEEE Transactions on Biomedical Engineering

Volumn 56, Issue 7, 2009, Pages 1929-1937

  Qian, Ming ^a   Aguilar, Mario ^a   Zachery, Karen N ^a   Privitera, Claudio ^b   Klein, Stanley ^b   Carney, Thom ^b   Nolte, Loren W ^c  

^a Teledyne Scientific and Imaging LLC   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Duke University   (United States)

Author keywords

Brain machine interface; Decision fusion; EEG; Image triage; Machine learning; Pupillary response; Rapid serial visual presentation (RSVP); Single trial detection

Indexed keywords

BRAIN-MACHINE INTERFACE; DECISION FUSION; EEG; IMAGE TRIAGE; MACHINE LEARNING; PUPILLARY RESPONSE; RAPID SERIAL VISUAL PRESENTATION (RSVP); SINGLE-TRIAL DETECTION;

ELECTROENCEPHALOGRAPHY; FEATURE EXTRACTION; IMAGE ACQUISITION; IMAGE FUSION; ROBOT LEARNING; SIGNAL ANALYSIS;

SIGNAL DETECTION;

ACCURACY; ARTICLE; COGNITION; CONTROLLED STUDY; DECISION MAKING; ELECTROENCEPHALOGRAM; FEMALE; HUMAN; MALE; NORMAL HUMAN; PUPIL; RETINA IMAGE; SIGNAL TRANSDUCTION; VISION; VISUAL STIMULATION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DISCRIMINANT ANALYSIS; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LINEAR MODELS; MALE; MAN-MACHINE SYSTEMS; PUPIL; ROC CURVE; SIGNAL PROCESSING, COMPUTER-ASSISTED; TASK PERFORMANCE AND ANALYSIS;

EID: 67650895069     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2009.2016670     Document Type: Article

References (21)

1. Y. Barniv, M. Aguilar, and E. Hasanbelliu, "Using EMG to anticipate head motion for virtual-environment applications," IEEE Trans. Biomed. Eng., vol. 52, no. 6, pp. 1087-1093, Jun. 2005.
2. J. Beatty, "Task-evoked pupillary responses, processing load, and the structure of processing resources," Psychol. Bull., vol. 91, no. 1, pp. 276-292, 1982.
3. J. Beatty and L. W. Brennis, "The pupillary system," in Handbook of Psychophysiology, J. T. Cacioppo and L. G. Tassinary, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2000.
4. R. F. Brem, "The never ending controversiesof screening mammography," Cancer, vol. 3, no. 5, pp. 1549-1552, 2004.
5. B. V. Dasarathy, Decision Fusion. Los Alamitos, CA: IEEE Comput. Soc. Press, 1994.
6. A. Delorme and S. Makeig, "EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics," J. Neurosci. Methods, vol. 134, pp. 9-21, 2004.
7. A. D. Gerson, L. C. Parra, and P. Sajda, "Cortical origins of response time variability during rapid discrimination of visual objects," NeuroImage, vol. 28, pp. 326-341, 2005.
8. A. D. Gerson, L. C. Parra, and P. Sajda, "Cortical-coupled computer vision for rapid image search," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 14, no. 2, pp. 174-179, Jun. 2006.
9. A. K. Jain and D. Zongher, "Feature selection: Evaluation, application and small sample performance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 2, pp. 153-158, Feb. 1997.
10. W. Krenz, M. Robin, S. Barez, and L. W. Stark, "Neurology model of the normal and abnormal human pupil," IEEE Trans. Biomed. Eng., vol. BME-32, no. 10, pp. 817-825, Oct. 1985.
11. I. Loewenfeld and O. Lowenstein, The Pupil: Anatomy Physiology and Clinical Applications. Detroit, MI: Wayne State Univ. Press, 1993.
12. T.Marill andD.M.Green, "Onthe effectivenessofreceptorsinrecognition system," IEEE Trans. Inf. Theory, vol. IT-9, no. 1, pp. 11-17, Jan. 1961.
13. S. Mathan, D. Erdogmus, and Y. Huang, "Rapid image analysis using neural signals," presented at the Conf. Hum. Factors Comput. Syst., Montreal, QC, Canada, 2008.
14. L. Parra, C. Spence, A. Gerson, and P. Sajda, "Response error correction - A demonstration of improved human - machine performance using realtime EEG monitoring," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 173-177, Jun. 2003.
15. L. C. Parra, C. D. Spence, A. D. Gerson, and P. Sajda, "Recipes for the linear analysis of EEG," NeuroImage, vol. 28, pp. 342-353, 2005.
16. C. Privitera, L. Renninger, T. Carney, S. Klein, and M. Aguilar, "Pupil dilation during visual target detection," in Proc. SPIE 20th Annu. Symp. Electron. Imag. Sci. Technol., Jan. 2008, pp. 68060T-1-68060T-11.
17. P. Pudil, J. Novovicova, and J. Kittler, "Floating search methods in feature selection," Pattern Recognit. Lett., vol. 15, pp. 1119-1125, Nov. 1994.
18. M. Qian, M. Aguilar, and L. Nolte, "The role of multi-level fusion in EEG-based classification for image triage tasks," to be published.
19. A. R. Reibman and L. W. Nolte, "Design and performance comparison of distributed detection networks," IEEE Tran. Aerosp. Electron. Syst., vol. 23, no. 6, pp. 789-797, Nov. 1987.
20. J. D. Smith, G. A. Masek, L. Y. Ichinose, T. Watanabe, and L. W. Stark, "Single neuron activity in the pupillary system," Brain Res., vol. 24, pp. 219-234, 1970.
21. A. W. Whitney, "A direct method of nonparametric measurement selection," IEEE Trans. Comput., vol. 20, no. 9, pp. 1100-1103, Sep. 1971.