An analysis of performance evaluation for motor-imagery based BCI

Journal of Neural Engineering

Volumn 10, Issue 3, 2013, Pages

  Thomas, Eoin ^a   Dyson, Matthew ^b   Clerc, Maureen ^a  

^a INRIA   (France)

^b AIX MARSEILLE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CLASSIFICATION; AUXILIARY SIGNALS; BRAIN COMPUTER INTERFACES (BCIS); ERROR DETECTION AND CORRECTION; EVALUATION STRATEGIES; EXPERIMENTAL DATUM; SHARED CONTROL;

BIOMEDICAL ENGINEERING; ENGINEERING TECHNOLOGY; NEUROLOGY;

BRAIN COMPUTER INTERFACE;

ALGORITHM; BRAIN COMPUTER INTERFACE; IMAGERY; METRIC SYSTEM; PRACTICE GUIDELINE; PRIORITY JOURNAL; REVIEW; SIMULATION;

ALGORITHMS; BRAIN MAPPING; BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, MOTOR; HUMANS; IMAGINATION; MOVEMENT; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE;

EID: 84878312128     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/10/3/031001     Document Type: Review

References (50)

1. Pfurtscheller G and da Silva F H L 1999 Event-related EEG/MEG synchronization and desynchronization: basic principles Clin. Neurophysiol. 110 1842-57 (Pubitemid 29454610)
2. Mason S, Kronegg J, Huggins J, Fatourechi M and Schlögl A 2006 Evaluating the performance of self-paced brain-computer interface technology Technical Report Neil Squire Soc., Vancouver, BC, Canada (http://ipl.ece.ubc.ca/ bci-files/self-paced-tech-report-2006-05-19.pdf)
3. Jackson M, Mason S and Birch G 2006 Analyzing trends in brain interface technology: a method to compare studies Ann. Biomed. Eng. 34 859-78 (Pubitemid 43824034)
4. Mason S, Bashashati A, Fatourechi M, Navarro K and Birch G 2007 A comprehensive survey of brain interface technology designs Ann. Biomed. Eng. 35 137-69 (Pubitemid 46122173)
5. Schlögl A, Kronegg J, Huggins J E and Mason S G 2007 Evaluation criteria for BCI research Toward Brain-Computer Interfacing (Cambridge, MA: MIT Press) chapter 19 pp 327-42
6. Fatourechi M, Ward R, Mason S, Huggins J, Schlogl A and Birch G 2008 Comparison of evaluation metrics in classification applications with imbalanced datasets ICMLA'08: 7th Int. Conf. on Machine Learning and Applications pp 777-82
7. Billinger M, Daly I, Kaiser V, Jin J, Allison B Z, Müller-Putz G R and Brunner C 2013 Is it significant? Guidelines for reporting BCI performance Towards Practical Brain-Computer Interfaces (Biological and Medical Physics, Biomedical Engineering) ed B Z Allison, S Dunne, R Leeb, J Del R Millán and A Nijholt (Berlin: Springer) pp 333-54
8. Wolpaw J, Ramoser H, McFarland D and Pfurtscheller G 1998 EEG-based communication: improved accuracy by response verification IEEE Trans. Rehabil. Eng. 6 326-33 (Pubitemid 28409341)
9. Nykopp T 2001 Statistical modelling issues for the adaptive brain interface MSc Thesis Helsinki University of Technology
10. Kronegg J, Voloshynovskiy S and Pun T 2005 Analysis of bit-rate definitions for brain-computer interfaces HCI'05: Proc. 11th Int. Conf. on Human-Computer Interaction pp 40-46
11. Wolpaw J and Wolpaw E (ed) 2012 Brain-Computer Interfaces: Principles and Practice (Oxford: Oxford University Press)
12. Lasko T, Bhagwat J, Zou K and Ohno-Machado L 2005 The use of receiver operating characteristic curves in biomedical informatics J. Biomed. Inform. 38 404-15 (Pubitemid 41405811)
13. Bianchi L, Quitadamo L, Garreffa G, Cardarilli G and Marciani M 2007 Performances evaluation and optimization of brain-computer interface systems in a copy spelling task IEEE Trans. Neural Syst. Rehabil. Eng. 15 207-16 (Pubitemid 46957028)
14. Quitadamo L, Abbafati M, Cardarilli G, Mattia D, Cincotti F, Babiloni F, Marciani M and Bianchi L 2012 Evaluation of the performances of different P300 based brain-computer interfaces by means of the efficiency metric J. Neurosci. Methods 203 361-8
15. Dal Seno B, Matteucci M and Mainardi L 2010 The utility metric: a novel method to assess the overall performance of discrete brain-computer interfaces IEEE Trans. Neural Syst. Rehabil. Eng. 18 20-28
16. Scherer R, Lee F, Schlogl A, Leeb R, Bischof H and Pfurtscheller G 2008 Toward self-paced brain-computer communication: navigation through virtual worlds IEEE Trans. Biomed. Eng. 55 675-82
17. Chin Z, Ang K, Wang C and Guan C 2010 Online performance evaluation of motor imagery BCI with augmented-reality virtual hand feedback EMBC: Annu. Int. Conf. of the IEEE Engineering in Medicine and Biology Society pp 3341-4
18. Leeb R, Lee F, Keinrath C, Scherer R, Bischof H and Pfurtscheller G 2007 Brain-computer communication: motivation, aim and impact of exploring a virtual apartment IEEE Trans. Neural Syst. Rehabil. Eng. 15 473-82 (Pubitemid 350274168)
19. Hsu W 2011 EEG-based motor imagery classification using enhanced active segment selection and adaptive classifier Comput. Biol. Med. 41 633-9
20. Nijboer F, Furdea A, Gunst I, Mellinger J, McFarland D, Birbaumer N and Kübler A 2008 An auditory brain-computer interface (BCI) J. Neurosci. Methods 167 43-50 (Pubitemid 350186060)
21. Thomas E, Fruitet J and Clerc M 2012 Investigating brief motor imagery for an ERD/ERS based BCI Annu. Int. Conf. of IEEE Engineering in Medicine and Biology Society pp 2929-32
22. Satti A, Coyle D and Prasad G 2009 Continuous EEG classification for a self-paced BCI NER'09: 4th Int. IEEE/EMBS Conf. on Neural Engineering pp 315-8
23. Kawanabe M, Vidaurre C, Scholler S and Müller K 2009 Robust common spatial filters with a maxmin approach EMBC: Annu. Int. Conf. of IEEE Engineering in Medicine and Biology Society pp 2470-3
24. Sugiyama M, Krauledat M and Müller K 2007 Covariate shift adaptation by importance weighted cross validation J. Mach. Learn. Res. 8 985-1005 (Pubitemid 46798411)
25. Fazli S, Popescu F, Danóczy M, Blankertz B, Müller K and Grozea C 2009 Subject-independent mental state classification in single trials Neural Netw. 22 1305-12
26. Zhao Q, Zhang L, Cichocki A and Li J 2008 Incremental common spatial pattern algorithm for BCI IEEE World Congress on Computational Intelligence (Hong Kong, China,) pp 2656-9
27. Chen C, Song W, Zhang J, Hu Z and Xu H 2010 An adaptive feature extraction method for motor-imagery BCI systems IEEE World Congress on Computational Intelligence (Nanning, China,) pp 275-9
28. Vidaurre C, Schlogl A, Cabeza R, Scherer R and Pfurtscheller G 2007 Study of on-line adaptive discriminant analysis for EEG-based brain-computer interfaces IEEE Trans. Biomed. Eng. 54 550-6 (Pubitemid 46371248)
29. Blumberg J, Rickert J, Waldert S, Schulze-Bonhage A, Aertsen A and Mehring C 2007 Adaptive classification for brain-computer interfaces 29th Annu. Int. Conf. of IEEE Engineering in Medicine and Biology Society pp 2536-9
30. McFarland D J, Sarnacki W A and Wolpaw J R 2011 Should the parameters of a BCI translation algorithm be continually adapted? J. Neurosci. Methods 199 103-7
31. Vidaurre C, Sannelli C, Müller K and Blankertz B 2011 Machine-learning-based coadaptive calibration for brain-computer interfaces Neural Comput. 23 791-816
32. Vidaurre C, Schlögl A, Blankertz B, Kawanabe M and Müller K 2008 Unsupervised adaptation of the LDA classifier for brain-computer interfaces Proc. 4th Int. Brain-Computer Interface Workshop and Training Course pp 122-7
33. Zander T O, Kothe C, Jatzev S and Gaertner M 2010 Enhancing human-computer interaction with input from active and passive brain-computer interfaces Brain-Computer Interfaces (Human-Computer Interaction Series) ed D S Tan and A Nijholt (London: Springer) pp 181-99
34. Artusi X, Niazi I K, Lucas M and Farina D 2011 Theoretical framework and simulation of an adaptive BCI based on movement-related and error potentials 5th Int. Brain-Computer Interface Workshop and Training Course (Graz, Austria,) pp 88-91
35. Ferrez P and del R Millán J 2007 EEG-based brain-computer interaction: improved accuracy by automatic single-trial error detection Advances in Neural Information Processing Systems 20 (Cambridge, MA: MIT Press) pp 441-8
36. Ferrez P and del R Millán J 2008 Simultaneous real-time detection of motor imagery and error-related potentials for improved BCI accuracy Proc. 4th Int. Brain-Computer Interface Workshop and Training Course pp 197-202
37. Kreilinger A, Neuper C, Pfurtscheller G and Müller-Putz G 2009 Implementation of error detection into the Graz-brain-computer interface, the interaction error potential AAATE '09: 9th European Conf. for the Advancement of Assistive Technology (Florence, Italy,) pp 1-5
38. Kreilinger A, Neuper C and Müller-Putz G 2011 Detection of error potentials during a car-game with combined continuous and discrete feedback Proc. 5th Int. BCI Workshop and Training Course (Graz, Austria,) pp 204-7
39. Kreilinger A, Neuper C and Müller-Putz G 2012 Error potential detection during continuous movement of an artificial arm controlled by brain-computer interface Med. Biol. Eng. Comput. 50 223-30
40. Zander T and Jatzev S 2012 Context-aware brain-computer interfaces: exploring the information space of user, technical system and environment J. Neural Eng. 9 016003
41. Pfurtscheller G, Allison B Z, Brunner C, Bauernfeind G, Solis-Escalante T, Scherer R, Zander T O, Mueller-Putz G, Neuper C and Birbaumer N 2010 The hybrid BCI Front. Res. Found. 4 42
42. Muller-Putz G, Breitwieser C, Cincotti F, Leeb R, Schreuder M, Leotta F, Tavella M, Bianchi L, Kreilinger A and Ramsay A 2011 Tools for brain-computer interaction: a general concept for a hybrid BCI Front. Neuroinform. 5 30
43. Galán F, Nuttin M, Lew E, Ferrez P, Vanacker G, Philips J and Millán J 2008 A brain-actuated wheelchair: Asynchronous and non-invasive brain-computer interfaces for continuous control of robots Clin. Neurophysiol. 119 2159-69
44. Brunner C, Allison B, Krusienski D, Kaiser V, Müller-Putz G, Pfurtscheller G and Neuper C 2010 Improved signal processing approaches in an offline simulation of a hybrid brain-computer interface J. Neurosci. Methods 188 165-73
45. Allison B, Brunner C, Kaiser V, Müller-Putz G, Neuper C and Pfurtscheller G 2010 Toward a hybrid brain-computer interface based on imagined movement and visual attention J. Neural Eng. 7 026007
46. Leeb R, Sagha H, Chavarriaga R and Millán J 2011 A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities J. Neural Eng. 8 025011
47. Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P and Muller-Putz G 2010 Self-paced operation of an SSVEP-based orthosis with and without an imagery-based 'brain switch': a feasibility study towards a hybrid BCI IEEE Trans. Neural Syst. Rehabil. Eng. 18 409-14
48. Scherer R, Müller-Putz G R and Pfurtscheller G 2007 Self-initiation of EEG-based brain-computer communication using the heart rate response J. Neural Eng. 4 L23
49. Tsui C, Gan J and Roberts S 2009 A self-paced brain-computer interface for controlling a robot simulator: an online event labelling paradigm and an extended Kalman filter based algorithm for online training Medical Biol. Eng. Comput. 47 257-65
50. Ferrez P and Millán J D R 2008 Simultaneous real-time detection of motor imagery and error-related potentials for improved BCI accuracy Proc. 4th Int. Brain-Computer Interface Workshop and Training Course pp 197-202