The utility metric: A novel method to assess the overall performance of discrete braincomputer interfaces

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 18, Issue 1, 2010, Pages 20-28

  Dal Seno, Bernardo ^a   Matteucci, Matteo ^a   Mainardi, Luca T ^a  

^a POLITECNICO DI MILANO   (Italy)

Author keywords

BCI performance; Brain computer interface (BCI); Error potential; P300 speller

Indexed keywords

BCI PERFORMANCE; CLASSIFIER PERFORMANCE; CONTROL INTERFACES; INFORMATION TRANSFER RATE; MONTE CARLO SIMULATION; NOVEL METHODS; USER INTENTION;

CLASSIFIERS; COMPUTER SIMULATION; ERROR CORRECTION; INTERFACES (COMPUTER); MONTE CARLO METHODS; OPTICAL SENSORS;

BRAIN COMPUTER INTERFACE;

ALGORITHM; ARTICLE; BRAIN; BRAIN MAPPING; CLASSIFICATION; COMPUTER INTERFACE; EVOKED RESPONSE; HUMAN; METHODOLOGY; PHYSIOLOGY; TASK PERFORMANCE;

ALGORITHMS; BRAIN; BRAIN MAPPING; EVOKED POTENTIALS; HUMANS; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE;

EID: 77649313876     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2009.2032642     Document Type: Article

References (22)

1. J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, pp. 767-791, 2002.
2. S. G. Mason and G. E. Birch, "A general framework for brain-computer interface design," IEEE Trans. Neural Syst. Rehab. Eng., vol. 11, no. 1, pp. 70-85, Mar. 2003.
3. L. Bianchi, L. R. Quitadamo, G. Garreffa, G. C. Cardarilli, and M. G. Marciani, "Performances evaluation and optimization of brain computer interface systems in a copy spelling task," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 15, no. 2, pp. 207-216, Jun. 2007.
4. J. Cohen, "A coefficient of agreement for nominal scales," Educ. Psychol. Meas., vol. 20, pp. 37-46, 1960.
5. J. R. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarland, G. S. P. H. Peckham, E. Donchin, L. A. Quatrano, C. J. Robinson, and T. M. Vaughan, "Brain-computer interface technology: A review of the first international meeting," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164-173, Jun. 2000.
6. A. Schlögl, J. Kronegg, J. E. Huggins, and S. G. Mason, "Evaluation criteria for BCI research," in Towards Brain-Computer Interfacing, G. Dornhege, J. d. R. Millán, T. Hinterberger, D. J. McFarland, and K. Müller, Eds. Cambridge, MA: MIT Press, 2007, pp. 327-342.
7. B. Dal Seno, L. Mainardi, and M. Matteucci, "Assessing the performance of a BCI: A task-oriented approach," in Proc. 4th Int. Brain-Computer Interface Workshop Train. Course, Graz, Austria, Sep. 2008, pp. 274-279.
8. B. Obermaier, C. Neuper, C. Guger, and G. Pfurtscheller, "Information transfer rate in a five-classes brain-computer interface," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 9, no. 3, pp. 283-288, Sep. 2001.
9. A. Schlögl, C. Keinrath, R. Scherer, and G. Pfurtscheller, "Information transfer of an EEG-based brain computer interface," in Proc. 1st Int. IEEE EMBS Conf. Neural Eng., 2003, pp. 641-644.
10. C. E. Shannon and W. Weaver, The Mathematical Theory of Communication. Champaign, IL: Univ. Illinois Press, 1949.
11. J. Kronegg, S. Voloshynovskiy, and T. Pun, "Analysis of bit-rate definitions for brain-computer interfaces," presented at the 2005 Int. Conf. Human-computer Interaction (HCI'05), Las Vegas, NV, Jun. 2005.
12. G. Dornhege, B. Blankertz, G. Curio, and K.-R. Müller, "Increase information transfer rates in BCI by CSP extension to multi-class," in Advances in Neural Information Processing Systems (NIPS 03), S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2004, vol. 16.
13. P. W. Ferrez and J. d. R. Millán, "You are wrong! - Automatic detection of interaction errors from brain waves," in Proc. 19th Int. Joint Conf. Artif. Intell., 2005, pp. 1413-1418.
14. P. Peebles, Probability, Random Variables, and Random Signal Principles. New York: McGraw-Hill, 1980.
15. L. A. Farwell and E. Donchin, "Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials," Electroenceph. Clin. Neurophysiol., vol. 70, no. 6, pp. 510-523, Dec. 1988.
16. G. Dornhege, "Increasing information transfer rates for brain-computer interfacing," Ph.D. dissertation, Univ. Potsdam, Potsdam, Germany, 2006.
17. P. W. Ferrez and J. d. R. Millán, "Error-related EEG potentials generated during simulated brain-computer interaction," IEEE Trans. Biomed. Eng., vol. 55, no. 3, pp. 923-929, Mar. 2008.
18. G. Visconti, B. Dal Seno, M. Matteucci, and L. Mainardi, "Automatic recognition of error potentials in a P300-based brain-computer interface," in Proc. 4th Int. Brain-Computer Interface Workshop Training Course, Graz, Austria, Sep. 2008, pp. 238-243.
19. B. Dal Seno, "Toward an integrated P300- and ErrP-based brain-computer interface," Ph.D. dissertation, Politecnico di Milano, Milan, Italy, 2009.
20. E. W. Sellers, D. J. Krusienski, D. J. McFarland, T. M. Vaughan, and J. R. Wolpaw, "A P300 event-related potential brain-computer interface (BCI): The effects of matrix size and inter stimulus interval on performance," Biol. Psychol., vol. 73, no. 3, pp. 242-252, Oct. 2006.
21. D. J. Krusienski, E. W. Sellers, D. J. McFarland, T. M. Vaughan, and J. R. Wolpaw, "Toward enhanced speller performance," J. Neurosci. Methods, vol. 167, no. 1, pp. 15-21, Jan. 2008.
22. T. Nykopp, "Statistical modelling issues for the adaptive brain interface," M.S. thesis, Dept. Elect. Commun. Eng., Helsinki Univ. Technol., Helsinki, Finland, 2001.