The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications

PLoS ONE

Volumn 9, Issue 12, 2014, Pages

  Kübler, Andrea ^a   Holz, Elisa M ^a   Riccio, Angela ^b   Zickler, Claudia ^c   Kaufmann, Tobias ^d   Kleih, Sonja C ^a   Staiger Sälzer, Pit ^e   Desideri, Lorenzo ^f   Hoogerwerf, Evert Jan ^f   Mattia, Donatella ^b  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b IRCCS FONDAZIONE SANTA LUCIA   (Italy)

^c UNIVERSITY OF TÜBINGEN   (Germany)

^d UNIVERSITY OF OSLO   (Norway)

^e Beratungsstelle für Unterstützte Kommunikation ^*  (Germany)

^f AIAS   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ASSISTIVE TECHNOLOGY DEVICE; BRAIN COMPUTER INTERFACE; CLINICAL ARTICLE; COMPUTER PROGRAM; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; DAILY LIFE ACTIVITY; DISEASE SEVERITY; ELECTRONIC DATA INTERCHANGE; EVENT RELATED POTENTIAL; HUMAN; INFORMATION PROCESSING; INFORMATION TRANSFER RATE; MEASUREMENT ACCURACY; MOTOR DYSFUNCTION; PHYSICAL PARAMETERS; QUESTIONNAIRE; SATISFACTION; USER CENTERED DESIGN; VISUAL ANALOG SCALE; WORKLOAD; COMPUTER INTERFACE; ECONOMICS; ELECTROENCEPHALOGRAPHY; PATHOPHYSIOLOGY; PATIENT SATISFACTION;

BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; EVENT-RELATED POTENTIALS, P300; HUMANS; MOVEMENT DISORDERS; PATIENT SATISFACTION; SURVEYS AND QUESTIONNAIRES; USER-COMPUTER INTERFACE;

EID: 84916231184     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0112392     Document Type: Article

References (60)

1. Birbaumer N, Ghanayim N, Hinterberger T, Iversen I, Kotchoubey B, et al. (1999) A spelling device for the paralysed. Nature 398: 297-298.
2. Kaufmann T, Schulz SM, Koblitz A, Renner G, Wessig C, et al. (2013) Face stimuli effectively prevent brain-computer interface inefficiency in patients with neurodegenerative disease. Clin Neurophysiol 124: 893-900.
3. Kübler A, Nijboer F, Mellinger J, Vaughan TM, Pawelzik H, et al. (2005) Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology 64: 1775-1777.
4. Nijboer F, Sellers EW, Mellinger J, Jordan MA, Matuz T, et al. (2008) A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol 119: 1909-1916.
5. Piccione F, Giorgi F, Tonin P, Priftis K, Giove S, et al. (2006) P300-based brain computer interface: reliability and performance in healthy and paralysed participants. Clin Neurophysiol 117: 531-537.
6. Riccio A, Simione L, Schettini F, Pizzimenti A, Inghilleri M, et al. (2013) Attention and P300-based BCI performance in people with amyotrophic lateral sclerosis. Front Hum Neurosci 7: 732.
7. Sellers EW, Donchin E (2006) A P300-based brain-computer interface: initial tests by ALS patients. Clin Neurophysiol 117: 538-548.
8. Kübler A (2013) Brain-computer interfacing: science fiction has come true. Brain 136: 2001-2004.
9. Kübler A, Holz EM, Kaufmann T, Zickler C (2013) A User Centred Approach for Bringing BCI Controlled Applications to End-Users. In: Fazel-Rezai R, editor. Brain-Computer Interface Systems - Recent Progress and Future Prospects: InTech.
10. Friedrich EV, Scherer R, Neuper C (2013) Long-term evaluation of a 4-class imagery-based braincomputer interface. Clin Neurophysiol 124: 916-927.
11. Kübler A, Mattia D, Rupp R, Tangermann M (2013) Facing the challenge: bringing brain-computer interfaces to end-users. Artif Intell Med 59: 55-60.
12. ISO 9241-210 (2008) Ergonomics of human system interaction - Part 210: Human-centred design for interactive systems (formerly known as 13407). International Organization for Standardization (ISO) Switzerland.
13. Arthanat S, Bauer SM, Lenker JA, Nochajski SM, Wu YW (2007) Conceptualization and measurement of assistive technology usability. Disabil Rehabil Assist Technol 2: 235-248.
14. Lorenz R, Pascual J, Blankertz B, Vidaurre C (2014) Towards a holistic assessment of the user experience with hybrid BCIs. J Neural Eng 11: 035007.
15. van de Laar B, Nijboer F, Gürkök H, Plass-Oude D, Nijholt A (2011) User experience evaluation in BCI: Bridge the gap. Int J Bioelectromagn 13: 157-158.
16. Choi YM, Sprigle SH (2011) Approaches for evaluating the usability of assisstive technology product prototypes. Assist Technol 23: 36-41.
17. Pasqualotto E, Simonetta A, Gnisci V, Federici S, Belardinelli MO (2009) Usability evaluation of BCIs. In: P.L.Emiliani, L.Burzagli, A Como, F.Gabbanini, Salminen A-L, editors. Assistive Technology from Adapted Equipment to Inclusive Environments, AAATE 25 Assistive Technology Research Series. Amsterdam: IOS Press pp. 882.
18. Pasqualotto E, Simonetta A, Gnisci V, Federici S, Belardinelli MO (2011) Toward a usability evaluation of BCIs. Int J Bioelectromagn 13: 121-122.
19. McCane LM, Sellers EW, McFarland DJ, Mak JN, Carmack CS, et al. (2014) Brain-computer interface (BCI) evaluation in people with amyotrophic lateral sclerosis. Amyotroph Lateral Scler Frontotemporal Degener 15: 207-215.
20. Hoogerwerf EJ, Desideri L, Malavasi M, Rimondini M, Kübler A (2013) Towards a framework for user involvement in research and development of emerging assistive technologies. AAATE Vilamoura, Algarve, Portugal.
21. Zickler C, Halder S, Kleih SC, Herbert C, Kübler A (2013) Brain Painting: usability testing according to the user-centered design in end users with severe motor paralysis. Artif Intell Med 59: 99-110.
22. Zickler C, Riccio A, Leotta F, Hillian-Tress S, Halder S, et al. (2011) A brain-computer interface as input channel for a standard assistive technology software. Clin EEG Neurosci 42: 236-244.
23. Dal Seno B, Matteucci M, Mainardi LT (2010) The utility metric: a novel method to assess the overall performance of discrete brain-computer interfaces. IEEE Trans Rehabil Eng 18: 20-28.
24. Schlögl A, Kronegg J, Huggins J, Mason SG (2007) Evaluation Criteria for BCI Research. In: Dornhege G, Millán JdR, Hinterberger T, McFarland D, Müller K-R, editors. Toward brain-computer interfacing. Cambridge, MA: MIT Press. pp. 373-391.
25. Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: Hancock PA, Meshkati N, editors. Human Mental Workload. Amsterdam: North Holland Press. pp. 139-183.
26. Demers L, Weiss-Lambrou R, Ska B (2002) The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): an overview and recent progress. Technol Disabil 14: 101-105.
27. Batavia AI, Hammer GS (1990) Toward the development of consumer-based criteria for the evaluation of assistive devices. J Rehabil Res Dev 27: 425-436.
28. Scherer MJ, Lane JP (1997) Assessing consumer profiles of 'ideal' assistive technologies in ten categories: an integration of quantitative and qualitative methods. Disabil Rehabil 19: 528-535.
29. Holz EM, Botrel L, Kaufmann T, Kübler A (2014) Independent BCI home-use improves quality of life of a patient in the locked-in state (ALS): A long-term study. Arch Phys Med Rehab. In Press.
30. Corradi F, Scherer MJ, Lo Presti A (2012) Measuring the Assistive Technology Match. In: Federici S, Scherer MJ, editors. Assistive Technology Assessment Handbook. London, UK: CRC Press. pp. 49-65.
31. Holz EM, Botrel L, Kaufmann T, Kübler A (2013) Long-Term Independent BCI Home-Use by a Locked- In End-User: An Evaluation Study. 5th International BCI Meeting. Asilomar, Pacific Grove, CA.
32. Holz EM, Botrel L, Kübler A (2013) Bridging Gaps: Long-Term Independent BCI Home-Use by a Locked-In End-User. TOBI Workshop IV. Sion, Switzerland.
33. Holz EM, Höhne J, Staiger-Sälzer P, Tangermann M, Kübler A (2013) Brain-computer interface controlled gaming: evaluation of usability by severely motor restricted end-users. Artif Intell Med 59: 111-120.
34. Riccio A, Holz EM, Arico P, Leotta F, Aloise F, et al. (2013) A hybrid control of a P300-based BCI: a solution to improve system usability? 5th International BCI Meeting. Asilomar, Pacific Grove, CA.
35. Riccio A, Holz EM, Arico P, Leotta F, Desideri L, et al. (2014) A hybrid control of a P300-based braincomputer interface to improve usability for people with severe motor disability. Arch Phys Med Rehab. In Press.
36. Riccio A, Leotta F, Tiripicchio S, Mattia D, Cincotti F (2011) Can Severe Acquired Brain Injury Users Control a Communication Application Operated through a P300-Based Brain Computer Interface? 5th International Brain-Computer Interface Conference. Graz, Austria: Graz University of Technology.
37. Kleih SC, Kaufmann T, Zickler C, Halder S, Leotta F, et al. (2011) Out of the frying pan into the fire - the P300-based BCI faces real-world challenges. Prog Brain Res 194: 27-46.
38. Blankertz B, Sannelli C, Halder S, Hammer EM, Kübler A, et al. (2010) Neurophysiological predictor of SMR-based BCI performance. Neuroimage 51: 1303-1309.
39. Neuper C, Scherer R, Reiner M, Pfurtscheller G (2005) Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. Brain Res Cogn Brain Res 25: 668-677.
40. Wolpaw JR, McFarland DJ (2004) Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc Natl Acad Sci U S A 101: 17849-17854.
41. Zander TO, Kothe C (2011) Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J Neural Eng 8: 025005.
42. Nykopp T (2001) Statistical modelling issues for the adaptive brain interface. Helsinki: Helsinki University of Technology. 113 p.
43. Wolpaw JR, Ramoser H, McFarland DJ, Pfurtscheller G (1998) EEG-based communication: improved accuracy by response verification. IEEE Trans Rehabil Eng 6: 326-333.
44. Riccio A, Leotta F, Bianchi L, Aloise F, Zickler C, et al. (2011) Workload measurement in a communication application operated through a P300-based brain-computer interface. J Neurol Eng 8: 025028.
45. Müller-Putz GR, Breitwieser C, Cincotti F, Leeb R, Schreuder M, et al. (2011) Tools for Brain- Computer Interaction: A General Concept for a Hybrid BCI. Front Neuroinform 5: 30.
46. Pfurtscheller G, Allison BZ, Brunner C, Bauernfeind G, Solis-Escalante T, et al. (2010) The hybrid BCI. Front Neurosci 4: 30.
47. Holz EM, Riccio A, Reichert J, Leotta F, Arico P, et al. (2013) Hybrid-P300 BCI: Usability Testing by Severely Motor-restricted End-Users. TOBI Workshop IV. Sion, Switzerland.
48. Riccio A, Holz EM, Arico P, Leotta F, Aloise F, et al. (2013) Towards a hybrid control of a P300-based BCI for communication in severely disabled end-users. TOBI Workshop IV. Sion, Switzerland.
49. Kübler A, Neumann N, Kaiser J, Kotchoubey B, Hinterberger T, et al. (2001) Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. Arch Phys Med Rehabil 82: 1533-1539.
50. Kübler A, Halder S, Furdea A, Hösle A (2008) Brain painting: BCI meets art. In: Müller-Putz GR, Brunner C, Leeb R, Pfurtscheller G, Neuper C, editors. 4th International Brain-Computer Interface Workshop and Training Course. Graz, Austria: Technical University of Graz. pp. 361-366.
51. Münßinger JI, Halder S, Kleih SC, Furdea A, Raco V, et al. (2010) Brain Painting: First evaluation of a new brain-bomputer interface application with ALS-patients and healthy volunteers. Front Neurosci 4: 182.
52. Höhne J, Holz E, Staiger-Salzer P, Müller KR, Kübler A, et al. (2014) Motor imagery for severely motor-impaired patients: evidence for brain-computer interfacing as superior control solution. PLoS One 9: e104854.
53. Rohm M, Schneiders M, Muller C, Kreilinger A, Kaiser V, et al. (2013) Hybrid brain-computer interfaces and hybrid neuroprostheses for restoration of upper limb functions in individuals with highlevel spinal cord injury. Artif Intell Med 59: 133-142.
54. Schreuder M, Riccio A, Risetti M, Dahne S, Ramsay A, et al. (2013) User-centered design in braincomputer interfaces-a case study. Artif Intell Med 59: 71-80.
55. Wolpaw JR, Wolpaw EW (2012) Brain-computer interfaces: principles and practice. New York, USA: Oxford University Press.
56. Cincotti F, Pichiorri F, Arico P, Aloise F, Leotta F, et al. (2012) EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb. 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2013/02/01 ed. San Diego, USA. pp. 4112-4115.
57. Ramos-Murguialday A, Broetz D, Rea M, Laer L, Yilmaz O, et al. (2013) Brain-machine interface in chronic stroke rehabilitation: a controlled study. Ann Neurol 74: 100-108.
58. Wang W, Collinger JL, Degenhart AD, Tyler-Kabara EC, Schwartz AB, et al. (2013) An electrocorticographic brain interface in an individual with tetraplegia. PLoS One 8: e55344.
59. Zickler C, Di Donna V, Kaiser V, Al-Khodairy A, Kleih S, et al. (2009) BCI applications for people with disabilities: defining user needs and user requirements. In: P.L.Emiliani, L.Burzagli, A Como, F.Gabbanini, Salminen A-L, editors. Assistive Technology from Adapted Equipment to Inclusive Environments, AAATE 25 Assistive Technology Research Series. Amsterdam: IOS Press pp. 185-189.
60. Holz EM, Zickler C, Riccio A, Höhne J, Cincotti F, et al. (2013) Evaluation of Four Different BCI Prototypes by Severely Motor-Restricted End-Users. 5th International BCI Meeting. Asilomar, Pacific Grove, CA.