Control-display mapping in brain-computer interfaces

Ergonomics

Volumn 55, Issue 5, 2012, Pages 564-580

  Thurlings, Marieke E ^a,b   van Erp, Jan B F ^b   Brouwer, Anne Marie ^b   Blankertz, Benjamin ^c   Werkhoven, Peter ^a  

^a UTRECHT UNIVERSITY   (Netherlands)

^b TNO   (Netherlands)

^c TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

attention; BCI; CDM; conflict; congruency; ERP; interface; mapping; N2; navigation; P300

Indexed keywords

ATTENTION; BCI; CDM; CONFLICT; CONGRUENCY; N2; P300;

BRAIN COMPUTER INTERFACE; ENTERPRISE RESOURCE PLANNING; INTERFACES (COMPUTER); INTERFACES (MATERIALS); MAPPING; NAVIGATION;

BRAIN MAPPING;

ARTICLE; BRAIN MAPPING; COMMUNICATION AID; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEMALE; HUMAN; INFORMATION PROCESSING; MALE; METHODOLOGY; PHYSIOLOGY;

BRAIN MAPPING; COMMUNICATION AIDS FOR DISABLED; DATA DISPLAY; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; USER-COMPUTER INTERFACE;

EID: 84860907646     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2012.661085     Document Type: Article

References (76)

1. Acqualagna, L. and Blankertz, B. 2011. A gaze independent speller based on rapid serial visual presentation. Conference Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society, 1: 4560-4563.
2. Allison, B. Z. and Polich, J. 2008. Workload assessment of computer gaming using a single-stimulus event-related potential paradigm. Biological Psychology, 77(3): 277-283.
3. Allison, B. Z., McFarland, D.J., Schalf, G., Zheng, S.D., Moore Jackson, M. and Wolpaw, J.R. 2008. Towards an independent brain-computer interface using steady state visual evoked potentials. Clinical Neurophysiology, 119(2): 399-408.
4. Allison, T., Puce, A., Spencer, D.D. and McCarthy, G. 1999. Electrophysiological studies of human face perception. I: potentials generated in occipitotemporal cortex by face and non-face stimuli. Cerebral Cortex, 9(5): 415-430.
5. Avraamides, M. N. and Kelly, J. W. 2008. Multiple systems of spatial memory and action. Cognitive Processing, 9(2): 93-106.
6. Bahramisharif, A., Van Gerven, M., Heskes, T. and Jensen, O. 2010. Covert attention allows for continuous control of brain-computer interfaces. European Journal of Neuroscience, 31(8): 1501-1508.
7. Bartholow, B. D., Pearson, M.A., Dickter, C.L., Sher, K.J., Fabiani, M. and Gratton, G. 2005. Strategic control and medial frontal negativity: beyond errors and response conflict. Psychophysiology, 42(1): 33-42.
8. Blankertz, B., Dornhege, G., Schäfer, C., Krepki, R., Kohlmorgen, J., Müller, K.R., Kunzmann, V., Losch, F. and Curio, G. 2003. Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis. IEEE Transactions on Neural and Rehabilitation Systems Engineering, 11(2): 127-131.
9. Blankertz, B., Lemm, S., Treder, M., Haufe, S. and Müller, K.R. 2011. Single-trial analysis and classification of ERP components-a tutorial. NeuroImage, 56(2): 814-825.
10. Brandeis, D. and Lehmann, D. 1986. Event-related potentials of the brain and cognitive processes: approaches and applications. Neuropsychologia, 24(1): 151-168.
11. Brouwer, A.-M. and Van Erp, J.B.F. 2010. A Tactile P300 brain-computer interface. Frontiers in Neuroscience, 4 (19): 1-12.
12. Brouwer, A.-M., van Erp, J.B.F., Aloise, F. and Cincotti, F. 2010. Tactile, visual, and Bimodal P300s: could Bimodal P300s boost BCI performance?. SRX Neuroscience, ID 967027
13. Brunner, P., Joshi, S., Briskin, S., Wolpaw, J.R., Bischof, H. and Schalk, G. 2010. Does the "P300" speller depend on eye gaze?. Journal of Neural Engineering, 7(5) art.no.056013
14. Chan, K. W.L. and Chan, A. H.S. 2011. Spatial stimulus response compatibility for a horizontal visual display with hand and foot controls. Ergonomics, 54(3): 233-245.
15. D'Arcy, R. C.N., Service, E., Connolly, J.F. and Hawco, C.S. 2005. The influence of increased working memory load on semantic neural systems: a high-resolution event-related brain potential study. Cognitive Brain Research, 22(2): 177-191.
16. Delorme, A. and Makeig, S. 2004. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1): 9-21.
17. Dutta, A. and Proctor, R. W. 1992. Persistence of stimulus-response compatibility effects with extended practice. Journal of experimental psychology: Learning memory and cognition, 18(4): 801-809.
18. Farwell, L. A. and Donchin, E. 1988. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology, 70(6): 510-523.
19. Ferrez, P. W. and Del R Millan, J. 2008. Error-related EEG potentials generated during simulated brain-computer interaction. IEEE Transactions on Biomedical Engineering, 55(3): 923-929.
20. Fitts, P. M. and Seeger, C. M. 1953. S-R compatibility: spatial characteristics of stimulus and response codes. Journal of Experimental Psychology, 46(3): 199-210.
21. Fitts, P. M. and Deininger, R. L. 1954. S-R compatibility: correspondence among paired elements within stimulus and response codes. Journal of Experimental Psychology, 48(6): 483-492.
22. Forster, B. and Pavone, E. F. 2008. Electrophysiological correlates of crossmodal visual distractor congruency effects: evidence for response conflict. Cognitive Affective Behavioral Neuroscience, 8(1): 65-73.
23. Friedman, D. and Johnson, R. 2000. Event-related potential (ERP) studies of memory encoding and retrieval: a selective review. Microscopy Research and Technique, 51(1): 6-28.
24. Gillmeister, H. and Forster, B. 2010. Vision enhances selective attention to body-related information. Neuroscience Letters, 483(3): 184-188.
25. Guger, C., Edlinger, G., Harkam, W., Niedermayer, I. and Pfurtscheller, G. 2003. How many people are able to operate an EEG-based brain-computer interface (BCI)?. IEEE Transactions on Neural and Rehabilitation Systems Engineering, 11(2): 145-147.
26. Guger, C., Daban, S., Sellers, E., Holzner, C., Krausz, G., Carabalona, R., Gramatica, F. and Edlinger, G. 2009. How many people are able to control a P300-based brain-computer interface (BCI)?. Neuroscience Letters, 462(1): 94-98.
27. Guthrie, D. and Buchwald, J. S. 1991. Significance testing of difference potentials. Psychophysiology, 28(2): 240-244.
28. Haufe, S., Treder, M.S., Gugler, M.F., Sagebaum, M., Curio, G. and Blankertz, B. 2011. EEG potentials predict upcoming emergency brakings during simulated driving. Journal of Neural Engineering, 8(5) art.no. 056001
29. Heil, M. 2002. The functional significance of ERP effects during mental rotation. Psychophysiology, 39(5): 535-545.
30. Hillyard, S. A. and Kutas, M. 1983. Electrophysiology of cognitive processing. Annual Review of Psychology, 34: 33-61.
31. Höhne, J., Schreuder, M., Blankertz, B. and Tangermann, M. 2010. Two-dimensional auditory P300 Speller with predictive text system. Conference Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society, 2010: 4185-4188.
32. Jung, T. P., Makeig, S., Westerfield, M., Townsend, J., Courchesne, E. and Sejnowski, T.J. 2000. Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clinical Neurophysiology, 111(10): 1745-1758.
33. Kennett, S., Eimer, M., Spence, C. and Driver, J. 2001. Tactile-visual links in exogenous spatial attention under different postures: convergent evidence from psychophysics and ERPs. Journal of Cognitive Neuroscience, 13(4): 462-478.
34. Kida, T., Nishihira, Y., Wasaka, T., Nakata, H. and Sakamoto, M. 2004. Differential modulation of temporal and frontal components of the somatosensory N140 and the effect of interstimulus interval in a selective attention task. Cognitive Brain Research, 19(1): 33-39.
35. Kok, A. 1997. Event-related-potential (ERP) reflections of mental resources: a review and synthesis. Biological Psychology, 45(1-3): 19-56.
36. Kramer, A. F., Trejo, L. J. and Humphrey, D. 1995. Assessment of mental workload with task-irrelevant auditory probes. Biological Psychology, 40(1-2): 83-100.
37. Krusienski, D.J., Sellers, E.W., McFarland, D.J., Vaughan, T.M. and Wolpaw, J.R. 2008. Toward enhanced P300 speller performance. Journal of Neuroscience Methods, 167(1): 15-21.
38. Liu, Y., Zhou, Z. and Hu, D. 2011. Gaze independent brain-computer speller with covert visual search tasks. Clinical Neurophysiology, 122(6): 1127-1136.
39. Luck, S. J. 2005. An introduction to the event-related potential technique, Cambridge, MA: MIT Press.
40. Macaluso, E., Driver, J., Van Velzen, J.L. and Eimer, M. 2005. Influence of gaze direction on crossmodal modulation of visual ERPs by endogenous tactile spatial attention. Cognitive Brain Research, 23(2-3): 406-417.
41. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E. and Foxe, J.J. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Research, 14(1): 115-128.
42. Mühl, C. and Heylen, D. Cross-modal elicitation of affective experience. In: 3rd international conference on affective computing and intelligent interaction and workshops, ACII 2009, workshop on affective brain-computer interfaces,. 10-12 September, Amsterdam, The Netherlands. pp.1-12. Piscataway, NJ: IEEE.
43. Mühl, C., Gürkök, H., Plass-Oude Bos, D., Thurlings, M.E., Scherffig, L., Duvinage, M., Elbakyan, A.A., Kang, S., Poel, M. and Heylen, D.K.J. 2010. Bacteria Hunt - Evaluating multi-paradigm BCI interaction. Journal on Multimodal User Interfaces, 4 (1): 11-25.
44. Naveh-Benjamin, M., Kilb, A. and Fisher, T. 2006. Concurrent task effects on memory encoding and retrieval: further support for an asymmetry. Memory cognition, 34(1): 90-101.
45. Nijboer, F., Furdea, A., Gunst, I., Mellinger, J., McFarland, D.J., Birbaumer, N. and Kübler, A. 2008. An auditory brain-computer interface (BCI). Journal of Neuroscience Methods, 167(1): 43-50.
46. Nijholt, A., Plass-Oude Bos, D. and Reuderink, B. 2009. Turning shortcomings into challenges: brain-computer interfaces for games. Entertainment Computing, 1(2): 85-94.
47. Ohara, S., Lenz, F. and Zhou, Y.-D. 2006. Sequential neural processes of tactile-visual crossmodal working memory. Neuroscience, 139(1): 299-309.
48. Pfurtscheller, G., Leeb, R., Keinrath, C., Friedman, D., Neuper, C., Guger, C. and Slater, M. 2006. Walking from thought. Brain Research, 1071(1): 145-152.
49. Phillips, J. G., Triggs, T. J. and Meehan, J. W. 2005. Forward/up directional incompatibilities during cursor placement within graphical user interfaces. Ergonomics, 48(6): 722-735.
50. Porbadnigk, A. K., Antons, J., Blankertz, B., Treder, M.S., Schleicher, R., Moller, S. and Curio, G. 2010. Using ERPs for assessing the (Sub)conscious perception of noise. Conference Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society, 1: 2690-2693.
51. Proctor, R. W., Vu, K.-P.L. and Pick, D. F. 2005. Aging and response selection in spatial choice tasks. Human Factors, 47(2): 250-270.
52. Puce, A., Epling, J.A., Thompson, J.C. and Carrick, O.K. 2007. Neural responses elicited to face motion and vocalization pairings. Neuropsychologia, 45(1): 93-106.
53. Rugg, M. D., Doyle, M. C. and Wells, T. 1995. Word and nonword repetition within- and across-modality: an event-related potential study. Journal of Cognitive Neuroscience, 7(2): 209-227.
54. Salmon, N. and Pratt, H. 2002. A comparison of sentence- and discourse-level semantic processing: an ERP study. Brain and Language, 83(3): 367-383.
55. Schmidt, N., Blankertz, B. and Treder, M. S. 2011. Online detection of error potentials increases information throughput in a brain-computer interface. Neuroscience Letters, 500(Suppl. 1): e19-e20.
56. Schreuder, M., Blankertz, B. and Tangermann, M. 2010. A new auditory multi-class brain-computer interface paradigm: spatial hearing as an informative cue. PLoS ONE, 5(4) art.no. e9813
57. Tereshchenko, E. P., Kropotov, IuD, Ponomarev, V.A. and Muller, A. 2009. Comparative efficiencies of different methods for removing blink artefacts in analyzing quantitative electroencephalogram and event-related potentials. Human Physiology, 35(2): 241-247.
58. Thurlings, M. E., van Erp, J.B.F., Brouwer, A.-M. and Werkhoven, P.J. 2010. "EEG-Based navigation from a Human Factors perspective". In Brain-computer interfaces: applying our minds to human-computer interaction, Edited by: S. Tan, D. and Nijholt, A. 71-86. London: Springer.
59. Tlauka, M. 2004. Display-control compatibility: the relationship between performance and judgments of performance. Ergonomics, 47(3): 281-295.
60. Treder, M. S. and Blankertz, B. 2010. (C)overt attention and visual speller design in an ERP-based brain-computer interface. Behavioral and brain functions, 6, 28
61. Treder, M.S., Schmidt, N.M. and Blankertz, B. 2011. Gaze-independent brain-computer interfaces based on covert attention and feature attention. Journal of Neural Engineering, 8(6) 066003
62. Van Erp, J.B.F. 2005. Presenting directions with a vibrotactile torso display. Ergonomics, 48(3): 302-313.
63. Van, Erp, J.B.F. and Oving, A. B. 2002. Control performance with three translational degrees of freedom. Human Factors, 44(1): 144-155.
64. Van, Erp, J.B.F. and Van Veen, H.A.H.C. 2004. Vibrotactile in-vehicle navigation system. Transportation Research Part F Traffic Psychology and Behaviour, 7(4-5): 247-256.
65. Van, Erp, J.B.F., Erikkson, L., Levin, B., Carlander, O., Veltman, J.A. and Vos, W.K. 2007. Tactile cueing effects on performance in simulated aerial combat with high acceleration. Aviation Space and Environmental Medicine, 78(12): 1128-1134.
66. Vidal, J., Giard, M.H., Barthélé Roux, S., my, C. and Bruneau, N. 2008. Cross-modal processing of auditory-visual stimuli in a no-task paradigm: a topographic event-related potential study. Clinical Neurophysiology, 119(4): 763-771.
67. Wang, Y., Wu, J., Fu, S. and Luo, Y. 2010. Orienting and focusing in voluntary and involuntary visuospatial attention conditions: An event-related potential study. Journal of Psychophysiology, 24(3): 198-209.
68. Webb, A. 2002. Statistical pattern recognition, Chichester: John Wiley & Sons.
69. Wickens, C. D. 1987. "Information processing, decision-making, and cognition". In Handbook of human factors (pp. 72-107), Edited by: Salvendy, G. New York: Wiley.
70. Worringham, C. J. and Beringer, D. B. 1998. Directional stimulus-response compatibility: a test of three alternative principles. Ergonomics, 41(6): 864-880.
71. Yang, J. and Wang, Y. 2002. Event-related potentials elicited by stimulus spatial discrepancy in humans. Neuroscience Letters, 326(2): 73-76.
72. Zander, T. O. and Kothe, C. 2011. Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. Journal of Neural Engineering, 8(2) art.no. 025005
73. Zander, T. O., Ihme, K., Gärtner, M. and Rötting, M. 2011. A public data hub for benchmarking common brain-computer interface algorithms. Journal of Neural Engineering, 8(2) art.no. 025021
74. Zhai, S., Milgram, P. and Rastogi, A. 1997. Anisotropic human performance in six degree-of-freedom tracking: an evaluation of three-dimensional display and control interfaces. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 27(4): 518-528.
75. Zhou, B., Zhang, J.X., Tan, L.H. and Han, S. 2004. Spatial congruence in working memory: an ERP study. NeuroReport, 15(18): 2795-2799.
76. Zupanc, C. M., Burgess-Limerick, R. J. and Wallis, G. 2007. Performance consequences of alternating directional control-response compatibility: evidence from a coal mine shuttle car simulator. Human Factors, 49(4): 628-636.