Human-computer interface issues in controlling virtual reality with brain-computer interface

Human-Computer Interaction

Volumn 25, Issue 1, 2010, Pages 67-94

  Friedman, Doron ^a   Leeb, Robert ^b   Pfurtscheller, Gert ^b   Slater, Mel ^c  

^a INTERDISCIPLINARY CENTER   (Israel)

^b GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^c UNIVERSITY OF BARCELONA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

VIRTUAL REALITY;

HUMAN COMPUTER INTERFACES; IMMERSIVE VIRTUAL REALITY; MOTOR IMAGERY; SUBJECTIVE EXPERIENCES; VIRTUAL BODIES; VIRTUAL WORLDS;

BRAIN COMPUTER INTERFACE;

EID: 77951043501     PISSN: 07370024     EISSN: None     Source Type: Journal    
DOI: 10.1080/07370020903586688     Document Type: Article

References (48)

1. Armel, K. C., & Ramachandran, V. S. (2003). Projecting sensations to external objects: Evidence from skin conductance response. Proceedings of the Royal Society of London, Series B, Biological Sciences, 270, 1499-1506.
2. Bayliss, J. D. (2003). Use of the evoked potential P3 component for control in a virtual apartment. IEEE Transactions on Rehabilitation Engineering, 11, 113-116.
3. Bayliss, J. D., & Ballard, D. H. (2000). A virtual reality testbed for Brain Computer Interface research. IEEE Transactions on Rehabilitation Engineering, 8, 188-190.
4. Botvinick, M., & Cohen, J. (1998). Rubber hands "feel" touch that eyes see. Nature, 391(6669), 756. (Pubitemid 28099666)
5. Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V., & Hart, J. C. (1992, June). The CAVE: Audio visual experience automatic virtual environment. Communications of the ACM, 35(6), 65-72. (Pubitemid 23642227)
6. Desmond, D., Horgan, O., & MacLachlan, M. (2002). Trinity assessment of body plasticity (TABP). Unpublished manuscript, Department of Psychology, Trinity College, Dublin, Ireland.
7. Dornhege, G., Millan, J. R., Hinterberger, T., McFarland, D. J., & Muller, K. R. (Eds.). (2007). Toward brain-computer interfacing. Cambridge, MA: MIT Press.
8. Dragoi, V., & Staddon, J. E. (1999). The dynamics of operant conditioning. Psychological Review, 106, 20-61.
9. Frecon, E., Smith, G., Steed, A., Stenius, M., & Stahl, O. (2001, February). An overview of the COVEN platform. Presence: Teleoperators and Virtual Environments, 10(1), 109-127. (Pubitemid 33272164)
10. Friedman, D., Brogni, A., Guger, C., Antley, A., Steed, A., & Slater, M. (2006). Sharing and analyzing data from presence experiments. Presence: Teleoperators and Virtual Environments, 15, 555-610. (Pubitemid 44728709)
11. Friedman, D., Leeb, R., Guger, C., Steed, A., Pfertscheller, G., & Slater, M. (2007). Navigating virtual reality by thought: What is it like? Presence: Teleoperators and Virtual Environments, 16, 100-110.
12. Gibson, W. (1984). Neuromancer. London: Voyager.
13. Guger, C., Edlinger, G., Harkam, W., Niedermayer, I., & Pfurtscheller, G. (2003). How many people are able to operate an EEG-based brain-computer interface (BCI)? IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 145-147. (Pubitemid 36935043)
14. Hettinger, L. J., & Riccio, G. E. (1992). Visually induced motion sickness in virtual environments. Presence, 1(3), 306-310.
15. Jeannerod, M., & Frak, V. (1999). Mental imaging of motor activity in humans. Current Opinion in Neurobiology, 9(6), 735-739.
16. Kelly, F. D., & Main, F. O. (1978). Ideographic research in individual psychology: Problems and solutions. The Journal of Individual Psychology, 34(2), 221-231.
17. Kubler, A., Kotchoubey, B., Kaiser, J., & Wolpaw, J. R. (2001). Brain-computer communication: Unlocking the locked in. Psychological Bulletin, 127, 358-375. (Pubitemid 33610287)
18. Kubler, A., & Muller, K. R. (2007). An introduction to brain-computer interfacing. In Toward brain-computer interfacing (pp. 1-26). Cambridge, MA: MIT Press.
19. Leeb, R., Friedman, D., Müller-Putz, G., Scherer, R., Slater, M., & Pfurtscheller, G. (2007). Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: A case study with a tetraplegic. Computational Intelligence and Neuroscience, 2007. doi:10.1155/2007/79642
20. Leeb, R., Keinrath, C., Friedman, D., Guger, C., Neuper, C., Garau, M., et al. (2006). Walking from thoughts: Not the muscles are crucial, but the brain waves! Presence: Teleoperators and Virtual Environments, 15, 500-514.
21. Leeb, R., Lee, F., Keinrath, C., Scherer, R., Bischof, H., & Pfurtscheller, G. (2007). Brain-computer communication: Motivation, aim, and impact of exploring a virtual apartment. IEEE Transactions on Rehabilitation Engineering, 15, 473-482. (Pubitemid 350274168)
22. Lotte, F., Congedo, M., Lecuyer, A., Lamarche, F., & Arnaldi, B. (2007). A review of classification algorithms for EEG-based brain-computer interfaces. Journal of Neural Engineering, 4, R1-R13. (Pubitemid 46603810)
23. Lotze, M., Montoya, P., Erb, M., Hülsmann, E., Flor, H., Klose, U., et al. (1999). Activation of cortical and cerebellar motor areas during executed and imagined hand movements: An fMRI study. Journal of Cognitive Neuroscience, 11, 491-501.
24. Mackinlay, J. D., Card, S. K., & Robertson, G. G. (1990). Rapid controlled movement through a virtual 3d workspace. Proceedings of the 17th annual conference on Computer Graphics and Interactive Techniques. New York: ACM.
25. Mason, S. G., & Birch, G. E. (2000). A brain-controlled switch for asynchronous control applications. IEEE Transactions on Biomedical Engineering, 47, 1297-1307.
26. Middendorf, M., McMillan, G., Calhoun, G., & Jones, K. S. (2000). Brain-Computer Interface based on the steady-state visual-evoked response. IEEE Transactions on Rehabilitation Engineering, 8, 211-214.
27. Millan, J. D. R., & Mourino, J. (2003). Asynchronous BCI and local neural classiers: An overview of the adaptive brain interface project. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 159-161.
28. Nelson, W., Hettinger, L., Cunningham, J., & Roe, M. (1997). Navigating through virtual ight environments using brain-body-actuated control. Proceedings of the IEEE Virtual Reality Annual International Symposium. IEEE Computer Society.
29. Neuper, C., Scherer, R., Reiner, M., & Pfurtscheller, G. (2005). Imagery of motor actions: Differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. Cognitive Brain Research, 25, 668-677.
30. Pandzic, I. S., Thalmann, N. M., Capin, T. K., & Thalmann, D. (1997). Virtual life network: A body-centered networked virtual environment. Presence-Teleoperators and Virtual Environments, 6, 676-686.
31. Pfurtshceller, G., Leeb, R., Keinrath, C., Friedman, D., Neuper, C., Guger, C., et al. (2006). Walking from thought. Brain Research, 1071, 145-152.
32. Pfurtscheller, G., & Neuper, C. (2001, July). Motor imagery and direct brain computer communication. Proceedings of the IEEE, 89, 1123-1134
33. Riva, G., David, F., & IJsselsteijn, W. (Eds.). (2003). Being there: Concepts, effects and measurement of user presence in synthetic environments. Amsterdam: IOS Press.
34. Schlogl, A., Kronegg, J., Huggins, J. E., & Mason, S. G. (2007). Evaluation criteria for BCI research. In Toward brain-computer interfacing (pp. 327-342). Cambridge, MA: MIT Press.
35. Schneiderman, B. (1983). Direct manipulation: A step beyond programming languages. IEEE Computer, 16(8), 57-69.
36. Slater, M., Steed, A., McCarthy, J., & Maringelli, F. (1998). The influence of body movement on subjective presence in virtual environments. Human Factors, 40, 469-477.
37. Slater, M., Usoh, M., & Steed, A. (1994, June). Depth of presence in virtual environments. Presence: Teleoperators and Virtual Environments, 11(3), 130-144.
38. Slater, M., Usoh, M., & Steed, A. (1995). Taking steps: The influence of a walking metaphor on presence in virtual reality. ACM Transactions on Computer-Human Interaction, 2, 201-219.
39. Smith, J. (1977). Semi-structured interviewing and qualitative analysis. In J. Smith, R. Harre, & L. Langenhove (Eds.), Rethinking methods in psychology (pp. 9-26). London: Sage.
40. Steed, A., Mortensen, J., & Frecon, E. (2001). Spelunking: Experiences using the DIVE system on CAVE-like platforms. In Immersive projection technologies and virtual environments (Vol. 2, pp. 153-164). New York: Springer-Verlag/Wien.
41. Stephenson, N. (1991). Snow crash. New York: Roc.
42. Sutherland, I. (1965, May). The ultimate display. In Proceedings of the IFIPS Congress 1965 (Vol. 2, pp. 506-508). Amsterdam, The Netherlands: North-Holland Publishing Co.
43. Usoh, M., Arthur, K., Whitton, M., Bastos, R., Steed, A., Slater, M., et al. (1999). Walking walk-ing-in-place ying, in virtual environments. Proceedings of SIGGRAPH 99. New York, NY: ACM Press.
44. Utz, S. W. (1994). The eect of instructions on cognitive strategies and performance in biofeed-back. Journal of Behavioral Medicine, 17, 291-308.
45. Vallabhaneni, A., Wang, T., & He, B. (2005). Brain computer interface. In B. He (Ed.), Neural Engineering (pp. 85-122). Dordrecht, the Netherlands: Kluwer.
46. Vidal, J. J. (1973). Toward direct brain-computer communication. Annual Review of Biophysics and Bioengineering, 2, 157-180
47. Vives, M. S., & Slater, M. (2005). From presence to consciousness through virtual reality. Nature. Reviews Neuroscience. 6(4), 332-339
48. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002). Brain. Computer Interfaces for communication and control. Clinical Neurophysiology, 113, 767-791.