Affective brain-computer interfaces: Psychophysiological markers of emotion in healthy persons and in persons with amyotrophic lateral sclerosis

Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Volumn , Issue , 2009, Pages

  Nijboer, Femke ^a   Carmien, Stefan P ^a   Leon, Enrique ^a   Morin, Fabrice O ^a   Koene, Randal A ^a   Hoffmann, Ulrich ^a  

^a TECNALIA RESEARCH AND INNOVATION   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECTIVE STATE; AMYOTROPHIC LATERAL SCLEROSIS; ASSESSMENT TOOL; CENTRAL NERVOUS SYSTEMS; GENERAL POPULATION; HEALTHY PERSONS; MOTOR IMPAIRMENTS; QUALITY OF LIFE;

ADAPTIVE SYSTEMS; COMPUTER PERIPHERAL EQUIPMENT; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; INTELLIGENT COMPUTING; INTERFACES (COMPUTER); KNOWLEDGE MANAGEMENT;

BRAIN COMPUTER INTERFACE;

EID: 77949367207     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2009.5349479     Document Type: Conference Paper

References (86)

1. F. Aloise, F. Cincotti, F. Babiloni, M. G. Marciani, D. Morelli, S. Paolucci, G. Oriolo, A. Cherubini, F. Sciarra, F. Mangiola, A. Melpignano, F. Davide, and D. Mattia. The ASPICE project: inclusive design for the motor disabled. In Proceedings of the Working conference on Advanced Visual Interfaces, pages 360-363l, 2006.
2. M. Arns, S. de Ridder, U. Strehl, M. Breteler, and A. Coenen. Efficacy of neurofeedback treatment in ADHD: The effects of inattention, impulsivity and hyperactivity: a meta-analysis. Clinical EEG and Neuroscience, 40:3, 2009.
3. T. Bearden, J. Cassisi, and M. Pineda. Neurofeedback training for a patient with thalamic and cortical infarctions. Applied Psychophysiology Biofeedback, 28(3):241-253, 2003.
4. N. Birbaumer. Breaking the silence: Brain-computer interfaces (BCI) for communication and motor control. Psychophysiology, 43(6):517-532, 2006.
5. N. Birbaumer, N. Ghanayim, T. Hinterberger, I. Iversen, B. Kotchoubey, A. K̈ubler, J. Perelmouter, E. Taub, and H. Flor. A spelling device for the paralysed. Nature, 398(6725):297-298, 1999.
6. M. Bradley. Handbook of Psychophysiology, chapter Emotion and motivation, pages 602-642. Cambridge University Press, 2000.
7. M. M. Bradley and P. J. Lang. Measuring emotion: the selfassessment manikin and the semantic differential. Journal of Behavioral Therapy and Experimental Psychiatry, 25(1):49-59, 1994.
8. B. Brooks. Clinical epidemiology of amyotrophic lateral sclerosis. Neurological Clinics, 14(2):399-420, 1996.
9. E. Buch, C. Weber, L. Cohen, C. Braun, M. Dimyan, T. Ard, J. Mellinger, A. Caria, S. Soekadar, A. Fourkas, and N. Birbaumer. Think to move: A neuromagnetic brain-computer interface (BCI) system for chronic stroke. Stroke, 39(3):910-917, 2008.
10. M. Busse, Y. F. Low, F. I. Corona-Strauss,W. Delb, and D. J. Strauss. Neurofeedback by neural correlates of auditory selective attention as possible application for tinnitus therapies. Conference Proceedings IEEE Engineering in Medical and Biological Society, 2008:5136-5139, 2008.
11. J. Cacioppo, G. Berntson, J. Larsen, K. Poehlmann, and T. Ito. The Handbook of Emotion, chapter The psychophysiology of emotion, pages 173-191. The guilford press, 2000.
12. J. Cacioppo, G. Berntston, D. Klein, and K. Poehlmann. Annual Review of Gerontology and Geriatrics, chapter The psychophysiology of emotion across the lifespan, pages 27-65. Springer Publishing Company, 1998.
13. W. B. Cannon. The James-Lange theory of emotions: a critical examination and an alternative theory. American Journal of Psychology, 100(3-4):567-586, 1927.
14. G. Chanel, J. J. M. Kierkels, M. Soleymani, and T. Pun. Short-term emotion assessment in a recall paradigm. International Journal of Human-Computer Studies, 67:607-627, 2009.
15. K. Chwalisz, E. Diener, and D. Gallagher. Autonomic arousal feedback and emotional experience: Evidence from the spinal cord injured. Journal of Personality and Social Psychology, 54(5):820-828, May 1988.
16. T. Cochrane. 8 dimensions for emotions. Social Science Information. Special issue on The language of emotion: conceptual and cultural issues, 48(3), 2009.
17. M. Cudkowicz, M., and J. Shefner. Measures and markers in amyotrophic lateral sclerosis. NeuroRx, 1(2):273-83, 2004.
18. E. Cutrell and D. Tan. BCI for passive input in HCI. In Proceedings of CHI 2008. Microsoft Research, ACM, 2008.
19. A. Damasio. Feelings and emotions: The Amsterdam symposium, chapter Emotions and feelings - A neurobiological perspective, pages 49-57. Cambridge University Press, 2004.
20. R. Davidson. Affective neuroscience and psychophysiology: Toward a synthesis. Psychophysiology, 40:655-665, 2003.
21. S. D'Mello, S. Craig, B. Gholson, S. Franklin, R. Picard, and A. Graesser. Integrating affect sensors in an intelligent tutoring system. In Affective Interactions: The Computer in the Affective Loop Workshop at 2005 International Conference on Intelligent User Interfaces. AMC Press, 2005.
22. R. Drechsler, M. Straub, M. Doehnert, H. Heinrich, H.-C. Steinhausen, and D. Brandeis. Controlled evaluation of a neurofeedback training of slow cortical potentials in children with Attention Deficit/Hyperactivity Disorder (ADHD). Behavioral and Brain Functions, 3:35, 2007.
23. P. Ekman, W. Friesen, and P. Ellsworth. Emotion in the Human Face: Guidelines for Research and an Integration of Findings. Pergamon Press, 1972.
24. P. Ekman, R. W. Levenson, and W. V. Friesen. Autonomic nervous system activity distinguishes among emotions. Science, 221(4616):1208-1210, 1983.
25. R. Fernandez and R. Picard. Signal processing for recognition of human frustration. In IEEE International Conference on Acoustics, Speech, and Signal Processing. IEEE, WA, 1998.
26. E. E. Fetz and D. V. Finocchio. Operant conditioning of specific patterns of neural and muscular activity. Science, 174(7):431-435, 1971.
27. J. R. J. Fontaine, K. R. Scherer, E. B. Roesch, and P. C. Ellsworth. The world of emotions is not two-dimensional. Psychological Science, 18(12):1050-1057, Dec 2007.
28. L. Ganzini, W. S. Johnston, and W. F. Hoffman. Correlates of suffering in amyotrophic lateral sclerosis. Neurology, 52(7):1434-40, 1999.
29. N. Ghanayim. Psychophysiologische Untersuchungen bei Patienten mit amyotropher Lateralsklerose (ALS) zur Differenzierung von Emotionskonzepten. Master thesis, University of Tübingen, 2000.
30. E. Granholm and S. R. Steinhauer. Pupillometric measures of cognitive and emotional processes. International Journal of Psychophysiology, 52(1):1-6, 2004.
31. P. Gray. Psychology. Worth publishers, 1994.
32. P. Griffiths. What emotions really are: the problem of psychological categories. University of Chicago Press, illustrated edition, 1997.
33. A. Haag, S. Goronzy, P. Schaich, and J. Williamsh. Using bio-sensors: First steps towards an automatic system. In Workshop on Affective Dialogue Systems, 2004.
34. H. Hayashi and E. A. Oppenheimer. ALS patients on TPPV: Totally locked-in state, neurologic findings and ethical implications. Neurology, 61(1):135-7, 2003.
35. H. Heinrich, H. Gevensleben, F. Freisleder, G. Moll, and A. Rothenberger. Training of slow cortical potentials in Attention-Deficit/Hyperactivity Disorder: Evidence for positive behavioral and neurophysiological effects. Biological Psychiatry, 55(7):772-775, 2004.
36. L. Hochberg, M. Serruya, G. Friehs, J. Mukand, M. Saleh, A. Caplan, A. Branner, D. Chen, R. Penn, and J. Donoghue. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature, 442(7099):164-171, 2006.
37. U. Hoffmann, J.-M. Vesin, T. Ebrahimi, and K. Diserens. An efficient P300-based brain-computer interface for disabled subjects. Journal of Neuroscience Methods, 167(1):115-125, 2008.
38. W. James. What is an emotion? Mind, 9:188-205, 1890.
39. P. Kleinginna and A. M. Kleinginna. A categorized list of emotion definitions, with suggestions for a consensual definition. Motivation and Emotion, 5(4):345-379, 1981.
40. B. Kotchoubey, U. Strehl, S. Holzapfel, V. Blankenhorn, W. Fröscher, and N. Birbaumer. Negative potential shifts and the prediction of the outcome of neurofeedback therapy in epilepsy. Clinical Neurophysiology, 110(4):683-686, 1999.
41. P. Kropp, M. Siniatchkin, and W.-D. Gerber. On the pathophysiology of migraine-links for "empirically based treatment" with neurofeedback. Applied Psychophysiology Biofeedback, 27(3):203-213, 2002.
42. A. Kübler and N. Birbaumer. Brain-computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? Clinical Neurophysiology, 119(11):2658-2666, 2008.
43. A. Kübler, N. Neumann, J. Kaiser, B. Kotchoubey, T. Hinterberger, and N. P. Birbaumer. Brain-computer communication: Self-regulation of slow cortical potentials for verbal communication. Archives of Physical Medicine and Rehabilitation, 82(11):1533-1539, 2001.
44. A. Kübler, F. Nijboer, and N. Birbaumer. Brain-Computer Interfaces for Communication and Motor Control - Perspectives on Clinical Applications. In G. Dornhege, J. Millan, T. Hinterberger, D. McFarland, and K.-R.Müller, editors, Toward Brain-Computer Interfacing, pages 373-392. The MIT Press, 2007.
45. A. Kurt, F. Nijboer, T. Matuz, and A. Kübler. Depression and anxiety in individuals with amyotrophic lateral sclerosis: Epidemiology and management. CNS Drugs, 21(4):279-291, 2007.
46. P. Lang, A. Öhman, and D. Vaitl. The international affective picture system [photographic slides]. Technological report, The Center for Research in Psychophysiology, University of Florida, Gainsville, FL, 1988.
47. P. J. Lang. The emotion probe. studies of motivation and attention. American Psychologist, 50(5):372-385, May 1995.
48. J. Larsen, G. Berntson, H. Poehlmann, T. Ito, and J. Cacioppo. The handbook of emotions, chapter The psychophysiology of emotion, pages 180-195. Cambridge University Press, 2008.
49. U. Leins, G. Goth, T. Hinterberger, C. Klinger, N. Rumpf, and U. Strehl. Neurofeedback for children with ADHD: a comparison of SCP and Theta/Beta protocols. Applied Psychophysiology Biofeedback, 32(2):73-88, 2007.
50. E. Leon, G. Clarke, V. Callaghan, and F. Sepulveda. A user-independent real-time emotion recognition system for software agents in domestic environments. Engineering Applications of Artificial Intelligence, The International Journal of Intelligent Real-Time Automation, 20(3):337-345, 2007.
51. M. Lewis and J. Haviland-Jones, editors. The handbook of emotion. The guilford press, second edition edition, 2000.
52. D. Lul, A. Kurt, R. Jürgens, J. Kassubek, V. Diekmann, E. Kraft, N. Neumann, A. Ludolph, N. Birbaumer, and S. Anders. Emotional responding in amyotrophic lateral sclerosis. Journal of Neurology, 252(12):1517-1524, 2005.
53. I. Montalban, A. Garzo, and E. Leon. Emotion-aware intelligent environments: A user perspective. In Proceedings of the International Conference on Intelligent Environments, 2009.
54. M. Moore and U. Dua. A galvanic skin response interface for people with severe motor disabilities. ACM SIGACCESS Accessibility and Computing, (77-78):48-54, 2004.
55. C. Moritz, S. Perlmutter, and E. Fetz. Direct control of paralysed muscles by cortical neurons. Nature, 456(7222):639-642, 2008.
56. C. Neuper, G. R. Mller, A. Kbler, N. Birbaumer, and G. Pfurtscheller. Clinical application of an EEG-based braincomputer interface: A case study in a patient with severe motor impairment. Clinical Neurophysiology, 114(3):399-409, 2003.
57. F. Nijboer, A. Furdea, I. Gunst, J. Mellinger, D. J. McFarland, N. Birbaumer, and A. Kübler. An auditory braincomputer interface (BCI). Journal of Neuroscience Methods, 167(1):43-50, 2008.
58. A. Nijholt, B. Allison, M. Jackson, D. Tan, J. Milln, and B. Graimann. Brain-computer interfaces for HCI and games. In 28th Annual CHI Conference on Human Factors in Computing Systems, pages 3925-3928, 2008.
59. A. Nijholt and D. Tan. Playing with your brain: Braincomputer interfaces and games. Organizing paper for Brain-play Workshop at Advances in Computer Entertainment, 2007.
60. W. Parrott. Emotions in social psychology. Psychology Press, 2000.
61. G. Pfurtscheller, C. Guger, G. Müller, G. Krausz, and C. Neuper. Brain oscillations control hand orthosis in a tetraplegic. Neuroscience Letters, 292(3):211-214, 2000.
62. R. Picard and E. Vyzas. Affective pattern classification. In AAAI Fall symposium series. Emotional and intelligent: The tangled knot of cognition, 1998.
63. R. Picard, E. Vyzas, and J. Healey. Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:1175-1191, 2001.
64. F. Piccione, F. Giorgi, P. Tonin, K. Priftis, S. Giove, S. Silvoni, G. Palmas, and F. Beverina. P300-based brain computer interface: reliability and performance in healthy and paralysed participants. Clinical Neurophysiology, 117(3):531-537, 2006.
65. Plutarch. Las vidas paraleles. Libreria de Hernando y Cia., 1901.
66. J. Rabkin, S. Albert, M. D. Bene, I. O'Sullivan, T. Tider, L. Rowland, and H. Mitsumoto. Prevalence of depressive disorders and change over time in late-stage ALS. Neurology, 65(1):62-7, 2005.
67. J. Rabkin, S. Albert, T. Tider, M. D. Bene, I. O'Sullivan, L. Rowland, and H. Mitsumoto. Predictors and course of elective long-term mechanical ventilation: A prospective study of ALS patients. Amyotrophic Lateral Sclerosis, 7(2):86-95, 2006.
68. P. Rainville, A. Bechara, N. Naqvi, and A. Damasio. Basic emotions are associated with distinct patterns of cardiorespiratory activity. International Journal of Psychophysiology, 61(1):5-18, 2006.
69. G. R. Rozelle and T. H. Budzynski. Neurotherapy for stroke rehabilitation: A single case study. Biofeedback and Self-Regulation, 20(3):211-228, 1995.
70. J. Russell and A. Mehrabian. Evidence for a three-factor theory of emotions. Journal of Research in Personality, 11(3):273-294, 1977.
71. J. A. Russell and L. F. Barrett. Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of Personality and Social Psychology, 76(5):805-819, 1999.
72. J. Sanchez-Navarro, J. Martínez-Selva, G. Torrente, and F. Román. Psychophysiological, behavioral, and cognitive indices of the emotional response. The Spanish Journal of Psychology, 11(1):16-25, 2008.
73. S. Schachter and J. E. Singer. Cognitive, social, and physiological determinants of emotional state. Psychological Review, 69:379-399, 1962.
74. C. A. Seguin. Erasistratus, antiochus, and psychosomatic medicine. Psychosomatic Medicine, 10(6):355, 1948.
75. E. Sellers and E. Donchin. A P300-based brain-computer interface: initial tests by ALS patients. Clinical Neurophysiology, 117(3):538-548, 2006.
76. E. Sellers, A. Kübler, and E. Donchin. Brain-computer interface research at the University of South Florida Cognitive Psychophysiology Laboratory: the P300 speller. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 14(2):221-224, 2006.
77. S. Silvoni, C. Volpato, M. Cavinato, M. Marchetti, K. Priftis, A. Merico, P. Tonin, K. Koutsikos, F. Beverina, and F. Piccione. P300-based brain-computer interface communication: evaluation and follow-up in amyotrophic lateral sclerosis. Frontiers in Neuroprosthetics, 2009 (in press).
78. U. Strehl, U. Leins, G. Goth, C. Klinger, T. Hinterberger, and N. Birbaumer. Self-regulation of slow cortical potentials: A new treatment for children with attentiondeficit/ hyperactivity disorder. Pediatrics, 118(5):1530-1540, 2006.
79. T. Surmeli and A. Ertem. QEEG guided neurofeedback therapy in personality disorders: 13 case studies. Clinical EEG and Neuroscience, 40(1):5-10, 2009.
80. D. Taylor, S. H. Tillery, and A. Schwartz. Direct cortical control of 3d neuroprosthetic devices. Science, 296(5574):1829-1832, 2002.
81. C. Velasco. Adaptive interfaces based upon biofeedback sensors. In International conference on computers for handicapped persons (ICCHP), 2004.
82. E. Vyzas. Recognition of Emotional and Cognitive States Using Physiological Data. Phd thesis, Massachusetts Institute of Technology, 1999.
83. J. Walker. Power spectral frequency and coherence abnormalities in patients with intractable epilepsy and their usefulness in long-term remediation of seizures using neurofeedback. Clinical EEG and Neuroscience, 39(4):203-205, 2008.
84. J. Walker and G. Kozlowski. Neurofeedback treatment of epilepsy. Child and adolescent psychiatric clinics of North America, 14(1):163-76, 2005.
85. K. Wing. Effect of neurofeedback on motor recovery of a patient with brain injury: A case study and its implications for stroke rehabilitation. Topics in Stroke Rehabilitation, 8(3):45-53, 2001.
86. T. Zander, C. Kothe, S. Welke, and M. Roetting. Enhancing human-machine systems with secondary input from passive brain-computer interfaces. In Proceedings of the 4th International BCI workshop and Training Course, Graz, 2008.