Taking NIRS-BCIs outside the lab: Towards achieving robustness against environment noise

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 19, Issue 2, 2011, Pages 136-146

  Falk, Tiago H ^a   Guirgis, Mirna ^b   Power, Sarah ^b   Chau, Tom T ^b  

^a INRS EMT   (Canada)

^b University of Toronto   (Canada)

Author keywords

Ambient noise; autonomic nervous system; hidden Markov models; music imagery; near infrared spectroscopy

Indexed keywords

ACOUSTIC MONITORING; AMBIENT NOISE; AUDITORY DISTRACTION; AUTONOMIC NERVOUS SYSTEM; BLOOD VOLUME PULSE; COMPUTER INTERFACES; CONTROLLED LABORATORIES; ELECTRODERMAL ACTIVITY; ENVIRONMENTAL FACTORS; ENVIRONMENTAL NOISE; IMAGERY TASK; MARKOV MODEL; MENTAL STATE; MUSIC IMAGERY; NIRS SYSTEM; NOISE COMPENSATION; NOISE EVENTS; NOISY ENVIRONMENT; PERFORMANCE LOSS; PHYSIOLOGICAL RESPONSE; PHYSIOLOGICAL SIGNALS; PREFRONTAL CORTEX; SENSITIVITY AND SPECIFICITY; SKIN TEMPERATURES;

ACOUSTIC NOISE; BRAIN COMPUTER INTERFACE; EXPERIMENTS; INFRARED DEVICES; INFRARED SPECTROSCOPY; INTERFACES (COMPUTER); OBJECT RECOGNITION; PHYSIOLOGICAL MODELS; PHYSIOLOGY; TEXTILES;

HIDDEN MARKOV MODELS;

ADULT; ARTICLE; AUDITORY STIMULATION; AUTONOMIC NERVOUS SYSTEM; BRAIN CIRCULATION; BREATHING MECHANICS; COMPUTER INTERFACE; ELECTRODERMAL RESPONSE; ENVIRONMENT; FEMALE; HEART RATE; HEMISPHERIC DOMINANCE; HUMAN; MALE; MENTAL FUNCTION; METHODOLOGY; NEAR INFRARED SPECTROSCOPY; PHYSIOLOGY; PREFRONTAL CORTEX; PROBABILITY; PROSTHESIS; SKIN TEMPERATURE; STARTLE REFLEX; VASCULARIZATION;

ACOUSTIC STIMULATION; ADULT; AUTONOMIC NERVOUS SYSTEM; CEREBROVASCULAR CIRCULATION; ENVIRONMENT; FEMALE; FUNCTIONAL LATERALITY; GALVANIC SKIN RESPONSE; HEART RATE; HUMANS; MALE; MARKOV CHAINS; MENTAL PROCESSES; PREFRONTAL CORTEX; PROSTHESIS DESIGN; RESPIRATORY MECHANICS; SKIN TEMPERATURE; SPECTROSCOPY, NEAR-INFRARED; STARTLE REACTION; USER-COMPUTER INTERFACE;

EID: 79954511812     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2010.2078516     Document Type: Article

References (62)

1. A. Sesin, M. Adjouadi, M. Ayala, M. Caberirzo, and A. Barreto, "Eyeing a real-time human-computer interface to assist those with motor disabilities," IEEE Potentials, vol. 27, no. 3, pp. 19-25, 2008. (Pubitemid 351709537)
2. Y. Chen, "Application of tilt sensors in human-computer interface for people with disabilities," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 9, no. 3, pp. 289-294, Sep. 2001. (Pubitemid 32852066)
3. L. Struijk, "An inductive tongue computer interface for control of computers and assistive devices," IEEE Trans. Biomed. Eng., vol. 53, no. 12, pt. 2, pp. 2594-2597, Dec. 2006. (Pubitemid 46019549)
4. M. van Gerven et al., "The brain-computer interface cycle," J. Neural Eng., vol. 6, no. 4, 2009.
5. J. Wolpaw et al., "Brain-computer interface technology: A review of the first international meeting," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164-173, Jun. 2007.
6. R. Sitaram et al., "Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a braincomputer interface," NeuroImage, vol. 34, no. 4, pp. 1416-1427, 2007. (Pubitemid 46187084)
7. T. Germon, P. Evans, N. Barnett, P. Wall, A. Manara, and R. Nelson, "Cerebral near infrared spectroscopy: Emitter-detector separation must be increased," J. Anaesthesia, vol. 82, no. 6, pp. 831-837, 1999. (Pubitemid 29245609)
8. S. Coyle, T. Ward, C. Markham, and G. McDarby, "On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces," Physiol. Meas., vol. 25, pp. 815-822, 2004. (Pubitemid 39121166)
9. F. Matthews, B. Pearlmutter, T. Ward, C. Soraghan, and C. Markham, "Hemodynamics for brain-computer interfaces," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 87-94, Jan. 2008.
10. A. J. Blood and R. J. Zatorre, "Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion," Proc. Nat. Acad. Sci. USA, vol. 98, pp. 11 818-11 823, 2001.
11. M. Naito, Y. Michioka, K. Ozawa, Y. Ito, M. Kiguchi, and T. Kanazawa, "A communication means for totally locked-in ALS patients based on changes in cerebral blood volume measured with near-infrared light," IEICE Trans. Info. Syst., vol. 90, no. 7, pp. 1028-1037, 2007.
12. A. Villringer and B. Chance, "Non-invasive optical spectroscopy and imaging of human brain function," Trends Neurosci., vol. 20, no. 10, pp. 431-433, Oct. 1997.
13. S. Luu and T. Chau, "Decoding subjective preference from single-trial near-infrared spectroscopy signals," J. Neural Eng., vol. 6, no. 4, Feb. 2009.
14. S. Coyle, T. Ward, and C. Markham, "Physiological noise in nearinfrared spectroscopy: Implications for optical brain computer interfacing," in Proc. Int. Conf. IEEE Eng. Med. Biol. Soc., 2004, vol. 2, pp. 4540-4543. (Pubitemid 40035267)
15. Q. Zhang, E. Brown, and G. Strangman, "Adaptive filtering for global interference cancellation and real-time recovery of evoked brain activity: A Monte Carlo simulation study," J. Biomed. Opt., vol. 12, no. 4, p. 044014, 2007.
16. C. Nam, "Environmental noise and P300-based brain-computer interface," in Proc. Human Factors Ergonomics Soc. Annu. Meeting, 2008, vol. 52, pp. 803-807.
17. T. Falk, K. Paton, S. Power, and T. Chau, "Improving the performance of NIRS-based brain-computer interfaces in the presence of background auditory distractions," in Proc. Int. Conf. Acoustics, Speech, Signal Process., 2010, pp. 517-520.
18. S. Banbury and D. Berry, "Disruption of office-related tasks by speech and office noise," Br. J. Psychol., vol. 89, no. 3, pp. 499-517, 1998. (Pubitemid 128452353)
19. V. Gumenyuk, O. Korzyukov, K. Alho, C. Escera, and R. Naatanen, "Effects of auditory distraction on electrophysiological brain activity and performance in children aged 8-13 years," Psychophysiology, vol. 41, no. 1, pp. 30-36, 2004. (Pubitemid 38209026)
20. G. Cassidy and R. MacDonald, "The effect of background music and background noise on the task performance of introverts and extraverts," Psychol. Music, vol. 35, no. 3, pp. 517-537, 2007.
21. M. Flaten, E. Nordmark, and A. Elden, "Effect of background noise on the human startle reflex and prepulse inhibition," Psychophysiology, vol. 42, no. 3, pp. 298-305, 2005. (Pubitemid 40839538)
22. A. Furnham and L. Strbac, "Music is as distracting as noise: The differential distraction of background music and noise on the cognitive test performance of introverts and extraverts," Ergonomics, vol. 45, no. 3, pp. 203-217, 2002. (Pubitemid 34516372)
23. A. Engelien et al., "The neural correlates of 'deaf-hearing' in man: Conscious sensory awareness enabled by attentional modulation," Brain, vol. 123, no. 3, p. 532, 2000.
24. M. Boly et al., "Auditory processing in severely brain injured patients differences between the minimally conscious state and the persistent vegetative state," Arch. Neurol., vol. 61, no. 2, pp. 233-238, 2004. (Pubitemid 38197557)
25. S. Blain, A. Mihailidis, and T. Chau, "Conscious control of electrodermal activity: The potential of mental exercises," in Proc. IEEE Int. Conf. Eng. Med. Biol. Soc., 2006, pp. 6561-6564. (Pubitemid 46521428)
26. R. Freedman and P. Ianni, "Self-control of digital temperature: Physiologica factors and transfer effects," Psychophysiology, vol. 20, pp. 682-689, 1983. (Pubitemid 14216223)
27. D. Kristt and B. Engel, "Learned control of blood pressure in patients with high blood pressure," Circulation, vol. 51, no. 2, pp. 370-378, 1975.
28. C. Deschaumes-Molinaro, A. Dittmar, and E. Vernet-Maury, "Autonomic nervous system response patterns correlate with mental imagery," Physiol. Behav., vol. 51, no. 5, pp. 1021-1027, 1992.
29. B. Wilhelm, M. Jordan, and N. Birbaumer, "Communication in locked-in syndrome: Effects of imagery on salivary pH," Neurology, vol. 67, no. 3, pp. 534-535, 2006. (Pubitemid 44214994)
30. S. Blain, A. Mihailidis, and T. Chau, "Peripheral autonomic signals as access pathways for individuals with severe disabilities: A literature appraisal," Open Rehabil. J., vol. 1, pp. 27-37, 2008.
31. K. Kryter, "Non-auditory effects of environmental noise," Am. J. Public Health, vol. 62, no. 3, pp. 389-398, 1972.
32. S. Blain, S. Power, E. Sejdic, A. Mihailidis, and T. Chau, "A cardiorespiratory classifier of voluntary and involuntary electrodermal activity," BioMedical Eng. OnLine, vol. 9, no. 11, 2010, 13 pages.
33. M. Akbacak and J. Hansen, "Environmental sniffing: Noise knowledge estimation for robust speech systems," IEEE Trans. Audio, Speech, Language Process., vol. 15, no. 2, pp. 465-477, Feb. 2007.
34. G. Morren et al., "Detection of fast neuronal signals in the motor cortex from functional near infrared spectroscopy measurements using independent component analysis," Med. Biol. Eng. Comput., vol. 42, no. 1, pp. 92-99, 2004. (Pubitemid 38196283)
35. I. Sase, H. Eda, A. Seiyama, H. Tanabea, A. Takatsuke, and T. Yanagida, "Multi-channel optical mapping: Investigation of depth information," in Proc. Int. Soc. Opt. Eng., 2001, vol. 4250, pp. 29-36. (Pubitemid 32796493)
36. K. Tai and T. Chau, "Single-trial classification of NIRS signals during emotional induction tasks: Towards a corporeal machine interface," J. NeuroEng. Rehabil., vol. 6, no. 39, 2009.
37. J. Kim and E. Andre, "Emotion recognition based on physiological changes in music listening," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 12, pp. 2067-2083, Dec. 2008.
38. B. Obermaier, C. Guger, C. Neuper, and G. Pfurtscheller, "Hidden Markov models for online classification of single trial EEG data," Pattern Recognit. Lett., vol. 22, no. 12, pp. 1299-1309, 2001. (Pubitemid 32784363)
39. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
40. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc., pp. 1-38, 1977.
41. A. Gersho and R. Gray, Vector Quantization and Signal Compression. Norwell, MA: Kluwer, 1993.
42. T. Falk and W. Chan, "Feature mining for GMM-based speech quality measurement," in Proc. Conf. Signals, Syst. Comput., 2004.
43. M. Boso, P. Politi, F. Barale, and E. Enzo, "Neurophysiology and neurobiology of the musical experience," Funct. Neurol., vol. 21, no. 4, pp. 187-191, 2006. (Pubitemid 46578446)
44. A. Kistler, C. Mariauzouls, and K. von Berlepsch, "Fingertip temperature as an indicator for sympathetic responses," Int. J. Psychophysiol., vol. 29, pp. 35-41, 1998. (Pubitemid 28243135)
45. E. Cook, L. Hawk, T. Davis, and V. Stevenson, "Affective individual differences and startle reflex modulation," J. Abnormal Psychol., vol. 100, no. 1, pp. 5-13, 1991.
46. T. Falk and W. Chan, "Hybrid signal-and-link-parametric speech quality measurement for VoIP communications," IEEE Trans. Audio, Speech Language Process., vol. 16, no. 8, pp. 1579-1589, Aug. 2008.
47. G. Muller-Putz, R. Scherer, C. Brunner, R. Leeb, and G. Pfurtscheller, "Better than random? A closer look on BCI results," Int. J. Bioelectromagn., vol. 10, no. 1, pp. 52-55, 2008.
48. J. Fuster, "The prefrontal cortex-An update: Time is of the essence," Neuron, vol. 30, no. 2, pp. 319-333, 2001. (Pubitemid 32536780)
49. E. Altenmuller, K. Schurmann, V. Lim, and D. Parlitz, "Hits to the left, flops to the right: Different emotions during listening to music are reflected in cortical lateralization patterns," Neuropsychologia, vol. 40, no. 13, pp. 2242-2256, 2002. (Pubitemid 35300152)
50. C. Krumhansl, "An exploratory study of musical emotions and psychophysiology," Canadian J. Exp. Psychol., vol. 51, no. 4, pp. 336-353, 1997.
51. B. Kleber, N. Birmbauer, R. Veit, T. Trevorrow, and M. Lotze, "Overt and imagined singing of an italian aria," NeuroImage, vol. 36, pp. 889-900, 2007. (Pubitemid 46907618)
52. S. Power, T. Falk, and T. Chau, "Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy," J. Neural Eng., vol. 7, no. 2, 2010.
53. J. Grabert, N. Bregman, and H. McAllister, "Skin temperature regulation: The effects of suggestion and feedback," Int. J. Neurosci., vol. 10, pp. 217-221, 1980. (Pubitemid 10134012)
54. E. Bleecker and B. Engel, "Learned control of ventricular rate in patients with atrial fibrilation," Psychosomatic Med., vol. 35, no. 2, pp. 161-175, 1973.
55. E. Elaad and G. Ben-Shakhar, "Effects of mental countermeasures on psychophysiological detection in guilty knowledge test," Int. J. Psychophysiol., vol. 11, no. 2, pp. 99-108, 1991.
56. O. Bolliet, C. Collet, and A. Dittmar, "Autonomic nervous system activity durign actual and mentally simulated prepartion for movement," Appl. Psychophysio. Biofeedback, vol. 30, no. 1, pp. 11-20, 2005. (Pubitemid 40767791)
57. D. Berndt and J. Clifford, "Using dynamic time warping to find patterns in time series," in Proc. AAAI Workshop Knowledge Discovery Databases, 1994, pp. 229-248.
58. M. Guirgis, T. Falk, S. Power, S. Blain, and T. Chau, "Harnessing physiological responses to improve NIRS-based brain-computer interface performance," in Proc. ISSNIP Biosignals Biorobotics Conf., 2010, pp. 59-62.
59. T. Falk, M. Guirgis, S. Power, S. Blain, and T. Chau, "On the use of peripheral autonomic signals for binary control of body-machine interfaces," Physiological Measurement, vol. 31, no. 10, pp. 1-11, 2010.
60. G. Ben-Shakhar and K. Dolev, "Psychophysiological detection through the guilty knowledge technique: Effects of mental countermeasures," J. Appl. Psychol., vol. 81, no. 3, pp. 273-281, 1996. (Pubitemid 126344135)
61. W. Babisch, "Stress hormones in the research on cardiovascular effects of noise," Noise and Health, vol. 5, no. 15, pp. 1-11, 2003. (Pubitemid 37039195)
62. A. Abu-El-Quran, R. Goubran, and A. Chan, "Security monitoring using microphone arrays and audio classification," IEEE Trans. Instrum. Meas., vol. 55, no. 4, pp. 1025-1032, Aug. 2006. (Pubitemid 44111353)