What we can and cannot (yet) do with functional near infrared spectroscopy

Frontiers in Neuroscience

Volumn , Issue 8 MAY, 2014, Pages

  Strait, Megan ^a   Scheutz, Matthias ^a  

^a Tufts University   (United States)

Author keywords

Brain computer interfaces; Functional near infrared spectroscopy; Human computer interaction; Reliability; Signal processing

Indexed keywords

ARTICLE; ARTIFACT; BRAIN COMPUTER INTERFACE; HUMAN; HUMAN COMPUTER INTERACTION; LATENT PERIOD; MOTION; NEAR INFRARED SPECTROSCOPY; NEUROIMAGING; RELIABILITY; SIGNAL PROCESSING; TASK PERFORMANCE;

EID: 84904984562     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2014.00117     Document Type: Article

References (85)

1. Afergan, D., Peck, E., Solovey, E., Jenkins, A., Hincks, S., Chang, R., et al. (2014). "Dynamic difficulty using brain metrics of workload," in CHI. New York, NY: ACM.
2. Aoki, R., Sato, H., Katura, T., Matsuda, R., and Koizumi, H. (2013). Correlation between prefrontal cortex activity during working memory tasks and natural mood independent of personality effects: an optical topography study. Psychiatry Res. Neuroimag. 212, 79-87. doi: 10.1016/j.pscychresns.2012.10.009
3. Aoki, R., Sato, H., Katura, T., Utsugi, K., Koizumi, H., Matsuda, R., et al. (2011). Relationship of negative mood with prefrontal cortex activity during working memory tasks: an optical topography study. Neurosci. Res. 70, 189-196. doi: 10.1016/j.neures.2011.02.011
4. Ayaz, H., Izzetoglu, M., Shewokis, P., and Onaral, B. (2010). Sliding-window motion artifact rejection for functional near-infrared spectroscopy. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2010, 6567-6570. doi: 10.1109/IEMBS.2010.5627113
5. Ayaz, H., Shewokis, P., Bunce, S., Izzetoglu, K., Willems, B., and Onaral, B. (2012). Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36-47. doi: 10.1016/j.neuroimage.2011.06.023
6. Bainbridge, W. A., Nozawa, S., Ueda, R., Okada, K., and Inaba, M. (2012). A methodological outline and utility assessment of sensor-based biosignal measurement in human-robot interaction. Int. J. Soc. Rob. 4, 303-316. doi: 10.1007/s12369-012-0146-y
7. Brigadoi, S., Ceccherini, L., Cutini, S., Scarpa, F., Scatturin, P., Selb, J., et al. (2014). Motion artifacts in functional near-infrared spectroscopy: a comparison of motion correction techniques applied to real cognitive data. Neuroimage 85, 181-191. doi: 10.1016/j.neuroimage.2013.04.082
8. Brouwer, A.-M., van Erp, J., Heylen, D., Jensen, O., and Poel, M. (2013). "Effortless passive BCIs for healthy users," in HCII, (Berlin, Heidelberg: Springer), 615-622.
9. Cacioppo, J., Berntson, G., Lorig, T., Norris, C., Rickett, E., and Nushbaum, H. (2003). Just because you're imaging the brain doesn't mean you can stop using your head: a primer and set of first principles. J. Personality Soc. Psychol. 85, 650-661. doi: 10.1037/0022-3514.85.4.650
10. Canning, C., and Scheutz, M. (2013). Function near-infrared spectroscopy in human-robot interaction. J. Hum. Rob. Interact. 2, 62-84. doi: 10.5898/jhri.v2i3.144
11. Chau, T., and Damouras, S. (2009). Reply to 'on the risk of extracting relevant information from random data.' J. Neural Eng. 6, 058002. doi: 10.1088/1741-2560/6/5/058002
12. Coffey, E., Brouwer, A.-M., and van Erp, J. (2012). "Measuring workload using a combination of electroencephalography and near infrared spectroscopy," in HFES. doi: 10.1177/1071181312561367
13. Cortes, C., and Vapnik, V. (1995). Support-vector networks. Mach. Learn. 20, 273-297.
14. Coyle, S., Ward, T., and Markham, C. (2007). Brain-computer interface using a simplified functional near-infrared spectroscopy system. J. Neural Eng. 4, 219. doi: 10.1088/1741-2560/4/3/007
15. Cui, X., Bray, S., Bryant, D., Glover, G., and Reiss, A. (2011). A quantitative comparison of nirs and fmri across multiple cognitive tasks. Neuroimage 54, 2808-2821. doi: 10.1016/j.neuroimage.2010.10.069
16. Cui, X., Bray, S., and Reiss, A. (2010a). Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics. Neuroimage 49, 3039-3046. doi: 10.1016/j.neuroimage.2009.11.050
17. Cui, X., Bray, S., and Reiss, A. (2010b). Speeded near infrared spectroscopy (NIRS) response detection. PLoS ONE 5:e15474. doi: 10.1371/journal.pone.0015474
18. Cutini, S., Moro, S., and Bisconti, S. (2012). Functional near infrared optical imaging in cognitive neuroscience: an introductory review. J. Near Infrared Spectrosc. 20, 75-92. doi: 10.1255/jnirs.969
19. Cutini, S., Scatturin, P., and Zorzi, M. (2011). A new method based on ICBM152 head surface for probe placement in multichannel fNIRS. Neuroimage 54, 919-927. doi: 10.1016/j.neuroimage.2010.09.030
20. Derosiere, G., Mandrick, K., Dray, G., Ward, T., and Perrey, S. (2013). NIRS-measured prefrontal cortex activity in neuroergonomics: strengths and weaknesses. Front. Hum. Neurosci. 7:583. doi: 10.3389/fnhum.2013.00583
21. Dominguez, L. (2009). On the risk of extracting relevant information from random data. J. Neural Eng. 6, 058001. doi: 10.1088/1741-2560/6/5/058001
22. Falk, T., Guirgis, M., Power, S., and Chau, T. (2011). Taking nirs-bcis outside the lab: achieving robustness against environment noise. Neural Syst. Rehabil. Eng. 19, 136-146. doi: 10.1109/TNSRE.2010.2078516
23. Fekete, T., Rubin, D., Carlson, J., and Mujica-Parodi, L. (2011). The NIRS analysis package: noise reduction and statistical inference. PLoS ONE 6:e24322. doi: 10.1371/journal.pone.0024322
24. Ferrari, M., and Quaresima, V. (2012). A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application. Neuroimage 63, 921-935. doi: 10.1016/j.neuroimage.2012.03.049
25. Frey, J., Mühl, C., Lotte, F., and Hachet, M. (2014). "Review of the use of electroencephalography as an evaluation method for human-computer interaction," in International Conference on Physiological Computing Systems (PhyCS). (Lisbon).
26. George, L., and Lecuyer, A. (2010). "An overview of research on 'passive' brain-computer interfaces for implicit human-computer interaction in International Conference on Applied Bionics and Biomechanics. (Venice).
27. Girouard, A., Solovey, E., Hirshfield, L., Peck, E., Chauncey, K., Sassaroli, A., et al. (2010). "From brain signals to adaptive interfaces: using fNIRS in HCI," in Brain-Computer Interfaces, eds D. S. Tan and A. Nijholt (New York, NY: Springer), 221-237.
28. Girouard, A., Solovey, E., and Jacob, R. (2013). Designing a passive brain computer interface using real time classification of functional near-infrared spectroscopy. Int. J. Auton. Adapt. Commun. Syst. 6, 26-44. doi: 10.1504/IJAACS.2013.050689
29. Gupta, R., Laghari, K., Arndt, S., Schleicher, R., Moller, S., O'Shaughnessy, D., et al. (2013). "Using fNIRS to characterize human perception of TTS system quality, comprehension, and fluency: preliminary findings," in International Workshop on Perceptual Quality of Systems (PQS).
30. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. (2009). The WEKA data mining software: an update. ACM SIGKDD Explor. Newslett. 11, 10-18. doi: 10.1145/1656274.1656278
31. Heger, D., Mutter, R., Herff, C., Putze, F., and Schultz, T. (2013). "Continuous recognition of affective states by functional near infrared spectroscopy signals," in Affective Computing and Intelligent Interaction (ACII). doi: 10.1109/ACII.2013.156
32. Heger, D., Putze, F., and Schultz, T. (2011). "Online recognition of facial actions for natural EEG-based BCI applications," in Affective Computing and Intelligent Interaction (ACII). (Berlin, Heidelberg: Springer-Verlag), 436-446.
33. Herff, C., Heger, D., Fortmann, O., Hennrich, J., Putze, F., and Schultz, T. (2013a). Mental workload during n-back task-quantified in the prefrontal cortex using fNIRS. Front. Hum. Neurosci. 7:935. doi: 10.3389/fnhum.2013.00935
34. Herff, C., Heger, D., Putze, F., Hennrich, J., Fortmann, O., and Schultz, T. (2013b). Classification of mental tasks in the prefrontal cortex using fNIRS. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2013, 2160-2163. doi: 10.1109/EMBC.2013.6609962
35. Hirshfield, L., Chauncey, K., Gulotta, R., Girouard, A., Solovey, E., Jacob, R., et al. (2009a). "Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload," in HCII, (Heidelberg: Springer-Verlag Berlin), 239-247.
36. Hirshfield, L., Solovey, E., Girouard, A., Kebinger, J., Jacob, R., Sassaroli, A., et al. (2009b). "Brain measurement for usability testing and adaptive interfaces: an example of syntactic workload with functional near infrared spectroscopy," in CHI, (New York, NY: ACM), 2185-2194.
37. Hirshfield, L., Gulotta, R., Hirshfield, S., Hincks, S., Russell, M., Ward, R., et al. (2011a). "This is your brain on interfaces: enhancing usability testing with functional near-infrared spectroscopy," in CHI, (New York, NY: ACM), 373-382.
38. Hirshfield, L., Hirshfield, S., Hincks, S., Russell, M., Ward, R., and Williams, T. (2011b). "Trust in human-computer interactions as measured by frustration, surprise, and workload," in Foundations of Augmented Cognition (Orlando, FL), 507-516.
39. Hoshi, Y. (2003). Functional near-infrared optical imaging: utility and limitations in human brain mapping. Psychophysiology 40, 511-520. doi: 10.1111/1469-8986.00053
40. Hoshi, Y. (2007). Functional near-infrared spectroscopy: current status and future prospects. J. Biomed. Opt. 12:062106. doi: 10.1117/1.2804911
41. Hoshi, Y. (2011). Towards the next generation of near-infrared spectroscopy. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 369, 4425-4439. doi: 10.1098/rsta.2011.0262
42. Hu, X., Hong, K., and Ge, S. (2013). Reduction of trial-to-trial variability in functional near-infrared spectroscopy signals by accounting for resting-state functional connectivity. J. Biomed. Opt. 18:17003. doi: 10.1117/1.JBO.18.1.017003
43. Izzetoglu, M., Chitrapu, P., Bunce, S., and Onaral, B. (2010). Motion artifact cancellation in NIR spectroscopy using discrete kalman filtering. Biomed. Eng. Online 9, 16. doi: 10.1186/1475-925X-9-16
44. Kawaguchi, Y., Wada, K., Okamoto, M., Tsujii, T., Shibata, T., and Sakatani, K. (2011). "Investigation of brain activity after interaction with seal robot measured by fnirs," in Robot and Human Interactive Communication, 308-313. doi: 10.1109/ROMAN.2012.6343812
45. Kirilina, E., Jelzow, A., Heine, A., Niessing, M., Wabnitz, H., Bruhl, R., et al. (2012). The physiological origin of task-evoked systemic artifacts in functional near infrared spectroscopy. Neuroimage 61, 70-81. doi: 10.1016/j.neuroimage.2012.02.074
46. Krusienski, D., Grosse-Wentrup, M., Galan, F., Coyle, D., Miller, K., Forney, E., et al. (2011). Critical issues in state-of-the-art brain-computer interface signal processing. J. Neural Eng. 8:025002. doi: 10.1088/1741-2560/8/2/025002
47. Liu, Y., Sourina, O., and Nguyen, M. (2011). "Real-time EEG-based emotion recognition and its applications," in Transactions on Computational Science XII, eds M. L. Gavrilova, C. J. Kenneth Tan, A, Sourin, andO, Sourina (Berlin: Springer), 256-277. doi: 10.1007/978-3-642-22336-5_13
48. Lloyd-Fox, S., Blasi, A., and Elwell, C. (2010). Illuminating the developing brain: the past, present and future of functional near infrared spectroscopy. Neurosci. Biobehav. Rev. 34, 269-284. doi: 10.1016/j.neubiorev.2009.07.008
49. Logothetis, N. (2008). What we can do and what we cannot do with fMRI. Nature 453, 869-878. doi: 10.1038/nature06976
50. Lotte, F. (2011). "Brain-computer interfaces for 3d games: hype or hope?" in Foundations of Digital Games (New York, NY: ACM), 325-327. doi: 10.1145/2159365.2159427
51. Lu, C., Zhang, Y., Biswal, B., Zang, Y., Peng, D., and Zhu, C. (2010). Use of fNIRS to assess resting state functional connectivity. J. Neurosci. Methods 186, 242-249. doi: 10.1016/j.jneumeth.2009.11.010
52. Luu, S., and Chau, T. (2009). Decoding subjective preference from single-trial near-infrared spectroscopy signals. J. Neural Eng. 6, 016003. doi: 10.1088/1741-2560/6/1/016003
53. Matsuyama, H., Asama, H., and Otake, M. (2009). "Design of differential near-infrared spectroscopy based brain machine interface," in Robot and Human Interactive Communication, 775-780. doi: 10.1109/ROMAN.2009.5326215
54. Matthews, F., and Pearlmutter, B. (2008). Hemodynamics for brain-computer interfaces. Signal Process. 25, 87-94. doi: 10.1109/MSP.2008.4408445
55. Molvi, B., and Dumont, G. (2012). Wavelet-based motion artifact removal for functional near-infrared spectroscopy. Physiol. Meas. 33, 259. doi: 10.1088/0967-3334/33/2/259
56. Nozawa, T. (2010). Autonomous adaptive agent with intrinsic motivation for sustainable hai. J. Intell. Learn. Syst. Appl. 2, 167-178. doi: 10.4236/jilsa.2010.24020
57. Ohara, K., Sellen, A., and Harper, R. (2011). "Embodiment in brain-computer interaction," in CHI. doi: 10.1145/1978942.1978994
58. Oriheula-Espina, F., Leff, D., James, D., Darzi, A., and Yang, G. (2010). Quality control and assurance in functional near infrared spectroscopy (fNIRS) experimentation. Phys. Med. Biol. 55, 3701-3724. doi: 10.1088/0031-9155/55/13/009
59. Peck, E., Afergan, D., and Jacob, R. (2013). "Brain sensing as input to information filtering systems," in 4th Augmented Human International Conference, AH'13, (Stuttgart, Germany) 142-149.
60. Plichta, M., Herrmann, M., Baehne, C., Ehlis, A., Richter, M., Pauli, P., et al. (2007). Event-related functional near-infrared spectroscopy (fNIRS) based on craniocerebral correlations: reproducibility of activation? Hum. Brain Mapp. 28, 733-741. doi: 10.1002/hbm.20303
61. Power, S., Kushki, A., and Chau, T. (2012). Intersession consistency of single-trial classification of prefrontal response to mental arithmetic and no-control state by NIRS. PLoS ONE 7:e37791. doi: 10.1371/journal.pone.0037791
62. Robertson, F. C., Douglas, T. S., and Meintjes, E. M. (2010). Motion artifact removal for functional near infrared spectroscopy: a comparison of methods. IEEE Trans. Biomed. Eng. 57, 1377-1387. doi: 10.1109/TBME.2009.2038667
63. Sassaroli, A., Zheng, F., Hirshfield, L., Coutts, M., Girouard, A., Solovey, E., et al. (2009). "Application of near-infrared spectroscopy for discrimination of mental workloads," SPIE. doi: 10.1117/12.807737
64. Scarpa, F., Brigadoi, S., Cutini, S., Scatturin, P., Zorzi, M., Dell'Acqua, R., et al. (2013). A reference-channel based methodology to improve estimation of event related hemodynamic response from fNIRS measurements. Neuroimage. 72, 106-119. doi: 10.1016/j.neuroimage.2013.01.021
65. Scholkmann, F., Kleiser, S., Metz, A., Zimmermann, R., Pavi, J., Wolf, U., et al. (2014). A review on continuous wave functional near-infrared spectroscopy and imaging instrumentation and methodology. Neuroimage 85, 6-27. doi: 10.1016/j.neuroimage.2013.05.004
66. Scholkmann, F., Spichtig, S., Muehlemann, T., and Wolf, M. (2010). How to detect and reduce movement artifacts in near-infrared imaging using moving standard deviation and spline interpolation. Physiol. Meas. 31, 649-662. doi: 10.1088/0967-3334/31/5/004
67. Schudlo, L., and Chau, T. (2014). Dynamic topographical pattern classification of multichannel prefrontal NIRS signals: online differentiation of mental arithmetic and rest. J. Neural Eng. 11:016003. doi: 10.1088/1741-2560/11/1/016003
68. Solovey, E., Lalooses, F., Chauncey, K., Weaver, D., Parasi, M., Scheutz, M., et al. (2011). "Sensing cognitive multitasking for a brain-based adaptive user interface," in Conference on Human Factors in Computing Systems (CHI), 383-392. doi: 10.1145/1978942.1978997
69. Solovey, E., Schermerhorn, P., Scheutz, M., Sassaroli, A., Fantini, S., and Jacob, R. (2012). "Brainput: enhancing interactive systems with streaming fNIRS brain input," in CHI, (New York, NY: ACM), 2193-2202. doi: 10.1145/2207676.2208372
70. Solovey, E. T. (2012). Real-Time fNIRS Brain Input for Enhancing Interactive Systems. PhD thesis, Tufts University.
71. Strait, M., Briggs, G., and Scheutz, M. (2013a). "Some correlates of agency ascription and emotional value and their effects on decision- making," in Conference on Affective Computing and Intelligent Interaction (ACII), (Washington, DC), 505-510. doi: 10.1109/ACII.2013.89
72. Strait, M., Canning, C., and Scheutz, M. (2013b). "Limitations of NIRS-based BCI for realistic applications in human-computer interaction," in BCI Meeting, (Monterey, CA), 6-7.
73. Strait, M., Canning, C., and Scheutz, M. (2014a). "Let me tell you! investigating the effects of robot communication strategies in advice- giving situations based on robot appearance, interaction modality and distance," in Human-Robot Interaction (HRI), (New York, NY: ACM). doi: 10.1145/2559636.2559670
74. Strait, M., Canning, C., and Scheutz, S. (2014b). "Reliability of NIRS-Based BCIs: a placebo-controlled replication and reanalysis of Brainput," in Human Factors in Computing (CHI), Extended Abstracts. doi: 10.1145/2559206.2578866
75. Strait, M., and Scheutz, M. (2014). "Using near infrared spectroscopy to index temporal changes in affect in realistic human-robot interactions," in Physiological Computing Systems (PhyCS), Special Session on Affect Recogntion from Physiological Data for Social Robots.
76. Szafir, D., and Mutlu, B. (2012). "Pay attention! designing adaptive agents that monitor and improve user engagement," in Conference on Human Factors in Computing Systems (CHI), (New York, NY: ACM), 11-20. doi: 10.1145/2207676.2207679
77. Tak, S., and Ye, J. (2014). Statistical analysis of fNIRS data: a comprehensive review. Neuroimage 85, 92-103. doi: 10.1016/j.neuroimage.2013.06.016
78. Tan, D., and Nijholt, A., editors (2010). Brain-Computer Interfaces: Applying Our Minds to Human-Computer Interaction. London: Springer. doi: 10.1007/978-1-84996-272-8
79. Tanaka, H., Katura, T., and Sato, H. (2012). Task-related component analysis for functional neuroimaging and application to near-infrared spectroscopy data. Neuroimage 64, 308-327. doi: 10.1016/j.neuroimage.2012.08.044
80. Tsuzuki, D., and Dan, I. (2014). Spatial registration for functional near-infrared spectroscopy: from channel position on the scalp to cortical location in individual and group analyses. Neuroimage 85, 92-103. doi: 10.1016/j.neuroimage.2013.07.025
81. Tupak, S., Dresler, T., Guhn, A., Ehlis, A., Fallgatter, A., Pauli, P., et al. (2014). Implicit emotion regulation in the presence of threat: neural and autonomic correlates. Neuroimage 85, 372-379. doi: 10.1016/j.neuroimage.2013.09.066
82. Villringer, A., Planck, J., Hock, C., Schleinkofer, L., and Dirnagl, U. (1993). Near infrared spectroscopy (NIRS): a new tool to study hemodynamic changes during activation of brain function in human adults. Neurosci. Lett. 154, 101-104. doi: 10.1016/0304-3940(93)90181-J
83. Virtanen, J., Noponen, T., Kotilahti, K., Virtanen, J., and Ilmoniemi, R. (2011). Accelerometer-based method for correcting signal baseline changes caused by motion artifacts in medical near-infrared spectroscopy. J. Biomed. Opt. 16, 087005. doi: 10.1117/1.3606576
84. Ye, J., Tak, S., Jang, K., Jung, J., and Jang, J. (2009). NIRS-SPM: statistical parametric mapping for near-infrared spectroscopy. Neuroimage 44, 428-447. doi: 10.1016/j.neuroimage.2008.08.036
85. Zander, T., and Kothe, C. (2011). Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J. Neural Eng. 8, 025005. doi: 10.1088/1741-2560/8/2/025005