Online decoding of object-based attention using real-time fMRI

European Journal of Neuroscience

Volumn 39, Issue 2, 2014, Pages 319-329

  Niazi, Adnan M ^a,b   van den Broek, Philip L C ^a   Klanke, Stefan ^a   Barth, Markus ^a   Poel, Mannes ^b   Desain, Peter ^a   van Gerven, Marcel A J ^a  

^a RADBOUD UNIVERSITY   (Netherlands)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Categorization; Multivariate decoding; Object based attention; Real time fMRI

Indexed keywords

ADULT; ARTICLE; ATTENTION; CODING; ELECTROENCEPHALOGRAPHY; EVOKED VISUAL RESPONSE; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; MAGNETOENCEPHALOGRAPHY; MALE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; ORIENTATION; PRIORITY JOURNAL; REAL TIME FUNCTIONAL MAGNETIC RESONANCE IMAGING; VISUAL ATTENTION; VISUAL STIMULATION; YOUNG ADULT;

CATEGORIZATION; MULTIVARIATE DECODING; OBJECT-BASED ATTENTION; REAL-TIME FMRI;

ADULT; ARCHITECTURE AS TOPIC; ATTENTION; BRAIN; BRAIN MAPPING; CLUSTER ANALYSIS; FACE; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MULTIVARIATE ANALYSIS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS; YOUNG ADULT;

EID: 84892678462     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/ejn.12405     Document Type: Article

References (67)

1. Aguirre, G.K., Detre, J.A., Alsop, D.C. & D'Esposito, M. (1996) The parahippocampus subserves topographical learning in man. Cereb. Cortex, 6, 823-829.
2. Aguirre, G.K., Zarahn, E. & D'Esposito, M. (1998) An area within human ventral cortex sensitive to "building" stimuli: evidence and implications. Neuron, 21, 373-383.
3. Allen, G. (1997) Attentional activation of the cerebellum independent of motor involvement. Science, 275, 1940-1943.
4. Anderson, A., Han, D., Douglas, P.K., Bramen, J. & Cohen, M.S. (2011) Real-Time Functional MRI Classification of Brain States Using Markov-SVM Hybrid Models: Peering Inside the rt-fMRI Black Box. In Langs, G., Rish, I., Grosse-Wentrup, M. & Murphy, B. (Eds), Machine Learning and Interpretation in Neuroimaging. Springer Berlin Heidelberg, Spain, pp. 242-255.
5. Ashburner, J. & Friston, K.J. (2005) Unified segmentation. NeuroImage, 26, 839-851.
6. Bagarinao, E., Matsuo, K., Nakai, T. & Sato, S. (2003) Estimation of general linear model coefficients for real-time application. NeuroImage, 19, 422-429.
7. Baker, C.I., Behrmann, M. & Olson, C.R. (2002) Impact of learning on representation of parts and wholes in monkey inferotemporal cortex. Nat. Neurosci., 5, 1210-1216.
8. Brincat, S.L. & Connor, C.E. (2004) Underlying principles of visual shape selectivity in posterior inferotemporal cortex. Nat. Neurosci., 7, 880-886.
9. Cerf, M., Thiruvengadam, N., Mormann, F., Kraskov, A., Quiroga, R.Q., Koch, C. & Fried, I. (2010) On-line, voluntary control of human temporal lobe neurons. Nature, 467, 1104-1108.
10. Danckert, J., Maruff, P., Ymer, C., Kinsella, G., Yucel, M., de Graaff, S. & Currie, J. (2000) Goal-directed selective attention and response competition monitoring: evidence from unilateral parietal and anterior cingulate lesions. Neuropsychology, 14, 16-28.
11. Davis, K.D., Hutchison, W.D., Lozano, A.M., Tasker, R.R. & Dostrovsky, J.O. (2000) Human anterior cingulate cortex neurons modulated by attention-demanding tasks. J. Neurophysiol., 83, 3575-3577.
12. DeBettencourt, M.T., Lee, R.F., Cohen, J.D., Norman, K.A. & Turk-Browne, N.B. (2012) Real-time decoding and training of attention. J. Vision, 12, 377.
13. Dehaene, S. & Cohen, L. (2011) The unique role of the visual word form area in reading. Trends Cogn. Sci., 15, 254-262.
14. Desimone, R. & Duncan, J. (1995) Neural mechanisms of selective visual attention. Annu. Rev. Neurosci., 18, 193-222.
15. Eimer, M. (1996) The N2pc component as an indicator of attentional selectivity. Electroen. Clin. Neuro., 99, 225-234.
16. Epstein, R. & Kanwisher, N. (1998) A cortical representation of the local visual environment. Nature, 392, 598-601.
17. Epstein, R., Harris, A., Stanley, D. & Kanwisher, N. (1999) The parahippocampal place area: recognition, navigation, or encoding? Neuron, 23, 115-125.
18. Ewbank, M.P., Schluppeck, D. & Andrews, T.J. (2005) fMR-adaptation reveals a distributed representation of inanimate objects and places in human visual cortex. NeuroImage, 28, 268-279.
19. Friedman, J., Hastie, T. & Tibshirani, R. (2010) Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw., 33, 1-22.
20. Gazzaley, A., Cooney, J.W., McEvoy, K., Knight, R.T. & D'Esposito, M. (2005) Top-down enhancement and suppression of the magnitude and speed of neural activity. J. Cognitive Neurosci., 17, 507-517.
21. Goh, J.O.S., Siong, S.C., Park, D., Gutchess, A., Hebrank, A. & Chee, M.W.L. (2004) Cortical areas involved in object, background, and object-background processing revealed with functional magnetic resonance adaptation. J. Neurosci., 24, 10223-10228.
22. Gorno-Tempini, M.L. & Price, C.J. (2001) Identification of famous faces and buildings: a functional neuroimaging study of semantically unique items. Brain, 124, 2087-2097.
23. Hahn, B., Ross, T.J. & Stein, E.A. (2006) Neuroanatomical dissociation between bottom-up and top-down processes of visuospatial selective attention. NeuroImage, 32, 842-853.
24. Hanson, S.J. & Schmidt, A. (2011) High-resolution imaging of the fusiform face area (FFA) using multivariate non-linear classifiers shows diagnosticity for non-face categories. NeuroImage, 54, 1715-1734.
25. Hartmann, T., Schulz, H. & Weisz, N. (2011) Probing of brain states in real-time: introducing the ConSole environment. Front. Psychol., 2, 36.
26. Haxby, J.V., Gobbini, M.I., Furey, M.L., Ishai, A., Schouten, J.L. & Pietrini, P. (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 293, 2425-2430.
27. Haynes, J.-D. & Rees, G. (2006) Decoding mental states from brain activity in humans. Nat. Rev. Neurosci., 7, 523-534.
28. Hillis, A.E., Newhart, M., Heidler, J., Barker, P., Herskovits, E. & Degaonkar, M. (2005) The roles of the "visual word form area" in reading. NeuroImage, 24, 548-559.
29. Hollmann, M., Rieger, J.W., Baecke, S., Lützkendorf, R., Müller, C., Adolf, D. & Bernarding, J. (2011) Predicting decisions in human social interactions using real-time fMRI and pattern classification. PLoS One, 6, e25304.
30. Hopf, J.M., Luck, S.J., Girelli, M., Hagner, T., Mangun, G.R., Scheich, H. & Heinze, H.J. (2000) Neural sources of focused attention in visual search. Cereb. Cortex, 10, 1233-1241.
31. Jensen, O., Bahramisharif, A., Oostenveld, R., Klanke, S., Hadjipapas, A., Okazaki, Y.O. & van Gerven, M.A.J. (2011) Using brain-computer interfaces and brain-state dependent stimulation as tools in cognitive neuroscience. Front. Psychol., 2, 100.
32. Kamitani, Y. & Tong, F. (2005) Decoding the visual and subjective contents of the human brain. Nat. Neurosci., 8, 679-685.
33. Kanwisher, N., McDermott, J. & Chun, M.M. (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci., 17, 4302-4311.
34. Knapen, T., Brascamp, J., Pearson, J., van Ee, R. & Blake, R. (2011) The role of frontal and parietal brain areas in bistable perception. J. Neurosci., 31, 10293-10301.
35. Laconte, S.M., Peltier, S.J. & Hu, X.P. (2007) Real-Time fMRI using brain-state classification. Hum. Brain Mapp., 1044, 1033-1044.
36. Lee, S., Ruiz, S., Caria, A., Veit, R., Birbaumer, N. & Sitaram, R. (2011) Detection of cerebral reorganization induced by real-time fMRI feedback training of insula activation: a multivariate investigation. Neurorehab. Neural Re., 25, 259-267.
37. Li, W., Piëch, V. & Gilbert, C.D. (2004) Perceptual learning and top-down influences in primary visual cortex. Nat. Neurosci., 7, 651-657.
38. Li, L., Gratton, C., Yao, D. & Knight, R.T. (2010) Role of frontal and parietal cortices in the control of bottom-up and top-down attention in humans. Brain Res., 1344, 173-184.
39. Liu, J., Harris, A. & Kanwisher, N. (2002) Stages of processing in face perception: an MEG study. Nat. Neurosci., 5, 910-916.
40. Luck, S.J., Fan, S. & Hillyard, S.A. (1993) Attention-related modulation of sensory-evoked brain activity in a visual search task. J. Cognitive Neurosci., 5, 188-195.
41. Macevoy, S.P. & Epstein, R.A. (2009) Decoding the representation of multiple simultaneous objects in human occipitotemporal cortex. Curr. Biol., 19, 943-947.
42. McCandliss, B.D., Cohen, L. & Dehaene, S. (2003) The visual word form area: expertise for reading in the fusiform gyrus. Trends Cogn. Sci., 7, 293-299.
43. McCarthy, G., Puce, A., Gore, J.C. & Allison, T. (1997) Face-specific processing in the human fusiform gyrus. J. Cognitive Neurosci., 9, 605-610.
44. Mur, M., Ruff, D.A., Bodurka, J., De Weerd, P., Bandettini, P.A. & Kriegeskorte, N. (2012) Categorical, yet graded-single-image activation profiles of human category-selective cortical regions. J. Neurosci., 32, 8649-8662.
45. Nichols, T. & Hayasaka, S. (2003) Controlling the familywise error rate in functional neuroimaging: a comparative review. Stat. Methods Med. Res., 12, 419-446.
46. O'Craven, K.M., Downing, P.E. & Kanwisher, N. (1999) fMRI evidence for objects as the units of attentional selection. Nature, 401, 584-587.
47. Oostenveld, R., Fries, P., Maris, E. & Schoffelen, J.-M. (2011) FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci., 2011, 156869.
48. Pierce, K., Haist, F., Sedaghat, F. & Courchesne, E. (2004) The brain response to personally familiar faces in autism: findings of fusiform activity and beyond. Brain, 127, 2703-2716.
49. Pitcher, D., Walsh, V., Yovel, G. & Duchaine, B. (2007) TMS evidence for the involvement of the right occipital face area in early face processing. Curr. Biol., 17, 1568-1573.
50. Pitcher, D., Garrido, L., Walsh, V. & Duchaine, B. (2008) TMS disrupts the perception and embodiment of facial expressions. J. Neurosci., 8, 700.
51. Puce, A., Allison, T., Gore, J.C. & McCarthy, G. (1995) Face-sensitive regions in human extrastriate cortex studied by functional MRI. J. Neurophysiol., 74, 1192-1199.
52. Rahnev, D., Maniscalco, B., Graves, T., de Huang, E., Lange, F.P. & Lau, H. (2011) Attention induces conservative subjective biases in visual perception. Nat. Neurosci., 14, 1513-1515.
53. Reddy, L. & Kanwisher, N. (2006) Coding of visual objects in the ventral stream. Curr. Opin. Neurobiol., 16, 408-414.
54. Reddy, L. & Tsuchiya, N. (2010) Reading the minds eye: decoding category information during mental imagery. NeuroImage, 50, 818-825.
55. Rissman, J. & Wagner, A.D. (2012) Distributed representations in memory: insights from functional brain imaging. Annu. Rev. Psychol., 63, 101-128.
56. Rosenbaum, R.S., Ziegler, M., Winocur, G., Grady, C.L. & Moscovitch, M. (2004) "I have often walked down this street before": fMRI studies on the hippocampus and other structures during mental navigation of an old environment. Hippocampus, 14, 826-835.
57. Serences, J.T., Schwarzbach, J., Courtney, S.M., Golay, X. & Yantis, S. (2004) Control of object-based attention in human cortex. Cereb. Cortex, 14, 1346-1357.
58. Seymour, K., Clifford, C.W.G., Logothetis, N.K. & Bartels, A. (2009) The coding of color, motion, and their conjunction in the human visual cortex. Curr. Biol., 19, 177-183.
59. Shah, N.J., Marshall, J.C., Zafiris, O., Schwab, A., Zilles, K., Markowitsch, H.J. & Fink, G.R. (2001) The neural correlates of person familiarity. A functional magnetic resonance imaging study with clinical implications. Brain, 124, 804-815.
60. Sulpizio, V., Committeri, G., Lambrey, S., Berthoz, A. & Galati, G. (2013) Selective role of lingual/parahippocampal gyrus and retrosplenial complex in spatial memory across viewpoint changes relative to the environmental reference frame. Behav. Brain Res., 242, 62-75.
61. Thesen, S., Heid, O., Mueller, E. & Schad, L.R. (2000) Prospective acquisition correction for head motion with image-based tracking for Real-Time fMRI. Magn. Reson. Med., 465, 457-465.
62. Tong, F. & Pratte, M.S. (2012) Decoding patterns of human brain activity. Annu. Rev. Psychol., 63, 483-509.
63. Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B. & Joliot, M. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage, 15, 273-289.
64. Weiner, K.S. & Grill-Spector, K. (2012) The improbable simplicity of the fusiform face area. Trends Cogn. Sci., 16, 251-254.
65. Weiskopf, N., Scharnowski, F., Veit, R., Goebel, R., Birbaumer, N. & Mathiak, K. (2005) Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI). J. Physiol. Paris, 98, 357-373.
66. Xi, Y.T., Xu, H., Lee, R. & Ramadge, P.J. (2011) Online kernel SVM for Real-time fMRI brain state prediction. IEEE International Conference on Acoustics Speech and Signal Processing ICASSP, 2040-2043.
67. Yi, D.-J., Kelley, T.A., Marois, R. & Chun, M.M. (2006) Attentional modulation of repetition attenuation is anatomically dissociable for scenes and faces. Brain Res., 1080, 53-62.