Online tracking of the contents of conscious perception using real-time fMRI

Frontiers in Neuroscience

Volumn , Issue 8 MAY, 2014, Pages

  Reichert, Christoph ^a,b,c   Fendrich, Robert ^a,d   Bernarding, Johannes ^b   Tempelmann, Claus ^a   Hinrichs, Hermann ^a,c,e,f,g   Rieger, Jochem W ^h  

^a Department of Neurology   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

^c Forschungscampus STIMULATE   (Germany)

^d Lamont Doherty Earth Observatory   (United States)

^e LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

^f GERMAN CENTER FOR NEURODEGENERATIVE DISEASES DZNE   (Germany)

^g CENTER FOR BEHAVIORAL BRAIN SCIENCES   (Germany)

^h UNIVERSITY OF OLDENBURG   (Germany)

Author keywords

Ambiguous stimulus; Anorthoscopic; Bistable perception; Object integration; Real time fmri; Slit viewing

Indexed keywords

ADULT; ARTICLE; BOLD SIGNAL; BRAIN COMPUTER INTERFACE; ELECTROENCEPHALOGRAM; EYE MOVEMENT; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMODYNAMICS; HUMAN; MACHINE LEARNING; MALE; NUCLEAR MAGNETIC RESONANCE SCANNER; ONLINE ANALYSIS; ONLINE MONITORING; PERCEPTION; PERCEPTIVE DISCRIMINATION; REAL TIME FUNCTIONAL MAGNETIC RESONANCE IMAGING; SIGNAL PROCESSING; TIME PERCEPTION; VISION;

EID: 84904992233     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2014.00116     Document Type: Article

References (51)

1. Bregman, A. S. (1990). Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press.
2. Brouwer, G. J., and van Ee, R. (2007). Visual cortex allows prediction of perceptual states during ambiguous structure-from-motion. J. Neurosci. 27, 1015-1023. doi: 10.1523/JNEUROSCI.4593-06.2007
3. Burges, C. J. C. (1998). A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 2, 121-167. doi: 10.1023/A:1009715923555
4. Castelo-Branco, M., Formisano, E., Backes, W., Zanella, F., Neuenschwander, S., Singer, W., et al. (2002). Activity patterns in human motion-sensitive areas depend on the interpretation of global motion. Proc. Natl. Acad. Sci. U.S.A. 99, 13914-13919. doi: 10.1073/pnas.202049999
5. Chang, E. F., Rieger, J. W., Johnson, K., Berger, M. S., Barbaro, N. M., and Knight, R. T. (2010). Categorical speech representation in human superior temporal gyrus. Nat. Neurosci. 13, 1428-1432. doi: 10.1038/nn.2641
6. Cherkassky, V., and Mulier, F. M. (1998). Learning from Data: Concepts, Theory, and Methods. New York, NY: John Wiley & Sons.
7. Cox, D. D., and Savoy, R. L. (2003). Functional magnetic resonance imaging (fMRI) brain reading: detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19, 261-270. doi: 10.1016/S1053-8119(03)00049-1
8. Cusack, R. (2005). The intraparietal sulcus and perceptual organization. J. Cogn. Neurosci. 17, 641-651. doi: 10.1162/0898929053467541
9. Deike, S., Scheich, H., and Brechmann, A. (2010). Active stream segregation specifically involves the left human auditory cortex. Hear. Res. 265, 30-37. doi: 10.1016/j.heares.2010.03.005
10. Denham, S., Bendixen, A., Mill, R., Toth, D., Wennekers, T., Coath, M., et al. (2012). Characterising switching behaviour in perceptual multi-stability. J. Neurosci. Methods 210, 79-92. doi: 10.1016/j.jneumeth.2012.04.004
11. de-Wit, L. H., Kubilius, J., Wagemans, J., and Op de Beeck, H. P. (2012). Bistable Gestalts reduce activity in the whole of V1, not just the retinotopically predicted parts. J. Vis. 12:12. doi: 10.1167/12.11.12
12. Dumoulin, S. O., Bittar, R. G., Kabani, N. J., Baker, C. L., Le Goualher, G., Pike, G. B., et al. (2000). A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. Cereb. Cortex 10, 454-463. doi: 10.1093/cercor/10.5.454
13. Fang, F., Kersten, D., and Murray, S. O. (2008). Perceptual grouping and inverse fMRI activity patterns in human visual cortex. J. Vis. 8:2. doi: 10.1167/8.7.2
14. Fazli, S., Popescu, F., Danószy, M., Blankertz, B., Müller, K. R., and Grozea, C. (2009). Subject-independent mental state classification in single trials. Neural Netw. 22, 1305-1312. doi: 10.1016/j.neunet.2009.06.003
15. Fendrich, R., Rieger, J. W., and Heinze, H. J. (2005). The effect of retinal stabilization on anorthoscopic percepts under free-viewing conditions. Vision Res. 45, 567-582. doi: 10.1016/j.visres.2004.09.025
16. Freeman, E. D., Sterzer, P., and Driver, J. (2012). fMRI correlates of subjective reversals in ambiguous structure-from-motion. J. Vis. 12:6. doi: 10.1167/12.6.35
17. Good, P. I. (2005). Permutation, Parametric, and Bootstrap Tests of Hypotheses. New York, NY: Springer.
18. Grill-Spector, K., Kushnir, T., Hendler, T., and Malach, R. (2000). The dynamics of object-selective activation correlate with recognition performance in humans. Nat. Neurosci. 3, 837-843. doi: 10.1038/77754
19. Gutschalk, A., Micheyl, C., Melcher, J. R., Rupp, A., Scherg, M., and Oxenham, A. J. (2005). Neuromagnetic correlates of streaming in human auditory cortex. J. Neurosci. 25, 5382-5388. doi: 10.1523/JNEUROSCI.0347-05.2005
20. Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., and Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430. doi: 10.1126/science.1063736
21. Haynes, J. D., and Rees, G. (2005). Predicting the stream of consciousness from activity in human visual cortex. Curr. Biol. 15, 1301-1307. doi: 10.1016/j.cub.2005.06.026
22. Hollmann, M., Mönch, T., Mulla-Osman, S., Tempelmann, C., Stadler, J., and Bernarding, J. (2008). A new concept of a unified parameter management, experiment control, and data analysis in fMRI: application to real-time fMRI at 3T and 7T. J. Neurosci. Methods 175, 154-162. doi: 10.1016/j.jneumeth.2008.08.013
23. Hollmann, M., Rieger, J. W., Baecke, S., Lützkendorf, R., Müller, C., Adolf, D., et al. (2011). Predicting decisions in human social interactions using real-time fMRI and pattern classification. PLoS ONE 6:e25304. doi: 10.1371/journal.pone.0025304
24. Ishai, A., Ungerleider, L. G., Martin, A., and Haxby, J. V. (2000). The representation of objects in the human occipital and temporal cortex. J. Cogn. Neurosci. 12, 35-51. doi: 10.1162/089892900564055
25. Kay, K. N., Naselaris, T., Prenger, R. J., and Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature 452, 352-355. doi: 10.1038/nature06713
26. Kleinschmidt, A., Büchel, C., Zeki, S., and Frackowiak, R. S. J. (1998). Human brain activity during spontaneously reversing perception of ambiguous figures. Proc. Biol. Sci. 265, 2427-2433. doi: 10.1098/rspb.1998.0594
27. Kondo, H. M., and Kashino, M. (2009). Involvement of the thalamocortical loop in the spontaneous switching of percepts in auditory streaming. J. Neurosci. 29, 12695-12701. doi: 10.1523/JNEUROSCI.1549-09.2009
28. Kornmeier, J., Hein, C. M., and Bach, M. (2009). Multistable perception: when bottom-up and top-down coincide. Brain Cogn. 69, 138-147. doi: 10.1016/j.bandc.2008.06.005
29. Kourtzi, Z., and Kanwisher, N. (2000). Cortical regions involved in perceiving object shape. J. Neurosci. 20, 3310-3318.
30. LaConte, S. M., Peltier, S. J., and Hu, X. P. P. (2007). Real-time fMRI using brain-state classification. Hum. Brain Mapp. 28, 1033-1044. doi: 10.1002/hbm.20326
31. Mourão-Miranda, J., Bokde, A. L. W., Born, C., Hampel, H., and Stetter, M. (2005). Classifying brain states and determining the discriminating activation patterns: support vector machine on functional MRI data. Neuroimage 28, 980-995. doi: 10.1016/j.neuroimage.2005.06.070
32. Mumford, D. (1992). On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol. Cybern. 66, 241-251. doi: 10.1007/BF00198477
33. Murray, S. O., Kersten, D., Olshausen, B. A., Schrater, P., and Woods, D. L. (2002). Shape perception reduces activity in human primary visual cortex. Proc. Natl. Acad. Sci. U.S.A. 99, 15164-15169. doi: 10.1073/pnas.192579399
34. Norman, K. A., Polyn, S. M., Detre, G. J., and Haxby, J. V. (2006). Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 10, 424-430. doi: 10.1016/j.tics.2006.07.005
35. Peltier, S., Stilla, R., Mariola, E., LaConte, S., Hu, X., and Sathian, K. (2007). Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception. Neuropsychologia 45, 476-483. doi: 10.1016/j.neuropsychologia.2006.03.003
36. Pressnitzer, D., and Hupé, J. M. (2006). Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization. Curr. Biol. 16, 1351-1357. doi: 10.1016/j.cub.2006.05.054
37. Rao, R. P. N., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
38. Rees, G., Kreiman, G., and Koch, C. (2002). Neural correlates of consciousness in humans. Nat. Rev. Neurosci. 3, 261-270. doi: 10.1038/nrn783
39. Rieger, J. W., Grüschow, M., Heinze, H. J., and Fendrich, R. (2007). The appearance of figures seen through a narrow aperture under free viewing conditions: effects of spontaneous eye motions. J. Vis. 7:10. doi: 10.1167/7.6.10
40. Rieger, J. W., Reichert, C., Gegenfurtner, K. R., Noesselt, T., Braun, C., Heinze, H. J., et al. (2008). Predicting the recognition of natural scenes from single trial MEG recordings of brain activity. Neuroimage 42, 1056-1068. doi: 10.1016/j.neuroimage.2008.06.014
41. Tong, F., Meng, M., and Blake, R. (2006). Neural bases of binocular rivalry. Trends Cogn. Sci. 10, 502-511. doi: 10.1016/j.tics.2006.09.003
42. Tong, F., Nakayama, K., Vaughan, J. T., and Kanwisher, N. (1998). Binocular rivalry and visual awareness in human extrastriate cortex. Neuron 21, 753-759. doi: 10.1016/S0896-6273(00)80592-9
43. Tong, F., and Pratte, M. S. (2012). Decoding patterns of human brain activity. Annu. Rev. Psychol. 63, 483-509. doi: 10.1146/annurev-psych-120710-100412
44. Ungerleider, L. G., and Mishkin, M. (1982). "Two cortical visual systems," in Analysis of Visual Behavior, eds D. J. Ingle, M. A. Goodale, and R. J. W. Mansfield (Cambridge: MIT Press), 549-586.
45. van Ee, R., van Dam, L. C. J., and Brouwer, G. J. (2005). Voluntary control and the dynamics of perceptual bi-stability. Vision Res. 45, 41-55. doi: 10.1016/j.visres.2004.07.030
46. Vapnik, V. N. (1998). Statistical Learning Theory. New York, NY: John Wiley & Sons.
47. von Helmholtz, H. (1867). Handbuch der Physiologischen Optik. Hamburg: Voss.
48. Weiskopf, N. (2012). Real-time fMRI and its application to neurofeedback. Neuroimage 62, 682-692. doi: 10.1016/j.neuroimage.2011.10.009
49. Weiskopf, N., Sitaram, R., Josephs, O., Veit, R., Scharnowski, F., Goebel, R., et al. (2007). Real-time functional magnetic resonance imaging: methods and applications. Magn. Reson. Imaging 25, 989-1003. doi: 10.1016/j.mri.2007.02.007
50. Yin, C., Shimojo, S., Moore, C., and Engel, S. A. (2002). Dynamic shape integration in extrastriate cortex. Curr. Biol. 12, 1379-1385. doi: 10.1016/S0960-9822(02)01071-0
51. Zaretskaya, N., Anstis, S., and Bartels, A. (2013). Parietal cortex mediates conscious perception of illusory Gestalt. J. Neurosci. 33, 523-531. doi: 10.1523/JNEUROSCI.2905-12.2013