Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli

PLoS ONE

Volumn 6, Issue 6, 2011, Pages

  Li, Yuanqing ^a   Wang, Guangyi ^b,c   Long, Jinyi ^a   Yu, Zhuliang ^a   Huang, Biao ^c   Li, Xiaojian ^d   Yu, Tianyou ^a   Liang, Changhong ^c   Li, Zheng ^e   Sun, Pei ^f  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b SOUTHERN MEDICAL UNIVERSITY   (China)

^c GUANGDONG PROVINCIAL PEOPLE'S HOSPITAL   (China)

^d SOUTH CHINA NORMAL UNIVERSITY   (China)

^e DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^f RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BOLD SIGNAL; BRAIN FUNCTION; CHINESE; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; MALE; MIDDLE TEMPORAL GYRUS; PERCEPTIVE DISCRIMINATION; REPRODUCIBILITY; SEMANTIC MEMORY; SIGNAL PROCESSING; SUPERIOR TEMPORAL SULCUS; VISUAL STIMULATION; AGING; BRAIN; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; SEMANTICS; TEMPORAL LOBE;

ACOUSTIC STIMULATION; ADULT; AGING; BRAIN; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PATTERN RECOGNITION, PHYSIOLOGICAL; PHOTIC STIMULATION; REPRODUCIBILITY OF RESULTS; SEMANTICS; TEMPORAL LOBE;

EID: 79959719886     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0020801     Document Type: Article

References (36)

1. Bushara KO, Grafman J, Hallett M, (2001) Neural correlates of auditory-visual stimulus onset asynchrony detection. Journal of Neuroscience 21: 300-304.
2. Doehrmann O, Naumer MJ, (2008) Semantics and the multisensory brain: how meaning modulates processes of audio-visual integration. Brain Research 1242: 136-150.
3. Bushara KO, Hanakawa T, Immisch I, Toma K, Kansaku K, et al. (2003) Neural correlates of cross-modal binding. nature neuroscience 6: 190-195.
4. Calvert GA, Campbell R, Brammer MJ, (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10: 649-657.
5. Calvert GA, Thesen T, (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. Journal of Physiology-Paris 98: 191-205.
6. Frassinetti F, Bolognini N, L\'a dE, (2002) Enhancement of visual perception by crossmodal visuo-auditory interaction. Experimental Brain Research 147: 332-343.
7. Macaluso E, George N, Dolan R, Spence C, Driver J, (2004) Spatial and temporal factors during processing of audiovisual speech: a PET study. NeuroImage 21: 725-732.
8. Macaluso E, Frith CD, Driver J, (2005) Multisensory stimulation with or without saccades: fMRI evidence for crossmodal effects on sensory-specific cortices that reflect multisensory location-congruence rather than task-relevance. NeuroImage 26: 414-425.
9. Lavenex P, Amaral DG, (2000) Hippocampal-neocortical interaction: a hierarchy of associativity. Hippocampus 10: 420-430.
10. Taylor KI, Moss HE, Stamatakis EA, Tyler LK, (2006) Binding crossmodal object features in perirhinal cortex. Proceedings of the National Academy of Sciences 103: 8239-8244.
11. Werner S, Noppeney U, (2010) Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. Journal of Neuroscience 30: 2662-2675.
12. Fuster JM, (2005) Cortex and mind: Unifying cognition: Oxford University Press, USA.
13. Formisano E, De Martino F, Bonte M, Goebel R, (2008) "Who "Is Saying" What"? Brain-Based Decoding of Human Voice and Speech. Science 322: 970.
14. Liou M, Su HR, Lee JD, Cheng PE, Huang CC, et al. (2003) Bridging functional MR images and scientific inference: reproducibility maps. Journal of Cognitive Neuroscience pp. 935-945.
15. Schurger A, Pereira F, Treisman A, Cohen JD, (2010) Reproducibility distinguishes conscious from nonconscious neural representations. Science pp. 97-99.
16. Cox DD, Savoy RL, (2003) Functional magnetic resonance imaging (fMRI) brain reading? Detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19: 261-270.
17. Thirion B, Duchesnay E, Hubbard E, Dubois J, Poline JB, et al. (2006) Inverse retinotopy: inferring the visual content of images from brain activation patterns. Neuroimage 33: 1104-1116.
18. Bogousslavsky J, Miklossy J, Deruaz JP, Assal G, Regli F, (1987) Lingual and fusiform gyri in visual processing: a clinico-pathologic study of superior altitudinal hemianopia. Journal of Neurology, Neurosurgery & Psychiatry 50: 607-614.
19. Calvert GA, (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cerebral Cortex 11: 1110-1123.
20. Haxby JV, Hoffman EA, Gobbini MI, (2000) The distributed human neural system for face perception. Trends in cognitive sciences 4: 223-232.
21. Desmond JE, Fiez JA, (1998) Neuroimaging studies of the cerebellum: language, learning and memory. Trends in Cognitive Sciences 2: 355-362.
22. Pereira F, Mitchell T, Botvinick M, (2009) Machine learning classifiers and fMRI: a tutorial overview. Neuroimage 45: 199-209.
23. Fernandez G, Specht K, Weis S, Tendolkar I, Reuber M, et al. (2003) Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI. Neurology 60: 969-975.
24. Ishai A, (2003) On Representation and Reproducibility. Journal of Cognitive Neuroscience 15: 946-947.
25. McGonigle DJ, Howseman AM, Athwal BS, Friston KJ, Frackowiak RSJ, et al. (2003) Variability in fMRI: an examination of intersession differences. NeuroImage 11: 708-734.
26. Yoo SS, Wei X, Dickey CC, Guttmann CRG, Panych LP, (2005) Long-term reproducibility analysis of fMRI using hand motor task. International Journal of Neuroscience 115: 55-77.
27. Xue G, Dong Q, Chen C, Lu Z, Mumford JA, et al. (2010) Greater Neural Pattern Similarity Across Repetitions Is Associated with Better Memory. Science 330: 97-101.
28. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A, (2004) Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nature neuroscience 7: 1190-1192.
29. Beauchamp MS, Lee KE, Argall BD, Martin A, (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41: 809-823.
30. Smith AT, Kosillo P, Williams AL, (2011) The confounding effect of response amplitude on MVPA performance measures. NeuroImage 56: 525-530.
31. Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, et al. (1994) Statistical parametric maps in functional imaging: a general linear approach. Human Brain Mapping 2: 189-210.
32. De Martino F, Valente G, Staeren N, Ashburner J, Goebel R, et al. (2008) Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns. Neuroimage 43: 44-58.
33. Harrison SA, Tong F, (2009) Decoding reveals the contents of visual working memory in early visual areas. Nature 458: 632.
34. Kay KN, Naselaris T, Prenger RJ, Gallant JL, (2008) Identifying natural images from human brain activity. Nature 452: 352-355.
35. Mitchell TM, Shinkareva SV, Carlson A, Chang KM, Malave VL, et al. (2008) Predicting human brain activity associated with the meanings of nouns. science 320: 1191.
36. Li Y, Namburi P, Yu Z, Guan C, Feng J, et al. (2009) Voxel selection in fMRI data analysis based on sparse representation. IEEE Transactions on Biomedical Engineering 56: 2439-2451.