Dynamic decoding of ongoing perception

NeuroImage

Volumn 57, Issue 3, 2011, Pages 950-957

  Van Gerven, Marcel A J ^a,b   Kok, Peter ^a   de Lange, Floris P ^a   Heskes, Tom ^b  

^a RADBOUD UNIVERSITY   (Netherlands)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Decoding; Hidden Markov model; Linear dynamical system; Time series analysis; Visual cortex

Indexed keywords

ACCURACY; ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; BRAIN REGION; COMPUTER SYSTEM; CONTROLLED STUDY; DEPTH PERCEPTION; DYNAMIC DECODING SYSTEM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMISPHERIC DOMINANCE; HIDDEN MARKOV MODEL; HUMAN; HUMAN EXPERIMENT; MATHEMATICAL MODEL; NORMAL HUMAN; PRIORITY JOURNAL; ROTATION; STIMULUS RESPONSE; TIME SERIES ANALYSIS; VISUAL ORIENTATION; VISUAL STIMULATION;

ALGORITHMS; BRAIN; BRAIN MAPPING; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; VISUAL PERCEPTION;

EID: 79959728207     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2011.05.020     Document Type: Article

References (45)

1. Barber D., Cemgil A.T. Graphical models for time series. IEEE Signal Process. Mag. 2010, 27(6):18-28.
2. Beal, M., 2003. Variational algorithms for approximate Bayesian inference. Ph.D. thesis, University College London.
3. Brainard D.H. The psychophysics toolbox. Spat. Vis. 1997, 10:433-436.
4. Brouwer G.J., van Ee R. Visual cortex allows prediction of perceptual states during ambiguous structure-from-motion. J. Neurosci. 2007, 27(5):1015-1023.
5. Chadwick M.J., Hassabis D., Weiskopf N., Maguire E.A. Decoding individual episodic memory traces in the human hippocampus. Curr. Biol. 2010, 20(6):544-547.
6. DeCharms R.C. Applications of real-time fMRI. Nat. Rev. Neurosci. 2008, 9:720-729.
7. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. B 1977, 39(1):1-38.
8. DeYoe E.A., Carman G.J., Bandettini P., Glickman S., Wieser J., Cox R., Miller D., Neitz J. Mapping striate and extrastriate visual areas in human cerebral cortex. Proc. Natl. Acad. Sci. U.S.A. 1996, 93(6):2382-2386.
9. Engel S.A., Glover G.H., Wandell B.A. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb. Cortex 1997, 7(2):181-192.
10. Fisher N.I. Statistical analysis of circular data 1996, Cambridge University Press, Cambridge.
11. Formisano E., De Martino F., Bonte M., Goebel R. "Who" is saying "what"? Brain-based decoding of human voice and speech. Science 2008, 322(5903):970-973.
12. Fuentemilla L., Penny W.D., Cashdollar N., Bunzeck N., Düzel E. Theta-coupled periodic replay in working memory. Curr. Biol. 2010, 20:1-7.
13. Furmanski C.S., Engel S.A. An oblique effect in human primary visual cortex. Nat. Neurosci. 2000, 3(6):535-536.
14. Hassabis D., Chu C., Rees G., Weiskopf N., Molyneux P.D., Maguire E.A. Decoding neuronal ensembles in the human hippocampus. Curr. Biol. 2009, 19:546-554.
15. Hasson U., Nir Y., Levy I., Fuhrmann G., Malach R. Intersubject synchronization of cortical activity during natural vision. Science 2004, 303(5664):1634-1640. Mar.
16. Haxby J., Gobbini M., Furey M., Ishai A., Schouten J., Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
17. Haynes J.-D. Decoding visual consciousness from human brain signals. Trends Cogn. Sci. 2009, 13(5):194-202.
18. Haynes J.-D., Rees G. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat. Neurosci. 2005, 8(5):686-691. May.
19. Haynes J.-D., Rees G. Predicting the stream of consciousness from activity in human visual cortex. Curr. Biol. 2005, 15(14):1301-1307.
20. Haynes J.-D., Rees G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 2006, 7:523-534.
21. Kamitani Y., Tong F. Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 2005, 8(5):679-685.
22. Kamitani Y., Tong F. Decoding seen and attended motion directions from activity in the human visual cortex. Curr. Biol. 2006, 16(11):1096-1102. Jun.
23. Kay K., Naselaris T., Prenger R.J., Gallant J.L. Identifying natural images from human brain activity. Nature 2008, 452:352-355.
24. Kriegeskorte N., Simmons W.K., Bellgowan P.S.F., Baker C.I. Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci. 2009, 12(5):535-540.
25. Kriegeskorte N., Cusack R., Bandettini P. How does an fMRI voxel sample the neuronal activity pattern: compact-kernel or complex spatiotemporal filter?. NeuroImage 2010, 49(3):1965-1976.
26. Levine M.W., McAnany J.J. The relative capabilities of the upper and lower visual hemifields. Vis. Res. 2005, 45(21):2820-2830.
27. Makni S., Beckmann C., Smith S., Woolrich M. Bayesian deconvolution of fMRI data using bilinear dynamical systems. NeuroImage 2008, 42(4):1381-1396.
28. Mannion D.J., McDonald J.S., Clifford C.W.G. Orientation anisotropies in human visual cortex. J. Neurophysiol. 2010, 103(6):3465-3471.
29. Mardia K.V., Jupp P.E. Directional statistics 1999, Wiley, New York. 2nd ed.
30. Miyawaki Y., Uchida H., Yamashita O., Sato M., Morito Y., Tanabe H.C., Sadato N., Kamitani Y. Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 2008, 60(5):915-929.
31. Naselaris T., Prenger R.J., Kay K.N., Oliver M., Gallant J.L. Bayesian reconstruction of natural images from human brain activity. Neuron 2009, 63(6):902-915.
32. Norman K.A., Polyn S.M., Detra G.J., Haxby J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 2006, 10(9):424-430.
33. Op de Beeck H.P. Against hyperacuity in brain reading: spatial smoothing does not hurt multivariate fMRI analyses?. NeuroImage 2010, 49(3):1943-1948.
34. Reddy L., Tsuchiya N., Serre T. Reading the mind's eye: decoding category information during mental imagery. NeuroImage 2010, 50(2):818-825.
35. Roweis S.T., Ghahramani Z. A unifying review of linear Gaussian models. Neural Comput. 1999, 11(2):305-345.
36. Sasaki Y., Rajimehr R., Kim B.W., Ekstrom L.B., Vanduffel W., Tootell R.B.H. The radial bias: a different slant on visual orientation sensitivity in human and nonhuman primates. Neuron 2006, 51(5):661-670.
37. Schölkopf B., Smola A.J., Müller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 1998, 10:1299-1319.
38. Serences J.T., Boynton G.M. Feature-based attentional modulations in the absence of direct visual stimulation. Neuron 2007, 55(2):301-312.
39. Sereno M.I., Dale A.M., Reppas J.B., Kwong K.K., Belliveau J.W., Brady T.J., Rosen B.R., Tootell R.B. Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science 1995, 268(5212):889-893.
40. Shmuel A., Chaimow D., Raddatz G., Ugurbil K., Yacoub E. Mechanisms underlying decoding at 7 T: ocular dominance columns, broad structures, and macroscopic blood vessels in V1 convey information on the stimulated eye. NeuroImage 2010, 49(3):1957-1964.
41. Silver M.A., Kastner S. Topographic maps in human frontal and parietal cortex. Trends Cogn. Sci. 2009, 13(11):488-945.
42. Swisher J.D., Gatenby J.C., Gore J.C., Wolfe B.A., Moon C.-H., Kim S.-G., Tong F. Multiscale pattern analysis of orientation-selective activity in the primary visual cortex. J. Neurosci. 2010, 30(1):325-330.
43. Thirion B., Duchesnay E., Hubbard E., Dubois J., Poline J., Lebihan D., Dehaene S. Inverse retinotopy: inferring the visual content of images from brain activation patterns. NeuroImage 2006, 33(4):1104-1116.
44. Vanduffel W., Tootell R.B.H., Schoups A.A., Orban G.A. The organization of orientation selectivity throughout macaque visual cortex. Cereb. Cortex 2002, 12(6):647-662.
45. Winawer J., Horiguchi H., Sayres R.A., Amano K., Wandell B.A. Mapping hV4 and ventral occipital cortex: the venous eclipse. J. Vis. 2010, 10(5):1-22.