A predictive processing theory of sensorimotor contingencies: Explaining the puzzle of perceptual presence and its absence in synesthesia

Cognitive Neuroscience

Volumn 5, Issue 2, 2014, Pages 97-118

  Seth, Anil K ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Active inference; Bayesian brain; Counterfactuals; Predictive coding; Presence; Sensorimotor contingencies; Synesthesia; Veridicality

Indexed keywords

ACCURACY; ASSOCIATION; BAYESIAN LEARNING; CONCEPTUAL FRAMEWORK; EVOKED RESPONSE; EYE MOVEMENT; HALLUCINATION; IMAGERY; LEARNING; NOTE; PERCEPTION; PHENOMENOLOGY; PREDICTION; RECALL; SENSORIMOTOR FUNCTION; SENSORY STIMULATION; SYNESTHESIA; BAYES THEOREM; HUMAN; PATHOPHYSIOLOGY; PERCEPTION DISORDER; PHOTOSTIMULATION; PHYSIOLOGY;

BAYES THEOREM; HUMANS; PERCEPTION; PERCEPTUAL DISORDERS; PHOTIC STIMULATION;

EID: 84901470795     PISSN: 17588928     EISSN: 17588936     Source Type: Journal    
DOI: 10.1080/17588928.2013.877880     Document Type: Note

References (114)

1. Adams, R. A., Stephan, K. E., Brown, H. R., Frith, C., & Friston, K. J. (2013). The computational anatomy of psychosis. Frontiers in Psychiatry, 4, 47.
2. Albright, T. D. (2012). On the perception of probable things: Neural substrates of associative memory, imagery, and perception. Neuron, 74(2), 227-245.
3. Bach-y-Rita, P. (1972). Brain mechanisms in sensory substitution. New York, NY: Academic Press.
4. Banissy, M. J., Cohen Kadosh, R., Maus, G. W., Walsh, V., & Ward, J. (2009). Prevalence, characteristics and a neurocognitive model of mirror-touch synaesthesia. Experimental Brain Research, 198(2-3), 261-272.
5. Banissy, M. J., Garrido, L., Kusnir, F., Duchaine, B., Walsh, V., & Ward, J. (2011). Superior facial expression, but not identity recognition, in mirror-touch synesthesia. Journal of Neuroscience, 31(5), 1820-1824.
6. Banissy, M. J., Walsh, V., & Ward, J. (2009). Enhanced sensory perception in synaesthesia. Experimental Brain Research, 196(4), 565-571.
7. Bargary, G., & Mitchell, K. J. (2008). Synaesthesia and cortical connectivity. Trends in Neuroscience, 31(7), 335-342.
8. Barnett, K. J., & Newell, F. N. (2008). Synaesthesia is associated with enhanced, self-rated visual imagery. Consciousness and Cognitive, 17(3), 1032-1039.
9. Baron-Cohen, S., Wyke, M. A., & Binnie, C. (1987). Hearing words and seeing colours: An experimental investigation of a case of synaesthesia. Perception, 16(6), 761-767.
10. Beeli, G., Esslen, M., & Jancke, L. (2005). Synaesthesia: When coloured sounds taste sweet. Nature, 434(7029), 38.
11. Bien, N., ten Oever, S., Goebel, R., & Sack, A. T. (2012). The sound of size: Crossmodal binding in pitch-size synesthesia: A combined TMS, EEG and psychophysics study. NeuroImage, 59(1), 663-672.
12. Block, N. (2005). Book review: Action in perception by Alva Noe. Journal of Philosophy, 102(5), 259-272.
13. Brang, D., & Ramachandran, V. S. (2008). Psychopharmacology of synesthesia; the role of serotonin S2a receptor activation. Medical Hypotheses, 70(4), 903-904.
14. Bubic, A., von Cramon, D. Y., & Schubotz, R. I. (2010). Prediction, cognition and the brain. Frontiers in Human Neuroscience, 4, 25.
15. Buhrmann, T., Di Paolo, E., & Barandarian, X. (2013). A dynamical systems account of sensorimotor contingencies. Frontiers in Psychology, 4, 285.
16. Clark, A. (2012). Dreaming the whole cat: Generative models, predictive processing, and the enactivist conception of perceptual experience. Mind, 121(483), 753-771.
17. Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36(3), 181-204.
18. Cohen, M. A., & Dennett, D. C. (2011). Consciousness cannot be separated from function. Trends Cogn Sci, 15(8), 358-364.
19. Colizoli, O., Murre, J. M., & Rouw, R. (2012). Pseudo-synesthesia through reading books with colored letters. PLoS One, 7(6), e39799.
20. Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995). The Helmholtz machine. Neural Computing, 7(5), 889-904.
21. de Haas, B., Schwarzkopf, D. S., Urner, M., & Rees, G. (2013). Auditory modulation of visual stimulus encoding in human retinotopic cortex. NeuroImage, 70, 258-267.
22. Dehaene, S., Bossini, S., & Giraux, P. (1993). The mental representation of parity and numerical magnitude. Journal of Experimental Psychology: General, 122, 371-396.
23. Dennett, D. (1991). Consciousness explained. Boston, MA: Little, Brown, and London.
24. Deroy, O., & Spence, C. (2013). Are we all born synaesthetic? Examining the neonatal synaesthesia hypothesis. Neuroscience and biobehavioral reviews, 37(7), 1240-1253.
25. Dixon, M. J., Smilek, D., & Merikle, P. M. (2004). Not all synaesthetes are created equal: Projector versus associator synaesthetes. Cognitive, Affective, & Behavioral Neuroscience, 4(3), 335-343.
26. Eagleman, D. M. (2009). The objectification of overlearned sequences: A new view of spatial sequence synesthesia. Cortex, 45(10), 1266-1277.
27. Eagleman, D. M., Kagan, A. D., Nelson, S. S., Sagaram, D., & Sarma, A. K. (2007). A standardized test battery for the study of synesthesia. Journal of Neuroscience Methods, 159(1), 139-145.
28. Edquist, J., Rich, A. N., Brinkman, C., & Mattingley, J. B. (2006). Do synaesthetic colours act as unique features in visual search?. Cortex, 42(2), 222-231.
29. Edwards, M. J., Adams, R. A., Brown, H., Parees, I., & Friston, K. J. (2012). A Bayesian account of 'hysteria. Brain, 135(Pt 11), 3495-3512.
30. Egner, T., Monti, J. M., & Summerfield, C. (2010). Expectation and surprise determine neural population responses in the ventral visual stream. Journal of Neuroscience, 30(49), 16601-16608.
31. Egner, T., Summerfield, C., Trittschuh, E. H., Monti, J. M., & Mesulam, M. M. (2008). Neural repetition suppression reflects fulfilled perceptual expectations. Nature Neuroscience, 11(9), 1004-1006.
32. Feldman, H., & Friston, K. J. (2010). Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience, 4, 215.
33. Fletcher, P. C., & Frith, C. D. (2009). Perceiving is believing: A Bayesian approach to explaining the positive symptoms of schizophrenia. Nature Reviews Neuroscience, 10(1), 48-58.
34. Freeman, J., & Simoncelli, E. P. (2011). Metamers of the ventral stream. Nature Neuroscience, 14(9), 1195-1201.
35. Friston, K. J. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society London B: Biological Science, 360(1456), 815-836.
36. Friston, K. J. (2009). The free-energy principle: A rough guide to the brain?. Trends in Cognitive Science, 13(7), 293-301.
37. Friston, K. J. (2012). Embodied inference and spatial cognition. Cognitive Processing, 13(Suppl 1), S171-S177.
38. Friston, K. J., Adams, R. A., Perrinet, L., & Breakspear, M. (2012). Perceptions as hypotheses: Saccades as experiments. Frontiers in Psychology, 3, 151.
39. Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010). Action and behavior: A free-energy formulation. Biological Cybernetics, 102(3), 227-260.
40. Friston, K. J., Kilner, J., & Harrison, L. (2006). A free energy principle for the brain. Journal of Physiology - Paris, 100(1-3), 70-87.
41. Friston, K. J., Mattout, J., & Kilner, J. (2011). Action understanding and active inference. Biological Cybernetics, 104(1-2), 137-160.
42. Gibson, J. J. (1979). The ecological approach to visual perception. Hillsdale, NJ: Lawrence Erlbaum.
43. Gray, J. A. (2003). How are qualia coupled to functions?. Trends in Cognitive Science, 7(5), 192-194.
44. Gray, J. A., Parslow, D. M., Brammer, M. J., Chopping, S., Vythelingum, G. N., & ffytche, D. H. (2006). Evidence against functionalism from neuroimaging of the alien colour effect in synaesthesia. Cortex, 42(2), 309-318.
45. Grossenbacher, P. G., & Lovelace, C. T. (2001). Mechanisms of synesthesia: Cognitive and physiological constraints. Trends in Cognitive Science, 5(1), 36-41.
46. Hinton, G. E. (2007). To recognize shapes, first learn to generate images. In P. Cisek, T. Drew & J. Kalaska (Eds.), Computational neuroscience: Theoretical insights into brain function (pp. 535-548). Holland: Elsevier.
47. Hinton, G. E., & Dayan, P. (1996). Varieties of Helmholtz Machine. Neural Networks, 9(8), 1385-1403.
48. Hohwy, J. (2012). Attention and conscious perception in the hypothesis testing brain. Frontiers in Psychology, 3, 96.
49. Hohwy, J. (2013). The predictive mind. Oxford: Oxford University Press.
50. Hubbard, E. M., Brang, D., & Ramachandran, V. S. (2011). The cross-activation theory at 10. Journal of Neuropsychology, 5(2), 152-177.
51. Hupe, J. M., Bordier, C., & Dojat, M. (2012). The neural bases of grapheme-color synesthesia are not localized in real color-sensitive areas. Cerebral Cortex, 22(7), 1622-1633.
52. Hurley, S., & Noë, A. (2003a). Neural plasticity and consciousness. Biology and Philosophy, 18, 131-168.
53. Hurley, S., & Noë, A. (2003b). Neural plasticity and consciousness: Reply to Block. Trends in Cognitive Science, 7(8), 342.
54. Hutto, D., & Myin, E. (2013). Radicalizing enactivism: Basic minds without content. Cambridge, MA: MIT Press.
55. James, W. (1890). The principles of psychology. New York, NY: Henry Holt.
56. Kohler, I. (1951). Formation and transformation of the perceptual world. Psychological Issues, 3(4), 1-173.
57. Kok, P., Brouwer, G. J., van Gerven, M. A., & de Lange, F. P. (2013). Prior expectations bias sensory representations in visual cortex. Journal of Neuroscience, 33(41), 16275-16284.
58. Kok, P., Rahnev, D., Jehee, J. F., Lau, H. C., & de Lange, F. P. (2012). Attention reverses the effect of prediction in silencing sensory signals. Cerebral Cortex, 22(9), 2197-2206.
59. Koster-Hale, J., & Saxe, R. (2013). Theory of mind: A neural prediction problem. Neuron, 79(5), 836-848.
60. Kouider, S., de Gardelle, V., Sackur, J., & Dupoux, E. (2010). How rich is consciousness? The partial awareness hypothesis. Trends in Cognitive Science, 14(7), 301-307.
61. Kusnir, F., & Thut, G. (2012). Formation of automatic letter-colour associations in non-synaesthetes through likelihood manipulation of letter-colour pairings. Neuropsychologia, 50(14), 3641-3652.
62. Laeng, B., Svartdal, F., & Oelmann, H. (2004). Does color synesthesia pose a paradox for early-selection theories of attention?. Psychological Science, 15(4), 277-281.
63. Lee, T. S., & Mumford, D. (2003). Hierarchical Bayesian inference in the visual cortex. Journal of the Optical Society of America. A, Optics, Image Science, and Vision, 20(7), 1434-1448.
64. Lettvin, J. Y. (1976). On seeing sidelong. The Sciences, 16, 10-20.
65. Liang, M., Mouraux, A., Hu, L., & Iannetti, G. D. (2013). Primary sensory cortices contain distinguishable spatial patterns of activity for each sense. Nature Communications, 4, 1979.
66. Ludwig, V. U., Adachi, I., & Matsuzawa, T. (2011). Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans. Proceedings of the National Academy of Sciences of the United States of America, 108(51), 20661-20665.
67. Ludwig, V. U., & Simner, J. (2013). What colour does that feel? Tactile--visual mapping and the development of cross-modality. Cortex, 49(4), 1089-1099.
68. Luke, D. P., & Terhune, D. B. (2013). The induction of synaesthesia with chemical agents: A systematic review. Frontiers in Psychology, 4, 753.
69. Luo, H., Liu, Z., & Poeppel, D. (2010). Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. PLoS Biology, 8(8), e1000445.
70. Madary, M. (2012). How would the world look if it looked as if it were encoded as an intertwined set of probability density distributions?. Frontiers in Psychology, 3, 419.
71. Mattingley, J. B. (2009). Attention, automaticity, and awareness in synesthesia. Annals of the New York Academy of Sciences, 1156, 141-167.
72. Maurer, D., & Mondloch, C. J. (2006). The infant as synesthete?. Attention and Performance, 21, 449-471.
73. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746-748.
74. Meier, B., & Rothen, N. (2009). Training grapheme-colour associations produces a synaesthetic Stroop effect, but not a conditioned synaesthetic response. Neuropsychologia, 47(4), 1208-1211.
75. Melloni, L., Schwiedrzik, C. M., Muller, N., Rodriguez, E., & Singer, W. (2011). Expectations change the signatures and timing of electrophysiological correlates of perceptual awareness. Journal of Neuroscience, 31(4), 1386-1396.
76. Mroczko-Wasowicz, A., & Werning, M. (2012). Synesthesia, sensory-motor contingency, and semantic emulation: How swimming style-color synesthesia challenges the traditional view of synesthesia. Frontiers in Psychology, 3, 279.
77. Noë, A. (2004). Action in perception. Cambridge, MA: MIT Press.
78. Noë, A. (2006). Experience without the head. In T. Gendler & A. Hawthorne (Eds.), Perceptual experience (pp. 411-434). New York, NY: Clarendon/Oxford University Press.
79. Noë, A., & Hurley, S. (2003). The deferential brain in action: Response to Jeffrey Gray. Trends Cognitive Science, 7(5), 195-196.
80. Noesselt, T., Tyll, S., Boehler, C. N., Budinger, E., Heinze, H. J., & Driver, J. (2010). Sound-induced enhancement of low-intensity vision: Multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. Journal of Neuroscience, 30(41), 13609-13623.
81. O'Regan, J. K., & Noë, A. (2001). A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences, 24(5), 939-973. discussion 973-1031.
82. Ortiz, T., Poch, J., Santos, J. M., Requena, C., Martinez, A. M., Ortiz-Teran, L., Pascual-Leone, A. (2011). Recruitment of occipital cortex during sensory substitution training linked to subjective experience of seeing in people with blindness. PLoS One, 6(8), e23264.
83. Philipona, D. L., & O'Regan, J. K. (2006). Color naming, unique hues, and hue cancellation predicted from singularities in reflection properties. Visual Neuroscience, 23(3-4), 331-339.
84. Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013). Probabilistic brains: Knowns and unknowns. Nature Neuroscience, 16(9), 1170-1178.
85. Price, M. C., & Mattingley, J. B. (2013). Automaticity in sequence-space synaesthesia: A critical appraisal of the evidence. Cortex, 49(5), 1165-1186.
86. Ramachandran, V. S., & Hubbard, E. M. (2001a). Psychophysical investigations into the neural basis of synaesthesia. Proceedings of Biological Science, 268(1470), 979-983.
87. Ramachandran, V. S., & Hubbard, E. M. (2001b). Synaesthesia: A window into perception, thought and language. Journal of Consciousness Studies, 8(12), 3-34.
88. Ramachandran, V. S., & Rogers-Ramachandran, D. (1996). Synaesthesia in phantom limbs induced with mirrors. Proceedings of Biological Science, 263(1369), 377-386.
89. Rao, R. P., & Ballard, D. H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1), 79-87.
90. Roberts, D. (2009). Understanding "sensorimotor understanding. Phenomenology and the Cognitive Sciences, 9, 101-111.
91. Rothen, N., Seth, A. K., Witzel, C., & Ward, J. (2013). Diagnosing synaesthesia with online colour pickers: Maximising sensitivity and specificity. Journal of Neuroscience Methods, 215(1), 156-160.
92. Rothen, N., Wantz, A. L., & Meier, B. (2011). Training synaesthesia. Perception, 40(10), 1248-1250.
93. Rouw, R., & Scholte, H. S. (2010). Neural basis of individual differences in synesthetic experiences. Journal of Neuroscience, 30(18), 6205-6213.
94. Rouw, R., Scholte, H. S., & Colizoli, O. (2011). Brain areas involved in synaesthesia: A review. Journal of Neuropsychology, 5(2), 214-242.
95. Sagiv, N., & Frith, C. (2013). Synesthesia and consciousness. In J. Simner & E. M. Hubbard (Eds.), The Oxford handbook of synesthesia (pp. 924-940). Oxford: Oxford University Press.
96. Sagiv, N., Heer, J., & Robertson, L. (2006). Does binding of synesthetic color to the evoking grapheme require attention?. Cortex, 42(2), 232-242.
97. Sagiv, N., Simner, J., Collins, J., Butterworth, B., & Ward, J. (2006). What is the relationship between synaesthesia and visuo-spatial number forms?. Cognition, 101(1), 114-128.
98. Santhouse, A. M., Howard, R. J., & ffytche, D. H. (2000). Visual hallucinatory syndromes and the anatomy of the visual brain. Brain, 123(Pt 10), 2055-2064.
99. Schlack, A., & Albright, T. D. (2007). Remembering visual motion: Neural correlates of associative plasticity and motion recall in cortical area MT. Neuron, 53(6), 881-890.
100. Seth, A. K. (2013). Interoceptive inference, emotion, and the embodied self. Trends in Cognitive Science, 17(11), 565-573.
101. Seth, A. K., Suzuki, K., & Critchley, H. D. (2011). An interoceptive predictive coding model of conscious presence. Frontiers in Psychology, 2, 395.
102. Siegel, S. (2006). Subject and object in the contents of visual experience. Philosophical Review, 115, 355-388.
103. Sierra, M., & David, A. S. (2011). Depersonalization: A selective impairment of self-awareness. Consciousness and Cognition, 20(1), 99-108.
104. Smilek, D., Dixon, M. J., Cudahy, C., & Merikle, P. M. (2001). Synaesthetic photisms influence visual perception. Journal of Cognitive Neuroscience, 13(7), 930-936.
105. Thompson, E., & Varela, F. J. (2001). Radical embodiment: Neural dynamics and consciousness. Trends in Cognitive Science, 5(10), 418-425.
106. Tononi, G. (2008). Consciousness as integrated information: A provisional manifesto. The Biological Bulletin, 215(3), 216-242.
107. Ward, D. (2012). Enjoying the spread: Conscious externalism reconsidered. Mind, 121(483), 731-751.
108. Ward, J. (2013). Synesthesia. Annual Review of Psychology, 64, 49-75.
109. Ward, J., Huckstep, B., & Tsakanikos, E. (2006). Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all?. Cortex, 42(2), 264-280.
110. Ward, J., Jonas, C., Dienes, Z., & Seth, A. (2010). Grapheme-colour synaesthesia improves detection of embedded shapes, but without pre-attentive 'pop-out' of synaesthetic colour. Proceeding of Biological Science, 277(1684), 1021-1026.
111. Ward, J., Li, R., Salih, S., & Sagiv, N. (2007). Varieties of grapheme-colour synaesthesia: A new theory of phenomenological and behavioural differences. Consciousness Cognitive, 16(4), 913-931.
112. Ward, J., & Wright, T. (2012). Sensory substitution as an artificially acquired synaesthesia. Neuroscience and Biobehavioral Reviews, doi: 10.1016/j.neubiorev.2012.07.007
113. Yaro, C., & Ward, J. (2007). Searching for Shereshevskii: What is superior about the memory of synaesthetes?. Quality Journal of Experimental Psychology (Hove), 60(5), 681-695.
114. Yuille, A., & Kersten, D. (2006). Vision as Bayesian inference: Analysis by synthesis?. Trends in Cognitive Science, 10(7), 301-308.