A general rule for sensory cue summation: Evidence from photographic, musical, phonetic and cross-modal stimuli

Proceedings of the Royal Society B: Biological Sciences

Volumn 278, Issue 1710, 2011, Pages 1365-1372

  To, M P S ^a   Baddeley, R J ^b   Troscianko, T ^b   Tolhurst, D J ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Cross modal; Feature integration; Music; Natural images; Neuronal correlation; Phonetics

Indexed keywords

ACCURACY ASSESSMENT; COMPUTER SIMULATION; DETECTION METHOD; DISCRIMINANT ANALYSIS; EXPERIMENTAL STUDY; MAGNITUDE; MUSIC; NUMERICAL MODEL; PHOTOGRAPH; PHYSIOLOGICAL RESPONSE; SENSORY SYSTEM; THRESHOLD;

EID: 79953300999     PISSN: 09628452     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rspb.2010.1888     Document Type: Article

References (43)

1. von der Malsburg, C. 1995 Binding in models of perception and brain function. Curr. Opin. Neurobiol. 5, 520-526. (doi:10.1016/0959-4388(95)80014-X)
2. Treisman, A. 1996 The binding problem. Curr. Opin. Neurobiol. 6, 171-178. (doi:10.1016/S0959-4388(96)80070-5)
3. Ghose, G. M. & Maunsell, J. 1999 Specialized representations in visual cortex: a role for binding? Neuron 24, 79-85. (doi:10.1016/S0896-6273(00)80823-5)
4. Wolfe, J. M. & Cave, K. R. 1999 The psychophysical evidence for a binding problem in human vision. Neuron 24, 11-17. (doi:10.1016/S0896-6273(00)80818-1)
5. Ennis, D. M., Palen, J. J. & Mullen, K. 1988 A multidimensional stochastic theory of similarity. J. Math. Psychol. 32, 449-465. (doi:10.1016/0022-2496(88)90023-5)
6. Shepard, R. N. 1964 Attention and the metric structure of stimulus space. J. Math. Psychol. 1, 54-87. (doi:10.1016/0022-2496(64)90017-3)
7. Shepard, R. N. 1987 Toward a universal law of generalization for psychological science. Science 237, 1317-1323. (doi:10.1126/science.3629243)
8. Li, Z. 2002 A saliency map in primary visual cortex. Trends Cogn. Sci. 6, 9-16. (doi:10.1016/S1364-6613(00)01817-9)
9. Koene, A. R. & Zhaoping, L. 2007 Feature-specific interactions in salience from combined feature contrasts: evidence for a bottom-up saliency map in V1. J. Vis. 7, 6: 1-14. (doi:10.1167/7.7.6)
10. Zhaoping, L. & May, K. A. 2007 Psychophysical tests of the hypothesis of a bottom-up saliency map in the primary visual cortex. PLoS Comput. Biol. 3, e62. (doi:10.1371/journal.pcbi.0030062)
11. Riesenhuber, M. & Poggio, T. 1999 Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025. (doi:10.1038/14819)
12. Gawne, T. J. & Martin, J. M. 2002 Responses of primate visual cortical V4 neurons to simultaneously presented stimuli. J. Neurophysiol. 88, 1128-1135.
13. Zhou, C. H. & Mel, B. W. 2008 Cue combination and color edge detection in natural scenes. J. Vis. 8, 4: 1-25. (doi:10.1167/8.4.4)
14. Quick Jr, R. F. 1974 A vector-magnitude model of contrast detection. Kybernetik 16, 65-67. (doi:10.1007/ BF00271628)
15. Robson, J. G. & Graham, N. 1981 Probability summation and regional variation in contrast sensitivity across the visual field. Vis. Res. 21, 409-418. (doi:10.1016/0042-6989(81)90169-3)
16. Rohaly, A. M., Ahumada Jr, A. J. & Watson, A. B. 1997 Object detection in natural backgrounds predicted by discrimination performance and models. Vis. Res. 37, 3225-3235. (doi:10.1016/S0042-6989(97)00156-9)
17. Párraga, C. A., Troscianko, T. & Tolhurst, D. J. 2005 The effects of amplitude-spectrum statistics on foveal and peripheral discrimination of changes in natural images, and a multi-resolution model. Vis. Res. 45, 3145-3168. (doi:10.1016/j.visres.2005.08.006)
18. Lovell, P. G., Parraga, C. A., Troscianko, T., Ripamonti, C. & Tolhurst, D. J. 2006 Evaluation of a multiscale color model for visual difference prediction. ACM Trans. Appl. Percept. 3, 155-178. (doi:10.1145/1166087.1166089)
19. To, M., Lovell, P. G., Troscianko, T. & Tolhurst, D. J. 2008 Summation of perceptual cues in natural visual scenes. Proc. R. Soc. B 275, 2299-2308. (doi:10.1098/ rspb.2008.0692)
20. To, M. P. S., Troscianko, T. & Tolhurst, D. J. 2009 Music and natural image processing share a common featureintegration rule. In Proc. 31st Annual Conf. of the Cognitive Science Society (eds B. C. Love, K. McRae & V. M. Sloutsky), pp. 2481-2486. Austin, TX: Cognitive Science Society.
21. Green, D. M. 1958 Detection of multiple component signals in noise. J. Acoust. Soc. Am. 30, 904-911. (doi:10.1121/1.1909400)
22. Meng, A., Ahrendt, P. & Larsen, J. 2005 Improving music genre classification by short-time feature integration. IEEE Int. Conf. Acoust., Speech, and Signal Process. 5, 497-500.
23. Oden, G. C. & Massaro, D. W. 1978 Integration of featural information in speech perception. Psychol. Rev. 85, 172-191. (doi:10.1037/0033-295X.85.3.172)
24. Geisler, W. S., Perry, J. S., Super, B. J. & Gallogly, D. P. 2001 Edge co-occurrence in natural images predicts contour grouping performance. Vis. Res. 41, 711-724. (doi:10.1016/S0042-6989(00)00277-7)
25. To, M. P. S., Lovell, P. G., Troscianko, T. & Tolhurst, D. J. 2010 Perception of suprathreshold naturalistic changes in colored natural images. J. Vis. 10, 12: 1-22. (doi:10.1167/10.4.12)
26. Kruskal, J. B. 1964 Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29, 1-27. (doi:10.1007/BF02289565)
27. Laurienti, P. J., Perrault, T. J., Stanford, T. R., Wallace, M. T. & Stein, B. E. 2005 On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp. Brain Res. 166, 289-297. (doi:10.1007/s00221-005-2370-2)
28. Lehky, S. R. 1983 A model of binocular brightness and binaural loudness perception in humans with general applications to nonlinear summation of sensory inputs. Biol. Cybernet. 49, 89-97. (doi:10.1007/BF00320389)
29. Ashby, F. G. & Perrin, N. A. 1988 Toward a unified theory of similarity and recognition. Psychol. Rev. 95, 124-150. (doi:10.1037/0033-295X.95.1.124)
30. Li, C. L. 1959 Synchronization of unit activity in the cerebral cortex. Science 129, 783-784. (doi:10.1126/ science.129.3351.783)
31. Ecker, A. S., Berens, P., Keliris, G. A., Bethge, M., Logothetis, N. K. & Tolias, A. S. 2010 Decorrelated neuronal firing in cortical microcircuits. Science 327, 584-587. (doi:10.1126/science.1179867)
32. Fox, M. D. & Raichle, M. E. 2007 Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 8, 700-711. (doi:10.1038/nrn2201)
33. Moran, J. & Desimone, R. 1985 Selective attention gates visual processing in the extrastriate cortex. Science 229, 782-784. (doi:10.1126/science.4023713)
34. Marr, D. 1982 Vision. San Francisco, CA: W. H. Freeman.
35. Olshausen, B. A. & Field, D. J. 1997 Sparse coding with an overcomplete basis set: a strategy employed by V1? Vis. Res. 37, 3311-3325. (doi:10.1016/S0042-6989(97)00169-7)
36. Willmore, B. & Tolhurst, D. J. 2001 Characterising the sparseness of neural codes. Network, Comput. Neural Syst. 12, 255-270.
37. Hubel, D. H. & Wiesel, T. N. 1962 Receptive fields and functional architecture of monkey striate cortex. J. Physiol. 195, 215-243.
38. Yen, S. C., Baker, J. & Gray, C. M. 2007 Heterogeneity in the responses of adjacent neurons to natural stimuli in cat striate cortex. J. Neurophysiol. 97, 1326-1341. (doi:10.1152/jn.00747.2006)
39. Gawne, T. J. & Richmond, B. J. 1993 How independent are the messages carried by adjacent inferior temporal cortical neurons? J. Neurosci. 13, 2758-2771.
40. Reich, D. S., Mechler, F. & Victor, J. D. 2001 Independent and redundant information in nearby cortical neurons. Science 294, 2566-2568. (doi:10.1126/science.1065839)
41. Smith, M. A. & Kohn, A. 2008 Spatial and temporal scales of neuronal correlation in primary visual cortex. J. Neurosci. 28, 12591-12603. (doi:10.1523/ JNEUROSCI.2929-08.2008)
42. Zohary, E., Shadlen, M. N. & Newsome, W. T. 1994 Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370, 140-143. (doi:10.1038/370140a0)
43. Petersen, R. S., Panzeri, S. & Diamond, M. E. 2001 Population coding of stimulus location in rat somatosensory cortex. Neuron 32, 503-514. (doi:10.1016/S0896-6273(01)00481-0)