What role does multisensory integration play in the visuotactile perception of texture?

International Journal of Psychophysiology

Volumn 50, Issue 1-2, 2003, Pages 63-80

  Guest, Steve ^a,b   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

Ecological; Multisensory; Perception; Sensory integration; Texture; Touch; Vision

Indexed keywords

ADULT; ATTENTION; CONFERENCE PAPER; CONTROLLED STUDY; DECISION MAKING; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MODEL; NORMAL HUMAN; PERCEPTIVE DISCRIMINATION; SENSORY SYSTEM; STIMULATION; STIMULUS; TACTILE DISCRIMINATION; TASK PERFORMANCE; TOUCH; VISION; VISUAL DISCRIMINATION;

EID: 0348077581     PISSN: 01678760     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8760(03)00125-9     Document Type: Conference Paper

References (68)

1. Anastasio T.J., Patton P.E., Belkacem-Boussaid K. Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Comput. 12:2000;1165-1187.
2. Abril H.C., Millan M.S., Torres Y., Navarre R. Automatic method based on image analysis for pilling evaluation in fabrics. Opt. Eng. 37:1998;2937-2947.
3. Ashby F.G., Maddox W.T. A response time theory of separability and integrality in speeded classification. J. Math. Psychol. 38:1994;423-466.
4. Bjorkman M. Relations between intra-modal and cross-modal matching. Scand. J. Psychol. 8:1967;65-76.
5. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10:2000;649-657.
6. Cascio C.J., Sathian K. Temporal cues contribute to tactile perception of roughness. J. Neurosci. 21:2001;5289-5296.
7. Dalton P., Doolittle N., Nagata H., Breslin P.A.S. The merging of the senses: integration of subthreshold taste and smell. Nat. Neurosci. 3:2000;431-432.
8. Driver J. Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature. 381:1996;66-68.
9. Ernst M.O., Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature. 415:2002;429-433.
10. Fazekas Z., Szalai L. Computerised assessment of the appearance of abraded fabric. S. Afr. Comput. J. 26:2000;77-83.
11. Fidell S. Sensory function in multimodal signal detection. J. Acoust. Soc. Am. 4:1970;1009-1015.
12. Fidell S. Comments on Mulligan and Shaw's 'Multimodal signal detection: independent decisions vs. integration'. Percept. Psychophys. 31:1982;90.
13. Freides D. Human information processing and sensory modality: cross-modal functions, information complexity, memory and deficit. Psychol. Bull. 31:1974;284-310.
14. Gamzu E., Ahissar E. Importance of temporal cues for tactile spatial-frequency discrimination. J. Neurosci. 21:2001;7416-7427.
15. Gescheider G.A., Berryhill M.E., Verrillo R.T., Bolanowski S.J. Vibrotactile temporal summation: probability summation or neural integration? Somatosens. Motor Res. 16:1999;229-242.
16. Gourevitch V., Galanter E. A significance test for one parameter isosensitivity functions. Psychometrika. 32:1967;25-33.
17. Guest S., Catmur C., Lloyd D., Spence C. Audiotactile interactions in roughness perception. Exp. Brain Res. 146:2002;161-171.
18. Guest S., Spence C. Tactile dominance in speeded discrimination of textures. Exp. Brain Res. 150:2003;201-207.
19. Haverland, E.M., 1979. Magnitude estimation: a new method for measuring subjective test variables. Report No. 790610, US Army Tropic Test Center, Miami.
20. Heller M.A. Visual and tactual texture perception: intersensory cooperation. Percept. Psychophys. 31:1982;339-344.
21. Heller M.A. Texture perception in sighted and blind observers. Percept. Psychophys. 45:1989;49-54.
22. Heller M.A. Haptic dominance in form perception; vision versus proprioception. Perception. 21:1992;655-660.
23. Hollins M., Faldowski R., Rao S., Young F. Perceptual dimensions of tactile surface texture: a multidimensional scaling analysis. Percept. Psychophys. 54:1993;697-705.
24. Hollins M., Bensmaia S., Karlof K., Young F. Individual differences in perceptual space for tactile textures: evidence from multidimensional scaling. Percept. Psychophys. 62:2000;1534-1544.
25. Johnston E.B., Gumming B.G., Parker A.J. Integration of depth modules: stereopsis and texture. Vision Res. 33:1993;813-826.
26. Jones B., O'Neil S. Combining vision and touch in texture perception. Percept. Psychophys. 37:1985;66-72.
27. Lamb G.D. Tactile discrimination of textured surfaces: psychophysical performance measurements in humans. J. Physiol. 338:1983;551-565.
28. Lederman S.J. Auditory texture perception. Perception. 8:1979;93-103.
29. Lederman S.J. Tactile roughness of grooved surfaces: the touching process and effects of macro- and microsurface structure. Percept. Psychophys. 16:1974;385-395.
30. Lederman S.J., Abbott S.G. Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics. J. Exp. Psychol.: Hum. Percept. Performance. 7:1981;902-915.
31. Lederman S.J., Thome G., Jones B. Perception of texture by vision and touch: multidimensionality and intersensory integration. J. Exp. Psychol.: Hum. Percept. Performance. 12:1986;169-180.
32. Linschoten M.R.I., Kroeze J.H.A. Ipsi- and bilateral interactions in taste. Percept. Psychophys. 55:1994;387-393.
33. Lloyd, D., Kulke, T., McGlone, F., 1999. Crossmodal manipulations of fabric texture by vision and olfaction. Unilever Report No. 990713, Unilever Research, Port Sunlight, UK.
34. MacMillan N.A., Creelman C.D. Detection Theory: A User's Guide. 1990;Cambridge University Press, Cambridge.
35. Meese T.S., Williams C.B. Probability summation for multiple patches of luminance modulation. Vision Res. 40:2000;2101-2113.
36. Meredith M.A., Stein B.E. Interactions among converging sensory inputs in the superior colliculus. Science. 221:1983;389-391.
37. Meyer G.F., Wuerger S.M. Cross-modal integration of auditory and visual motion signals. Neuroreport. 12:2001;2557-2560.
38. Millan M.S., Abril H.C. Image analysis of standard pilling series. Opt. Eng. 40:2001;1281-1286.
39. Miyaoka T., Mano T., Ohka M. Mechanisms of fine-surface-texture discrimination in human tactile sensation. J. Acoust. Soc. Am. 105:1999;2485-2492.
40. Mulligan R.M., Shaw M.L. Multimodal signal detection: independent decisions vs. integration. Percept. Psychophys. 28:1980;471-478.
41. Odgaard E.C., Arieh Y., Marks L.E. Cross-modal enhancement of perceived brightness: sensory interaction versus response bias. Percept. Psychophys. 65:2003;123-132.
42. Over R. An experimentally induced conflict between vision and proprioception. Br. J. Psychol. 57:1966;335-341.
43. Populin L.C., Yin T.C.T. Bimodal interactions in the superior colliculus of the behaving cat. J. Neurosci. 22:2002;2826-2834.
44. Risberg, A., Lubker, J., 1978. Prosody and speech-reading. STL Quarterly Progress and Status Report, vol. 4, pp. 1-16.
45. Sade A., Spitzer H. The effects of attentional spread and attentional effort on orientation discrimination. Spatial Vision. 11:1998;367-383.
46. Schnupp J.W.H., Giles J.D., Baddeley R.J., King A.J. Multisensory facilitation may be due to non-linearities in the neuron's rate-intensity function. Soc. Neurosci. Abstr. 23:1997;1542.
47. Schofleld A.J., Georgeson M.A. Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour. Vision Res. 39:1999;2697-2716.
48. Shaw M.L. Attending to multiple sources of information: 1. The integration of information in decision making. Cog. Psychol. 14:1982;353-409.
49. Shaw M.L., Mulligan R.M. Models for bimodal signal detection: a reply to Fidell. Percept. Psychophys. 31:1982;91-92.
50. Sinclair R.J., Kuo J.J., Burton H. Effects on discrimination performance of selective attention to tactile features. Somatosens. Motor Res. 17:2000;145-157.
51. Soto-Faraco, S., Kingstone, A. Multisensory integration of dynamic information. In: Calvert, G., Spence, C., Stein, B. (Eds.), The Handbook of Multisensory Processes. MIT Press, in press.
52. Spence C., Driver J. Audiovisual links in endogenous covert spatial attention. J. Exp. Psychol.: Hum. Percept. Performance. 22:1996;1005-1030.
53. Spence C., Driver J. On measuring selective attention to a specific sensory modality. Percept. Psychophys. 59:1997;389-403.
54. Spence C., Driver J. Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism. Neuroreport. 11:2000;2057-2061.
55. Spence C., Nicholls M.E.R., Driver J. The cost of expecting events in the wrong sensory modality. Percept. Psychophys. 63:2001;330-336.
56. Spence C., Shore D.I., Klein R.M. Multisensory prior entry. J. Exp. Psychol.: Gen. 130:2001;799-832.
57. Srinivasan M.A., LaMotte R.H. Tactile discrimination of softness. J. Neurophysiol. 73:1995;88-101.
58. Stack D.M., Tsonis M. Infants' haptic perception of texture in the presence and absence of visual cues. Br. J. Dev. Psychol. 17:1999;97-110.
59. Stein B.E., London N., Wilkinson L.K., Price D.P. Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J. Cog. Neurosci. 8:1996;497-506.
60. Stein B.E., Meredith M.A. The Merging of the Senses. 1993;MIT Press, Cambridge, MA.
61. Stein, B.E., Stanford, T.R., Wallace, M.T., Vaughan, W.J., Jiang, W. Crossmodal spatial interactions in subcortical and cortical circuits. In: Spence, C., Driver, J. (Eds.), Crossmodal Space and Crossmodal Attention. Oxford University Press, in press.
62. Thomas R.D. Perceptual interactions of facial dimensions in speeded classification and identification. Percept. Psychophys. 63:2001;625-650.
63. Tyle P. Effect of size, shape and hardness of particles in suspension on oral texture and palatability. Acta Psychol. 84:1993;111-118.
64. Ukponmwan J.O., Mukhopadhyay A., Chatterjee K.N. Pilling. 1998;The Textile Institute, Manchester, UK.
65. Verrillo R.T., Bolanowski S.J., McGlone F.P. Subjective magnitude of tactile roughness. Somatosens. Motor Res. 16:1999;352-360.
66. Verrillo R.T., Capraro A.J. Effect of simultaneous auditory stimulation on vibrotactile thresholds. Percept. Psychophys. 16:1974;597-600.
67. Welch R.B., Warren D.H. Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88:1980;638-667.
68. Xu B. Instrumental evaluation of fabric pilling. J. Text. Inst. 88:1997;488-500.