Integration of auditory and vibrotactile stimuli: Effects of frequency

Journal of the Acoustical Society of America

Volumn 127, Issue 5, 2010, Pages 3044-3059

  Wilson, E Courtenay ^a   Reed, Charlotte M ^a   Braida, Louis D ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSOLUTE FREQUENCY; AUDITORY STIMULI; BROADBAND NOISE; DETECTION EXPERIMENTS; DETECTION PERFORMANCE; FREQUENCY SPACING; RELATIVE FREQUENCIES; SINGLE CHANNELS; SOUND PRESSURE LEVEL; STIMULATION FREQUENCIES; STIMULUS LEVELS; TACTILE STIMULI; THRESHOLD LEVELS; TONE PULSE; UNIMODAL; VIBROTACTILE;

EXPERIMENTS;

ADAPTATION; ADOLESCENT; ADULT; ARTICLE; AUDITORY NERVOUS SYSTEM; AUDITORY STIMULATION; AUDITORY THRESHOLD; BIOLOGICAL MODEL; COMPARATIVE STUDY; FEMALE; FINGER; HEARING; HUMAN; INNERVATION; MALE; MIDDLE AGED; PERCEPTION; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; PSYCHOPHYSICS; PURE TONE AUDIOMETRY; TOUCH; VIBRATION;

ACOUSTIC STIMULATION; ADAPTATION, PHYSIOLOGICAL; ADOLESCENT; ADULT; AUDIOMETRY, PURE-TONE; AUDITORY PATHWAYS; AUDITORY PERCEPTION; AUDITORY THRESHOLD; FEMALE; FINGERS; HUMANS; MALE; MIDDLE AGED; MODELS, NEUROLOGICAL; PERCEPTUAL MASKING; PITCH PERCEPTION; PSYCHOACOUSTICS; SIGNAL DETECTION, PSYCHOLOGICAL; TOUCH; TOUCH PERCEPTION; VIBRATION; YOUNG ADULT;

EID: 77956244932     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3365318     Document Type: Article

References (61)

1. Bilecen, D., Scheffler, K., Schmid, N., Tschopp, K., and Seelig, J. (1998). " Tonotopic organization of the human auditory cortex as detected by BOLD-FMRI.," Hear. Res. 0378-5955 126, 19-27. 10.1016/S0378-5955(98) 00139-7
2. Bolanowski, S. J., Gescheider, G. A., and Verrillo, R. T. (1988). " Four channels mediate the mechanical aspects of touch.," J. Acoust. Soc. Am. 0001-4966 84, 1680-1694. 10.1121/1.397184
3. Braida, L. D. (1991). " Crossmodal integration in the identification of consonant segments.," Q. J. Exp. Psychol. 0033-555X 43A, 647-677.
4. Cappe, C., and Barone, P. (2005). " Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey.," Eur. J. Neurosci. 0953-816X 22, 2886-2902. 10.1111/j.1460-9568. 2005.04462.x
5. Dadson, R. S., and King, J. H. (1952). " A determination of the normal threshold of hearing and its relation to the standardization of audiometers.," J. Laryngol. Otol. 0022-2151 66, 366-378. 10.1017/S0022215100047812
6. de Lafuente, V., and Romo, R. (2005). " Neuronal correlates of subjective sensory experience.," Nat. Neurosci. 1097-6256 8, 1698-1703. 10.1038/nn1587
7. Fletcher, H. (1940). " Auditory patterns.," Rev. Mod. Phys. 0034-6861 12, 47-65. 10.1103/RevModPhys.12.47
8. Fletcher, H., and Wegel, R. L. (1922). " The frequency-sensitivity of normal ears.," Proc. Natl. Acad. Sci. U.S.A. 0027-8424 8, 5-6.2. 10.1073/pnas.8.1.5
9. Formby, C., Morgan, L. N., Forrest, T. G., and Raney, J. J. (1992). " The role of frequency selectivity in measures of auditory and vibrotactile temporal resolution.," J. Acoust. Soc. Am. 0001-4966 91, 293-305. 10.1121/1.402772
10. Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., and Murray, M. M. (2002). " Auditory-somatosensory multisensory processing in auditory association cortex: An fMRI study.," J. Neurophysiol. 0022-3077 8, 540-543.
11. Francis, S. T., Kelly, E. F., Bowtell, R., Dunseath, W. J. R., Foger, S. E., and McGlone, F. (2000). " fMRI of the responses to vibratory stimulation of digit tips.," Neuroimage 1053-8119 11, 188-202. 10.1006/nimg.2000.0541
12. Fritzsch, B., and Beisel, K. W. (2001). " Evolution of the nervous system.," Brain Res. Bull. 0361-9230 55, 711-721. 10.1016/S0361-9230(01) 00558-5
13. Fritzsch, B., Beisel, K. W., Pauley, S., and Soukup, G. (2007). " Molecular evolution of the vertebrate mechanosensory cell and ear.," Int. J. Dev. Biol. 0214-6282 51, 663-678. 10.1387/ijdb.072367bf
14. Gescheider, G. A. (1970). " Some comparisons between touch and hearing.," IEEE Trans. Man-Machine Syst. 11, 28-35. 10.1109/TMMS.1970. 299958
15. Gescheider, G. A., Barton, W. G., Bruce, M. R., Goldberg, J. H., and Greenspan, M. J. (1969). " Effects of simultaneous auditory stimulation on the detection of tactile stimuli.," J. Exp. Psychol. 0022-1015 81, 120-125. 10.1037/h0027438
16. Gescheider, G. A., Bolanowski, S. J., and Hardick, K. R. (2001). " The frequency selectivity of information-processing channels in the tactile sensory system.," Somatosens. Mot. Res. 0899-0220 18, 191-201. 10.1080/01421590120072187
17. Gescheider, G. A., Bolanowski, S. J., Pope, J. V., and Verrillo, R. T. (2002). " A four-channel analysis of the tactile sensitivity of the fingertip: Frequency selectivity, spatial summation, and temporal summation.," Somatosens. Mot. Res. 0899-0220 19, 114-124. 10.1080/08990220220131505
18. Gillmeister, H., and Eimer, M. (2007). " Tactile enhancement of auditory detection and perceived loudness.," Brain Res. 0006-8993 1160, 58-68. 10.1016/j.brainres.2007.03.041
19. Green, D. M. (1958). " Detection of multiple component signals in noise.," J. Acoust. Soc. Am. 0001-4966 30, 904-911. 10.1121/1.1909400
20. Greenwood, P. D. (1961). " Auditory masking and the critical band.," J. Acoust. Soc. Am. 0001-4966 33, 484-502. 10.1121/1.1908699
21. Grose, J. H., and Hall, J. W., III (1997). " Multiband detection of energy fluctuations.," J. Acoust. Soc. Am. 0001-4966 102, 1088-1096. 10.1121/1.419613
22. Guest, S., Catmur, C., Lloyd, D., and Spence, C. (2002). " Audiotactile interactions in roughness perception.," Exp. Brain Res. 0014-4819 146, 161-171. 10.1007/s00221-002-1164-z
23. Hamer, R. D., Verrillo, R. T., and Zwislocki, J. J. (1983). " Vibrotactile masking of Pacinian and non-Pacinian channels.," J. Acoust. Soc. Am. 0001-4966 73, 1293-1303. 10.1121/1.389278
24. Harrington, G. S., and Downs, J. H., III (2001). " FMRI mapping of the somatosensory cortex with vibratory stimuli. Is there a dependency on stimulus frequency? " Brain Res. 0006-8993 897, 188-192. 10.1016/S0006-8993(01)02139-4
25. Harris, J. A., Arabzadeh, E., Fairhall, A. L., Benito, C., and Diamond, M. E. (2006). " Factors affecting frequency discrimination of vibrotactile stimuli: Implications for cortical encoding.," PLoS Biol. 1545-7885 1, 1-9.
26. Hashimoto, I., Saito, Y., Iguchi, Y., Kimura, T., Fukushima, T., Terasaki, O., and Sakuma, K. (1999). " Frequency representation in the human hand somatosensory cortex: A reappraisal.," NeuroReport 0959-4965 10, 959-963. 10.1097/00001756-199904060-00012
27. Hawkins, J. E., and Stevens, S. S. (1950). " The masking of pure tones and of speech by white noise.," J. Acoust. Soc. Am. 0001-4966 22, 6-13. 10.1121/1.1906581
28. Hegner, Y. L., Saur, R., Veit, R., Butts, R., Leiberg, S., Grodd, W., and Braun, C. (2007). " BOLD adaptation in vibrotactile stimulation: Neuronal networks involved in frequency discrimination.," J. Neurophysiol. 0022-3077 97, 264-271. 10.1152/jn.00617.2006
29. Hernandez, A., Zainos, A., and Romo, R. (2000). " Neuronal correlates of sensory discrimination in the somatosensory cortex.," Proc. Natl. Acad. Sci. U.S.A. 0027-8424 97, 6191-6196. 10.1073/pnas.120018597
30. Houtsma, A. J. (2004). " Hawkins and Stevens revisited with insert earphones.," J. Acoust. Soc. Am. 0001-4966 115, 967-970. 10.1121/1.1645246
31. Iguchi, Y., Hoshi, Y., Nemoto, M., Taira, M., and Hashimoto, I. (2007). " Co-activation of the secondary somatosensory and auditory cortices facilitates frequency discrimination of vibrotactile stimuli.," Neuroscience 0306-4522 148, 461-472. 10.1016/j.neuroscience.2007.06.004
32. Jousmäki, V., and Hari, R. (1998). " Parchment-skin illusion: Sound-biased touch.," Curr. Biol. 0960-9822 8, R190. 10.1016/S0960-9822(98) 70120-4
33. Lamoŕ, P. J., Muijser, H., and Keemijik, C. J. (1986). " Envelope detection of amplitude-modulated high-frequency sinusoidal signals by skin mechanoreceptors.," J. Acoust. Soc. Am. 0001-4966 79, 1082-1085. 10.1121/1.393380
34. Luna, R., Hernandez, A., Brody, C. D., and Romo, R. (2005). " Neural codes for perceptual discrimination in primary somatosensory cortex.," Nat. Neurosci. 1097-6256 8, 1210-1219. 10.1038/nn1513
35. Makous, J. C., Friedman, R. M., and Vierck, C. J., Jr. (1995). " A critical band filter in touch.," J. Neurosci. 0270-6474 15, 2808-2818.
36. Marill, T. (1956). " Detection theory and psychophysics.," Technical Report No. 319, Research Laboratory of Electronics, MIT, Cambridge, MA.
37. Marks, L. E. (1979). " Summation of vibrotactile intensity: An analog to auditory critical bands?," Sens. Processes 3, 188-203. 0363-3799
38. Moore, B. C. J., Peters, R. W., and Glasberg, B. R. (1990). " Auditory filter shapes at low center frequencies.," J. Acoust. Soc. Am. 0001-4966 88, 132-140. 10.1121/1.399960
39. Morley, J. W., and Rowe, M. J. (1990). " Perceived pitch of vibrotactile stimuli: Effects of vibration amplitude, and implications for vibration frequency coding.," J. Physiol. (London) 431, 403-416.
40. Neville, A. M., and Kennedy, J. B. (1964). Basic Statistical Methods for Engineers and Scientists (International Textbook Co., Scranton, PA), p. 133.
41. OConnell-Rodwell, C. E., Hart, L. A., and Arnason, B. T. (2001). " Exploring the potential use of seismic waves as a communication channel by elephants and other large mammals.," Am. Zool. 0003-1569 41, 1157-1170. 10.1668/0003-1569(2001)041[1157:ETPUOS]2.0.CO;2
42. Rabinowitz, W. M., Houtsma, A. J., Durlach, N. I., and Delhorne, L. A. (1987). " Multidimensional tactile displays: Identification of vibratory intensity, frequency and contactor area.," J. Acoust. Soc. Am. 0001-4966 82, 1243-1252. 10.1121/1.395260
43. Ro, T., Hsu, J., Yasar, N. E., Elmore, L. C., and Beauchamp, M. S. (2009). " Sound enhances touch perception.," Exp. Brain Res. 0014-4819 195, 135-143. 10.1007/s00221-009-1759-8
44. Romani, G. L., Williamson, S. J., and Kaufman, L. (1982). " Tonotopic organization of the human auditory cortex.," Science 0036-8075 216, 1339-1340. 10.1126/science.7079770
45. Romo, R., Hernandez, A., Zainos, A., Brody, C. D., and Lemus, L. (2000). " Sensing without touching: Psychophysical performance based on cortical microstimulation.," Neuron 0896-6273 26, 273-278. 10.1016/S0896-6273(00) 81156-3
46. Romo, R., Hernandez, A., Zainos, A., and Salinas, E. (1998). " Somatosensory discrimination based on cortical microstimulation.," Nature (London) 0028-0836 392, 387-390. 10.1038/32891
47. Schnupp, J. W. H., Dawe, K. L., and Pollack, G. (2005). " The detection of multisensory stimuli in an orthogonal sensory space.," Exp. Brain Res. 0014-4819 162, 181-190. 10.1007/s00221-004-2136-2
48. Schreiner, C. E., Read, H. L., and Sutter, M. L. (2000). " Modular organization of frequency integration in primary auditory cortex.," Annu. Rev. Neurosci. 0147-006X 23, 501-529. 10.1146/annurev.neuro.23.1.501
49. Schroeder, C. E., Lindskey, R. W., Specht, C., Marcovici, A., Smiley, J. F., and Javitt, D. C. (2001). " Somatosensory input to auditory association cortex in the macaque monkey.," J. Neurophysiol. 0022-3077 85, 1322-1327.
50. Schürmann, M., Caetano, G., Hlushchuk, Y., Jousmaki, V., and Hari, R. (2006). " Touch activates human auditory cortex.," Neuroimage 1053-8119 30, 1325-1331. 10.1016/j.neuroimage.2005.11.020
51. Schürmann, M., Caetano, G., Jousmaki, V., and Hari, R. (2004). " Hands help hearing: Facilitatory audiotactile interaction at low sound-intensity levels.," J. Acoust. Soc. Am. 0001-4966 115, 830-832. 10.1121/1.1639909
52. Talavage, T. M., Ledden, P. J., Benson, R. R., Rosen, B. R., and Melcher, J. R. (2000). " Frequency-dependent responses exhibited by multiple regions in human auditory cortex.," Hear. Res. 0378-5955 150, 225-244. 10.1016/S0378-5955(00)00203-3
53. Talavage, T. M., Sereno, M. I., Melcher, J. R., Ledden, P. J., Rosen, B. R., and Dale, A. M. (2004). " Tonotopic organization in human auditory cortex revealed by progressions of frequency sensitivity.," J. Neurophysiol. 0022-3077 91, 1282-1296. 10.1152/jn.01125.2002
54. Verrillo, R. T. (1963). " Effect of contactor area on the vibrotactile threshold.," J. Acoust. Soc. Am. 0001-4966 35, 1962-1966. 10.1121/1.1918868
55. Verrillo, R. T., Gescheider, G. A., Calman, B. G., and Van Doren, C. L. (1983). " Vibrotactile masking: Effect of one-and two-site stimulation.," Percept. Psychophys. 0031-5117 33, 379-387.
56. Watson, C. S., Franks, J. R., and Hood, D. C. (1972). " Detection of tones in the absence of external noise I. Effects of signal intensity and signal frequency.," J. Acoust. Soc. Am. 0001-4966 52, 633-643. 10.1121/1.1913153
57. Wilson, E. C., Reed, C. M., and Braida, L. D. (2009). " Integration of auditory and vibrotactile stimuli: Effects of phase and stimulus-onset asynchrony.," J. Acoust. Soc. Am. 0001-4966 126, 1960-1974. 10.1121/1.3204305
58. Yarrow, K., Haggard, P., and Rothwell, J. C. (2008). " Vibrotactile-auditory interactions are post-perceptual.," Perception 0301-0066 37, 1114-1130. 10.1068/p5824
59. Yau, J. M., Olenczak, J. B., Dammann, J. F., and Bensmaia, S. J. (2009). " Temporal frequency channels are linked across audition and touch.," Curr. Biol. 0960-9822 19, 561-566. 10.1016/j.cub.2009.02.013
60. Zhou, J., and Shore, S. (2004). " Projections from the trigeminal nuclear complex to the cochlear nuclei: A retrograde and anterograde tracing study in the guinea pig.," J. Neurosci. Res. 0360-4012 78, 901-907. 10.1002/jnr.20343
61. Zwicker, E. (1961). " Subdivision of the audible frequency range into critical bands (frequenzgruppen).," J. Acoust. Soc. Am. 0001-4966 33, 248. 10.1121/1.1908630