Identification of walked-upon materials in auditory, kinesthetic, haptic, and audio-haptic conditions

Journal of the Acoustical Society of America

Volumn 131, Issue 5, 2012, Pages 4002-4012

  Giordano, Bruno L ^a   Visell, Yon ^a   Yao, Hsin Yun ^b   Hayward, Vincent ^c   Cooperstock, Jeremy R ^a   McAdams, Stephen ^a  

^a MCGILL UNIVERSITY   (Canada)

^b Tactile Labs   (Canada)

^c UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AGGREGATES; GRAVEL; SENSORY ANALYSIS;

EXPERIMENTAL CONDITIONS; LOOSE MATERIALS; MULTISENSORY INFORMATION; PERCEPTUAL SYSTEM; POSTURAL INSTABILITIES; SENSORY INFORMATION; SOLID MATERIAL; TACTILE INFORMATION;

AUDIO ACOUSTICS;

ADULT; ARTICLE; AUDITORY STIMULATION; BUILDING MATERIAL; EPIDEMIOLOGY; HEARING; HUMAN; MALE; PERCEPTION; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; TOUCH; VIBRATION; WALKING; WOOD;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BIAS (EPIDEMIOLOGY); CONSTRUCTION MATERIALS; DISCRIMINATION (PSYCHOLOGY); HUMANS; MALE; PERCEPTUAL MASKING; PHOTIC STIMULATION; TOUCH PERCEPTION; VIBRATION; WALKING; WOOD;

EID: 84863799349     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3699205     Document Type: Article

References (68)

1. Altinsoy, M. (2008). "The effect of auditory cues on the audiotactile roughness perception: Modulation frequency and sound pressure level," in Haptic and Audio Interaction Design (HAID 2008 Proceedings), edited by A. Pirhonen and S. Brewster (Springer- Verlag, Berlin), Vol. 5270 of Lecture Notes in Computer Science, pp. 120-129.
2. ANSI. (1974). S3.19, Method for the Measurement of Real-Ear Protection of Hearing Protectors and Physical Attenuation of Earmuffs (American National Standards Institute, New York).
3. Ashby, F. G. (1992). Multidimensional Models of Perception and Cognition (Erlbaum, Hillsdale, NJ), pp. 1-523.
4. Ashby, F. G., and Perrin, N. A. (1988). "Toward a unified theory of similarity and recognition," Psychol. Rev. 95, 124-150. 10.1037/0033-295X.95.1.124
5. Ashby, F. G., and Townsend, J. T. (1986). "Varieties of perceptual independence," Psychol. Rev. 93, 154-179. 10.1037/0033-295X.93.2.154
6. Avanzini, F., and Crosato, P. (2006). "Haptic-auditory rendering and perception of contact stiffness," in Haptic and Audio Interaction Design (HAID 2006 Proceedings), edited by D. McGookin and S. Brewster (Springer-Verlag, Berlin), Vol. 4129 of Lecture Notes in Computer Science, pp. 24-35.
7. Ballas, J. A. (1993). "Common factors in the identification of an assortment of brief everyday sounds," J. Exp. Psychol. Hum. Percept. Perform. 19, 250-267. 10.1037/0096-1523.19.2.250
8. Ballesteros, S., and Heller, M. A. (2008). "Haptic object identification," in Human Haptic Perception: Basics and Applications, edited by M. Grunwald (Birkhäuser, Basel), pp. 207-222.
9. Courtney, A., and Chow, H. M. (2000). "A study of tile design for tactile guide pathways," Int. J. Ind. Ergonom. 25, 693-698. 10.1016/S0169-8141(99)00051-7
10. DiFranco, D. E., Beauregard, G. L., and Srinivasan, M. A. (1997). "The effect of auditory cues on the haptic perception of stiffness in virtual environments," in Proceedings of the ASME Dynamic Systems and Control Division, DSC, edited by G. Rizzoni (American Society of Mechanical Engineers, New York), pp. 17-22.
11. Donelan, J. M., Kram, R., and Kuo, A. D. (2002). "Mechanical work for step-to-step transitions is a major determinant of the metabolic cost of human walking," J. Exp. Biol. 205, 3717-3727.
12. Ekimov, A., and Sabatier, J. (2006). "Vibration and sound signatures of human footsteps in buildings," J. Acoust. Soc. Am. 120, 762-768. 10.1121/1.2217371
13. Ekimov, A., and Sabatier, J. (2008). "A review of human signatures in urban environments using acoustic and seismic methods," in Proceedings of IEEE Conference on Technologies for Homeland Security, pp. 215-220.
14. Ennis, D. M., and Ashby, F. G. (2003). "Fitting decision bound models to identification or categorization data," Technical Report (Department of Psychology, University of California Santa Barbara).
15. Ferris, D. P., Louie, M., and Farley, C. T. (1998). "Running in the real world: Adjusting leg stiffness for different surfaces," Proc. R. Soc. London B 265, 989-994. 10.1098/rspb.1998.0388
16. Fisher, R. (1915). "Frequency distribution of the values of the correlation coefficient in samples of an indefinitely large population," Biometrika 10, 507-521.
17. Freed, D. J. (1990). "Auditory correlates of perceived mallet hardness for a set of recorded percussive events," J. Acoust. Soc. Am. 87, 311-322. 10.1121/1.399298
18. Galbraith, F., and Barton, M. (1970). "Ground loading from footsteps," J. Acoust. Soc. Am. 48, 1288-1292. 10.1121/1.1912271
19. Giordano, B. L., Avanzini, F., Wanderley, M., and McAdams, S. (2010a). "Multisensory integration in percussion performance," in Actes du 10eme Congrès Français d'Acoustique, Lyon [Proceedings of the 10th French Congress of Acoustics] (Société Française d'Acoustique, Paris, France) (CD-ROM).
20. Giordano, B. L., and McAdams, S. (2006). "Material identification of real impact sounds: Effects of size variation in steel, glass, wood and Plexiglas plates," J. Acoust. Soc. Am. 119, 1171-1181. 10.1121/1.2149839
21. Giordano, B. L., McAdams, S., Visell, Y., Cooperstock, J., Yao, H., and Hayward, V. (2008). "Non-visual identification of walking grounds," J. Acoust. Soc. Am. 123, 3412. 10.1121/1.2934136
22. Giordano, B. L., Rocchesso, D., and McAdams, S. (2010b). "Integration of acoustical information in the perception of impacted sound sources: The role of information accuracy and exploitability," J. Exp. Psychol. Hum. Percept. Perform. 36, 462-476. 10.1037/a0018388
23. Grassi, M. (2005). "Do we hear size or sound? Balls dropped on plates," Percept. Psychophys. 67, 274-284. 10.3758/BF03206491
24. Green, D. M., and Swets, J. A. (1966). Signal Detection Theory and Psychophysics (Wiley, New York), pp. 1-455.
25. Guest, S., Catmur, C., Lloyd, D., and Spence, C. (2002). "Audiotactile interactions in roughness perception," Exp. Brain Res. 146, 161-171. 10.1007/s00221-002-1164-z
26. Heller, M. A. (1982). "Visual and tactual texture perception: Intersensory cooperation," Percept. Psychophys. 31, 339-344. 10.3758/BF03202657
27. ISO 389-8. (2004). "Acoustics-Reference zero for the calibration of audiometric equipment-Part 8: Reference equivalent threshold sound pressure levels for pure tones and circumaural earphones," Technical Report (International Organization for Standardization, Geneva, Switzerland).
28. Jansson, G. (1993). "Perception of the amount of fluid in a vessel shaken by hand," in Studies in Perception and Action II, edited by S. S. Valenti and J. B. Pittinger (Psychology Press, Taylor & Francis Group, New York), pp. 263-267.
29. Jones, L. A., and Lederman, S. J. (2006). Human Hand Function (Oxford University Press, New York), pp. 1-270.
30. Jousmäki, V., and Hari, R. (1998). "Parchment-skin illusion: Sound-biased touch," Curr. Biol. 8, 190-190. 10.1016/S0960-9822(98)70120-4
31. Kekoni, J., Hämäläinen, H., Rautio, J., and Tukeva, T. (1989). "Mechanical sensibility of the sole of the foot determined with vibratory stimuli of varying frequency," Exp. Brain Res. 78, 419-424. 10.1007/BF00228915
32. Kennedy, P. M., and Inglis, J. T. (2002). "Distribution and behaviour of glabrous cutaneous receptors in the human foot sole," J. Physiol. (London) 583, 995-1002. 10.1113/jphysiol.2001.013087
33. Kim, S., Kyung, K., and Kwon, D. (2007). "The effect of sound on haptic perception," in Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07) (IEEE Computer Society, Los Alamitos, CA), pp. 354-360.
34. Kinsella-Shaw, J. M., Shaw, B., and Turvey, M. T. (1992). "Perceiving 'walk-on-able' slopes," Ecological Psychol. 4, 223-239. 10.1207/s15326969eco0404-2
35. Klatzky, R. L., and Lederman, S. J. (2002). "Touch," in Handbook of Psychology, Volume 4 (Experimental Psychology), edited by A. F. Healy and R. W. Proctor (Wiley, New York), pp. 147-176.
36. Klatzky, R. L., Lederman, S. J., and Metzger, V. A. (1985). "Identifying objects by touch: An 'expert system,' "Percept. Psychophys. 37, 299-302. 10.3758/BF03211351
37. Klatzky, R. L., Lederman, S. J., and Reed, C. (1989). "Haptic integration of object properties: Texture, hardness, and planar contour," J. Exp. Psychol. Hum. Percept. Perform. 15, 45-57. 10.1037/0096-1523.15.1.45
38. Kobayashi, Y., Osaka, R., Hara, T., and Fujimoto, H. (2008). "How accurately people can discriminate the differences of floor materials with various elasticities," IEEE Trans. Neural Syst. Rehabil. Eng. 16, 99-105. 10.1109/TNSRE.2007.910283
39. Kording, K., and Wolpert, D. (2006). "Bayesian decision theory in sensorimotor control," Trends Cogn. Sci. 10, 319-326. 10.1016/j.tics.2006.05.003
40. Lederman, S. J. (1979). "Auditory texture perception," Perception 8, 93-103. 10.1068/p080093
41. Lederman, S. J., and Klatzky, R. L. (2004). "Multisensory texture perception," in Handbook of Multisensory Processes, edited by G. Calvert, C. Spence, and B. Stein (MIT Press, Cambridge, MA), pp. 107-122.
42. Lederman, S. J., Klatzky, R. L., Morgan, T., and Hamilton, C. (2002). "Integrating multi-modal information about surface texture via a probe: Relative contributions of haptic and touch-produced sound sources," in Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS 2002), pp. 97-104.
43. Li, X., Logan, R. J., and Pastore, R. E. (1991). "Perception of acoustic source characteristics: Walking sounds," J. Acoust. Soc. Am. 90, 3036-3049. 10.1121/1.401778
44. Lin, L. I. (1989). "A concordance correlation coefficient to evaluate reproducibility," Biometrics 45, 255-268. 10.2307/2532051
45. ® for mixed models, 2nd ed. (SAS Institute Inc., Cary, NC), pp. 1-816.
46. Lutfi, R. A. (2007). "Human sound source identification," in Auditory Perception of Sound Sources, edited by W. A. Yost, R. R. Fay, and A. N. Popper (Springer, New York), pp. 13-42.
47. Martin, F. N., and Champlin, C. A. (2000). "Reconsidering the limits of normal hearing," J. Am. Acad. Audiol. 11, 64-66.
48. Pan, N., and Williams, K., (2005). "Effects of floor coverings on posture steadiness and locomotion stability," Tech. rep., National Textile Center.
49. Pastore, R. E., Flint, J. D., Gaston, J. R., and Solomon, M. J. (2008). "Auditory event perception: The source-perception loop for posture in human gait," Percept. Psychophys. 70, 13-29. 10.3758/PP.70.1.13
50. Perry, S. D., Santos, L. C., and Patla, A. E. (2001). "Contribution of vision and cutaneous sensation to the control of centre of mass (COM) during gait termination," Brain Res. 913, 27-34. 10.1016/S0006-8993(01)02748-2
51. Pittenger, J. B., Jordan, J., Belden, A., Goodspeed, P., and Brown, F. (1997). "Auditory and haptic information support perception of size," in Studies in Perception and Action IV, edited by M. A. Schmuckler and J. M. Kennedy (Erlbaum, Hillsdale, NJ), pp. 103-105.
52. Pittenger, J. B., and Mincy, M. D. (1999). "Haptic and auditory information support perception of size: Fine granules," in Studies in Perception and Action V, edited by M. A. Grealy and J. A. Thomson (Erlbaum, Hillsdale, NJ), pp. 68-71.
53. Reyes-Lecuona, A., and Cañadas-Quesada, F. J. (2009). "Interference of auditory information with haptic perception of stiffness in virtual reality," in Engineering the User Interface, edited by M. Redondo, C. Bravo, and M. Ortega (Springer-Verlag, London, UK), pp. 45-56.
54. Rosburg, T. (2008). "Tactile ground surface indicators in public places," in Human Haptic Perception: Basics and Applications, edited by M. Grunwald (Birkhäuser, Basel), pp. 491-499.
55. Souman, J. L., Frissen, I., Sreenivasa, M. N., and Ernst, M. O. (2009). "Walking straight into circles," Curr. Biol. 19, 1538-1542. 10.1016/j.cub.2009.07.053
56. Spence, C., and Shanker, M. U. (2010). "The influence of auditory cues on the perception of, and responses to, food and drink," J. Sens. Stud. 25, 406-430. 10.1111/j.1745-459X.2009.00267.x
57. Srinivasan, M. A., and LaMotte, R. H. (1995). "Tactual discrimination of softness," J. Neurophysiol. 73, 88-101.
58. Suzuki, Y., Gyoba, J., and Sakamoto, S. (2008). "Selective effects of auditory stimuli on tactile roughness perception," Brain Res. 1242, 87-94. 10.1016/j.brainres.2008.06.104
59. Verbeke, G., and Molenberghs, G. (2000). Linear Mixed Models for Longitudinal Data (Springer, New York), pp. 1-568.
60. Visell, Y. (2011). "Walking on virtual ground: Physics, perception, and interface design," Ph.D. thesis, Department of Electrical and Computer Engineering, McGill University.
61. Visell, Y., Giordano, B., Millet, G., and Cooperstock, J. (2011). "Vibration influences haptic perception of surface compliance during walking," PLoS ONE, 6, e17697. 10.1371/journal.pone.0017697
62. Warren, W. H., and Verbrugge, R. R. (1984). "Auditory perception of breaking and bouncing events: A case study in ecological acoustics," J. Exp. Psychol. Hum. Percept. Perform. 10, 704-712. 10.1037/0096-1523.10.5.704
63. Weinstein, S. (1968). "Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality," in The Skin Senses, edited by D. R. Kenshalo (Thomas, Springfield, IL), pp. 195-222.
64. Welch, R. B., and Warren, D. H. (1980). "Immediate perceptual response to intersensory discrepancy," Psychol. Bull. 88, 638-667. 10.1037/0033-2909.88.3.638
65. Well, C., Ward, L. M., Chua, R., and Inglis, J. T. (2003). "Regional variation and changes with ageing in vibrotactile sensitivity in the human footsole," J. Gerontol., Ser. A 58, 680-686. 10.1093/gerona/58.8.B680
66. West, B. T., Welch, K. B., and Galecki, A. T. (2006). Linear Mixed Models: A Practical Guide to Using Statistical Software (Chapman & Hall/CRC Press, Boca Raton, FL), pp. 1-353.
67. Yao, H.-Y., and Hayward, V. (2010). "Design and analysis of a recoil-type vibrotactile transducer," J. Acoust. Soc. Am. 128, 619-627. 10.1121/1.3458852
68. Zampini, M., and Spence, C. (2004). "The role of auditory cues in modulating the perceived crispness and staleness of potato chips," J. Sens. Stud. 19, 347-363. 10.1111/j.1745-459x.2004.080403.x