Real-time perception-level translation from audio signals to vibrotactile effects

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2013, Pages 2567-2576

  Lee, Jaebong ^a   Choi, Seungmoon ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

Author keywords

Audio; Automatic conversion; Haptics; Perceived intensity; Perceived roughness; Vibrotactile effect

Indexed keywords

AUDIO; AUTOMATIC CONVERSION; HAPTICS; PERCEIVED INTENSITY; VIBROTACTILE;

ALGORITHMS; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; MOBILE DEVICES; SIGNAL DETECTION;

AUDIO ACOUSTICS;

EID: 84877943830     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2470654.2481354     Document Type: Conference Paper

References (32)

1. Ahmaniemi, T., Marila, J., and Lantz, V. Design of dynamic vibrotactile textures. IEEE Transactions on Haptics 3, 4 (2010), 245-256.
2. Bensmaia, S., Hollins, M., and Yau, J. Vibrotactile intensity and frequency information in the pacinian system: A psychophysical model. Perception & Psychophysics 67, 5 (2005), 828-841.
3. Birnbaum, D. M., and Wanderley, M. M. A systematic approach to musical vibrotactile feedback. In Proc. ICMC, vol. 2 (2007), 397-404.
4. Brown, L. M., Brewster, S. A., and Purchase, H. C. A first investigation into the effectiveness of tactons. In Proc. WHC, IEEE (2005), 167-176.
5. Chafe, C. Tactile audio feedback. In Proc. ICMC (1993), 76-79.
6. Chang, A., and O'Sullivan, C. Audio-haptic feedback in mobile phones. In Ext. Abstracts CHI, ACM Press (2005), 1264-1267.
7. Chi, D., Cho, D., Oh, S., Jun, K., You, Y., Lee, H., and Sung, M. Sound-specific vibration interface using digital signal processing. In Proc. CSSE (2008), 114-117.
8. Gescheider, G. A. Psychophysics: The Fundamentals, 3rd ed. Lawrence Erlbaum, 1997.
9. Glasberg, B. R., and Moore, B. C. J. A model of loudness applicable to time-varying sounds. Journal of Audio Engineering Society 50, 5 (2002), 331-342.
10. Han, S., Song, M., and Kwahk, J. A systematic method for analyzing magnitude estimation data. International Journal of Industrial Ergonomics 23, 5-6 (1999), 513-524.
11. Hollins, M., Faldowski, R., Rao, S., and Young, F. Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis. Perception & Psychophysics 54, 6 (1993), 697-705.
12. Hutchinson, W., and Knopoff, L. The acoustic component of western consonance. Journal of New Music Research 7, 1 (1978), 1-29.
13. Hwang, I., and Choi, S. Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device. In Proc. Haptics Symposium, IEEE (2010), 1-8.
14. Kameoka, A., and Kuriyagawa, M. Consonance theory, part I: Consonance of dyads. The Journal of the Acoustical Society of America 45, 6 (1969), 1451-1459.
15. Kameoka, A., and Kuriyagawa, M. Consonance theory, part II: Consonance of complex tones and its calculation method. The Journal of the Acoustical Society of America 45, 6 (1969), 1460-1469.
16. Karam, M., Russo, F. A., and Fels, D. I. Designing the model human cochlea: An ambient crossmodal audio-tactile display. IEEE Transactions on Haptics 2, 3 (2009), 160-169.
17. Kim, M., Lee, S., and Choi, S. Saliency-driven tactile effect authoring for real-time visuotactile feedback. In Proc. EuroHaptics 2012, vol. LNCS 7282 (2012), 258-269.
18. Kim, Y., Cha, J., Oakley, I., and Ryu, J. Exploring tactile movies: An initial tactile glove design and concept evaluation. IEEE MultiMedia 16, 3 (2009), 34-44.
19. Klatzky, R. L., and Lederman, S. J. Tactile roughness perception with a rigid link interposed between skin and surface. Perception & Psychophysics 61, 4 (1999), 591-607.
20. Konyo, M., Tadokoro, S., Yoshida, A., and Saiwaki, N. A tactile synthesis method using multiple frequency vibrations for representing virtual touch. In Proc. IROS (2005), 3965-3971.
21. Kutner, M. H., Nachtsheim, C. J., Neter, J., and Li, W. Applied Linear Statistical Models, 5th ed. McGraw-Hill, 2005.
22. Lee, J., Ryu, J., and Choi, S. Vibrotactile Score: A score metaphor for designing vibrotactile patterns. In Proc. WHC, IEEE (2009), 302-307.
23. LG Electronics. Apparatus and method for generating vibration pattern. US Patent Application, No. 12/840,988, Jul. 21, 2010.
24. Li, K. A., Sohn, T., Huang, S., and Griswold, W. G. PeopleTones: A system for the detection and notification of buddy proximity on mobile phones. In Proc. MobiSys, ACM Press (2008), 160-173.
25. Marshall, M. T., and Wanderley, M. M. Examining the effects of embedded vibrotactile feedback on the feel of a digital musical instrument. In Proc. NIME (2011), 399-404.
26. Ryu, J., and Choi, S. posVibEditor: Graphical authoring tool of vibrotactile patterns. In Proc. HAVE, IEEE (2008), 120-125.
27. Ryu, J., Jung, J., Park, G., and Choi, S. Psychophysical model for vibrotactile rendering in mobile devices. Presence 19, 4 (2010), 364-387.
28. Vassilakis, P. N. SRA: A web-based research tool for spectral and roughness analysis of sound signals. In Proc. SMC (2007), 319-325.
29. Verrillo, R. T. Measurement of vibrotactile sensation magnitude. In Ratio Scaling of Psychological Magnitude: In Honor of the Memory of S. S. Stevens, S. J. Bolanowski and G. A. Gescheider, Eds. Lawrence Erlbaum Associates, Inc., 1991, 260-275.
30. Yao, H., Grant, D., and Cruz-Hernandez, J. M. Perceived vibration strength in mobile devices: The effect of weight and frequency. IEEE Transactions on Haptics 3, 1 (2010), 56-62.
31. Yoo, Y., Hwang, I., and Choi, S. Consonance perception of vibrotactile chords: A feasibility study. In Proc. HAID, vol. LNCS 6851 (2011), 42-51.
32. Zwicker, E., and Fastl, H. Psychoacoustics: Facts and models, 2nd ed. Springer-Verlag, 1999.