Conveying language through haptics: A multi-sensory approach

Proceedings - International Symposium on Wearable Computers, ISWC

Volumn , Issue , 2018, Pages 25-32

  Dunkelberger, Nathan ^a   Sullivan, Jenny ^a   Bradley, Joshua ^a   Walling, Nickolas P ^a   Manickam, Indu ^a   Dasarathy, Gautam ^a   Israr, Ali ^b   Lau, Frances W Y ^b   Klumb, Keith ^b   Knott, Brian ^b   Abnousi, Freddy ^b   Baraniuk, Richard ^a   O’Malley, Marcia K ^a  

^a RICE UNIVERSITY   (United States)

^b FACEBOOK   (United States)

Author keywords

Haptics; Multi sensory; Speech.; Wearable

Indexed keywords

SIGNALING; SPEECH; WEARABLE COMPUTERS;

ACOUSTIC SIGNALS; AUDITORY CHANNEL; HAPTIC DEVICES; HAPTICS; LARGE SURFACE AREA; MULTI-SENSORY; WEARABLE; WORD IDENTIFICATION;

VISUAL LANGUAGES;

EID: 85056821369     PISSN: 15504816     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3267242.3267244     Document Type: Conference Paper

References (23)

1. Edoardo Battaglia, Janelle P Clark, Matteo Bianchi, Manuel G Catalano, Antonio Bicchi, and Marcia K O’Malley. 2017. The Rice Haptic Rocker: skin stretch haptic feedback with the Pisa/IIT SoftHand. In World Haptics Conf. IEEE, 7–12.
2. P. L. Brooks and B. J. Frost. 1983. Evaluation of a tactile vocoder for word recognition. The Journal of the Acoustical Society of America 74, 1 (1983), 34–39.
3. Zvi Drezner. 2003. A new genetic algorithm for the quadratic assignment problem. INFORMS Journal on Computing 15, 3 (2003), 320 – 330.
4. Nathan Dunkelberger, Joshua Bradley, Jennifer L. Sullivan, Ali Israr, Frances Lau, Keith Klumb, Freddy Abnousi, and Marcia K. O’Malley. 2018. Improving Perception Accuracy with Multi-sensory Haptic Cue Delivery. In Haptics: Science, Technology, and Applications. Springer International Publishing, Cham, 289–301.
5. Mario Enriquez, Karon MacLean, and Christian Chita. 2006. Haptic Phonemes: Basic Building Blocks of Haptic Communication. In Proceedings of the 8th Int. Conf. on Multimodal Interfaces (ICMI’06). ACM, New York, NY, USA, 302–309.
6. Ali Israr, Peter H Meckl, Charlotte M Reed, and Hong Z Tan. 2009. Controller design and consonantal contrast coding using a multi-finger tactual display. The Journal of the Acoustical Society of America 125, 6 (2009), 3925–3935.
7. Ali Israr, Peter H Meckl, and Hong Z Tan. 2004. A two DOF controller for a multi-finger tactual display using a loop-shaping technique. In Proceedings of the ASME Int. Mechanical Engineering Congress and Exposition (IMECE04). 1083–1089.
8. Chandrika Jayant, Christine Acuario, William Johnson, Janet Hollier, and Richard Ladner. 2010. V-braille: Haptic Braille Perception Using a Touch-screen and Vibration on Mobile Phones. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’10). 295–296.
9. Yang Jiao, Frederico M. Severgnini, Juan Sebastian Martinez, Jaehong Jung, Hong Z. Tan, Charlotte M. Reed, E. Courtenay Wilson, Frances Lau, Ali Israr, Robert Turcott, Keith Klumb, and Freddy Abnousi. 2018. A Comparative Study of Phoneme- and Word-Based Learning of English Words Presented to the Skin. In Haptics: Science, Technology, and Applications. Springer International Publishing, Cham, 623–635.
10. Edward T. Auer Jr., Lynne E. Bernstein, and David C. Coulter. 1998. Temporal and spatio-temporal vibrotactile displays for voice fundamental frequency: An initial evaluation of a new vibrotactile speech perception aid with normal-hearing and hearing-impaired individuals. The Journal of the Acoustical Society of America 104, 4 (1998), 2477–2489.
11. Vincent Levesque, Jerome Pasquero, Vincent Hayward, and Maryse Legault. 2005. Display of virtual braille dots by lateral skin deformation: feasibility study. ACM Trans. on Applied Perception (TAP) 2, 2 (2005), 132–149.
12. Eliane M. Loiola, Nair M. Maia de Abreu, Paulo O. Boaventura-Netto, Peter Hahn, and Tania Querido. 2007. A survey for the quadratic assignment problem. European Journal of Operational Research 176, 2 (2007), 657–690.
13. Granit Luzhnica, Eduardo Veas, and Viktoria Pammer. 2016. Skin Reading: Encoding Text in a 6-channel Haptic Display. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC’16). ACM, New York, NY, USA, 148–155. DOI: http://dx.doi.org/10.1145/2971763.2971769
14. Kimberly Myles and Mary S. Binseel. 2007. The Tactile Modality: A Review of Tactile Sensitivity and Human Tactile Interfaces, U.S. Army Research Laboratory, ARL-TR-4115.
15. Scott D. Novich and David M. Eagleman. 2015. Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput. Experimental Brain Research 233, 10 (2015), 2777–2788.
16. E. Piateski and L. Jones. 2005. Vibrotactile pattern recognition on the arm and torso. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference. 90–95.
17. Charlotte M Reed, Nathaniel I Durlach, and Louis D Braida. 1982. Research on tactile communication of speech: a review. ASHA monographs 20 (1982), 1.
18. Hong Tan, Robert Gray, J Jay Young, and Ryan Taylor. 2003. A haptic back display for attentional and directional cueing. Haptics-e, The electronic journal of haptics research (2003).
19. Hong Z. Tan, Nathaniel I. Durlach, William M. Rabinowitz, Charlotte M. Reed, and Jonathan R. Santos. 1997. Reception of Morse code through motional, vibrotactile, and auditory stimulation. Perception & Psychophysics 59, 7 (1997), 1004–1017.
20. Hong Z. Tan, Charlotte M. Reed, and Nathaniel I. Durlach. 2010. Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities. IEEE Trans. on Haptics 3, 2 (2010), 98–108.
21. Emma Treadway, Brent Gillespie, Darren Bolger, Amy Blank, Marcia K. O’Malley, and Alicia Davis. 2015. The role of auxiliary and referred haptic feedback in myoelectric control. In World Haptics Conf. IEEE, Northwestern University, 13–18.
22. Robert Turcott, Jennifer Chen, Pablo Castillo, Brian Knott, Wahyudinata Setiawan, Forrest Briggs, Keith Klumb, Freddy Abnousi, Prasad Chakka, Frances Lau, and Ali Israr. 2018. Efficient Evaluation of Coding Strategies for Transcutaneous Language Communication. In Haptics: Science, Technology, and Applications. Springer International Publishing, Cham, 600–611.
23. Siyan Zhao, Ali Israr, Frances Lau, and Freddy Abnousi. 2018. Coding Tactile Symbols for Phonemic Communication. In Conference on Human Factors in Computing Systems.