The design of hand gestures for human-computer interaction: Lessons from sign language interpreters

International Journal of Human Computer Studies

Volumn 72, Issue 10-11, 2014, Pages 728-735

  Rempel, David ^a   Camilleri, Matt J ^a   Lee, David L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Computer input; Computer interface; Gesture based interaction; Hand postures; Multi touch

Indexed keywords

DESIGN; GESTURE RECOGNITION; INTERFACES (COMPUTER); REGRESSION ANALYSIS;

GESTURE RECOGNITION SYSTEM; GESTURE-BASED INTERACTION; HAND POSTURE; LOGISTIC REGRESSION MODELING; MULTI-TOUCH; NATURAL LANGUAGES; PHYSICAL PROCESS; SIGN LANGUAGE;

HUMAN COMPUTER INTERACTION;

EID: 84902687843     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2014.05.003     Document Type: Article

References (32)

1. R.R. Butterworth, and M. Flodin The Perigee Visual Dictionary of Signing: An A-to-Z Guide to Over 1250 Signs of American Sign Language 1991 Perigee Books New York, NY
2. P. Cerveri, E. De Momi, N. Lopomo, G. Baud-Bovy, R.M. Barros, and G. Ferrigno Finger kinematic modeling and real-time hand motion estimation Ann. Biomed. Eng. 35 2007 1989 2002 (Pubitemid 47631066)
3. L. Cohn, R.M. Lowry, and S. Hart Overuse syndromes of the upper extremity in interpreters for the deaf Orthopaedics 13 1990 207 209 (Pubitemid 20059652)
4. J.J. DeCaro, M. Feuerstein, and T.A. Hurwitz Cumulative trauma disorders among educational interpreters Am. Ann. Deaf 137 1992 288 292
5. M. Feuerstein, and T.E. Fitzgerald Biomechanical factors affecting upper extremity cumulative trauma disorders in sign language interpreters J. Occup. Med. 34 3 1992 257 264
6. M. Feuerstein, A.M. Carosella, L.M. Burrell, L. Marshall, and J. Decaro Occupational upper extremity symptoms in sign language interpreters: prevalence and correlates of pain, function, and work disability J. Occup. Rehabil. 7 1997 187 205 (Pubitemid 28124451)
7. W. Fikkert, P. van der Vet, G. van der Veer, and A. Nijholt Gestures for large display control S Kopp, I Wachsmuth, Gesture in Embodied Communication and Human-Computer Interaction, volume 5934 of Lecture Notes in Computer Science 2010 Springer Berlin/Heidelberg 245 256
8. S.L. Fischer, M.M. Marshall, and K. Woodcock Musculoskeletal disorders in sign language interpreters: a systematic review and conceptual model of musculoskeletal disorder development Work 42 2 2012 173 184
9. W.B. Greene, and J.D. Heckman The Clinical Measurement of Joint Motion first ed. 1994 American Academy of Orthopaedic Surgeons Chicago, IL
10. G. Gustason, D. Pfetzing, and E. Zawolkow Signing Exact English 1980 Modern Signs Press Los Alamitos, CA
11. T.C. Horton, S. Sauerland, and T.R. Davis The effect of flexor digitorum profundus quadriga on grip strength J. Hand Surg. Eur. 32 2 2007 130 134
12. P.J. Keir, J.M. Bach, and D.M. Rempel Effects of finger posture on carpal tunnel pressure during wrist motion J Hand Surg. 23A 1998 1004 1009 (Pubitemid 29102305)
13. Kray, C., Nesbitt, D., Dawson, J., Rohs, M. 2010. User-defined gestures for connecting mobile phones, public displays, and tabletops. In: Proceedings 12th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI '10. pp. 239-248.
14. L.E. Lester, J.W. Bevins, C. Hughes, A. Rai, H. Whalley, M. Arafa, D.E. Shepherd, and D.W. Hukins Range of motion of the metacarpophalangeal joint in rheumatoid patients, with and without a flexible replacement prosthesis, compared with normal subjects Clin. Biomech. 27 5 2012 449 452
15. G. Manresa, J. Varona, R. Mas, and F.J. Perales Hand tracking and gesture recognition for human-computer interaction Electron. Lett. Comput. Vision Image Anal. 5 3 2005 96 104
16. Mistry, P., Maes, P., Chang, L. 2009. Wuw - wear ur world: a wearable gestural interface. In: Proc. 27th International Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA '09. pp. 4111-4116.
17. M. Nielsen, M. Störring, T.B. Moeslund, and E. Granum A procedure for developing intuitive and ergonomic gesture interfaces for HCI Proc. Gesture-Based Commun. Hum. Comput. Interact. 2004 2004 105 106
18. J. Qin, M. Marshall, J. Mozrall, and M. Marschark Effects of pace and stress on upper extremity kinematic responses in sign language interpreters Ergonomics 51 2008 274 289 (Pubitemid 351997498)
19. S. Radhakrishnan, Y. Ling, I. Zeid, and S. Kamarthi Finger-based multitouch interface for performing 3D CAD operations Int. J. Hum. Comput. Stud. 71 2013 261 275
20. D.M. Rempel, J. Bach, L. Gordon, and R. Tal Effects of forearm pronation/supination on carpal tunnel pressure J. Hand Surg. 23 1 1998 38 42 (Pubitemid 29097737)
21. J. Ruiz, Y. Li, and E. Lank User-defined motion gestures for mobile interaction Proc. Hum. Factors Comput. Syst. 2011 2011 197 206
22. Scheible, J., Ojala, T., Coulton, P. 2008. Mobitoss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays. In: Proceedings 16th ACM International Conference on Multimedia, MM '08. pp. 957-960.
23. J. Scheuerle, A.M. Guilford, and M.B. Habal Work-related cumulative trauma disorders and interpreters for the deaf Appl. Occup. Environ. Hyg. 5 2000 429 434 (Pubitemid 30253240)
24. S.M. Smith, T.A. Kress, and W.M. Hart Hand/wrist disorders among sign language communicators Am. Ann. Deaf 145 2000 22 25
25. H.I. Stern, J.P. Wachs, and Y. Edan Designing hand gestures vocabularies for natural interaction by combining psycho-physiological and recognition factors Int. J. Semant. Comput. 2 1 2008 137 160
26. S. Wan, and H.T. Nguyen Human computer interaction using hand gesture Proc. IEEE Eng. Med. Biol. Soc. 2008 2008 2357 2360
27. W. Wenhui, C. Xiang, W. Kongqiao, Z. Xu, and Y. Jihai Dynamic gesture recognition based on multiple sensors fusion technology Proc. IEEE Eng. Med. Biol. Soc. 2009 7014 7017
28. Wobbrock, J. O, Morris, M. R, Wilson, A. D. 2009. User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI '09. pp. 1083-1092.
29. M. Wright, C.J Lin, E. O'Neill, D. Cosker, and P. Johnson 3D gesture recognition: an evaluation of user and system performance Proc. Pervasive 2011 2011 294 313
30. A. Wu, K. Hassan-Shafique, M. Shah, and N. da Vitoria Lobo Virtual three-dimensional blackboard: three-dimensional finger tracking with a single camera Appl. Opt. 43 2004 379 390
31. Yatani, K., Tamura, K., Hiroki, K., Sugimoto, M., Hashizume, H. 2005. Toss-it: intuitive information transfer techniques for mobile devices. In: Proceedings CHI'05. pp. 1881-1884.
32. J. Yoo, W. Hwang, H. Seok, S. Park, C. Kim, and K. Park Cocktail: exploiting bartenders' gestures for mobile interaction Image 2 3 2010 44 57