Accurate and accessible motion-capture glove calibration for sign language data collection

ACM Transactions on Accessible Computing

Volumn 3, Issue 1, 2010, Pages

  Huenerfauth, Matt ^a   Lu, Pengfei ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Accessibility technology for the deaf; American Sign Language; Animation; Calibration; CyberGlove; Motion capture glove

Indexed keywords

ACCESSIBILITY TECHNOLOGY FOR THE DEAF; AMERICAN SIGN LANGUAGE; AUTOMATIC RECOGNITION; CALIBRATION PROCESS; CALIBRATION PROTOCOLS; CYBERGLOVE; DATA COLLECTION; DEAF USERS; EVALUATION STUDY; LOW LEVEL; MOTION CAPTURE; MOTION-CAPTURE GLOVE; NEW PROTOCOL; SIGN LANGUAGE; STANDARD CALIBRATION; STANDARD PROTOCOLS; UNDERSTANDABILITY;

ANIMATION;

CALIBRATION;

EID: 78651591047     PISSN: 19367228     EISSN: None     Source Type: Journal    
DOI: 10.1145/1838562.1838564     Document Type: Article

References (37)

1. BRASHEAR, H., STAMER, T., LUKOWICZ, P., AND JUNKER, H. 2003. Using multiple sensors for mobile sign language recognition. In Proceedings of the 7th IEEE International Symposium on Wearable Computers. IEEE Computer Society, 45.
2. CHAO, A. 2001. Uni-dimensional evaluation of Wristsystem and CyberGlove ®. Master Thesis, Department of Industrial and Manufacturing Engineering, Wichita State University, Los Alamitos, CA.
3. CHOU, T.-S., GADD, A., AND KNOTT, D. 2000. Hand-Eye: A vision based approach to data glove calibration. In Proceedings of Human Interface Technologies. 47-54.
4. COX, S., LINCOLN, M., TRYGGVASON, J., NAKISA, M., WELLS, M., TUTT, M., AND ABBOTT, S. 2002. Tessa, a system to aid communication with deaf people. In Proceedings of the 5th International ACM Conference on Assistive Technologies. ACM, New York, 205-212.
5. CYBERGLOVE SYSTEMS. 2009. Wireless data glove: The CyberGlove ® II system. http://www.cyberglovesystems.com/products/hardware/cyberglove.php
6. DIPIETRO, L., SABATINI, A. M., AND DARIO, P. 2003. Evaluation of an instrumented glove for hand-movement acquisition. J. Rehabil. Res. Dev. 40, 179-190.
7. ELLIOTT, R., GLAUERT, J., KENNAWAY, J., MARSHALL, I., AND SAFAR, E. 2008. Linguistic modeling and language-processing technologies for avatar-based sign language presentation. Univ. Access. Inf. Soc. 6, 4, 375-391.
8. FISCHER, M., VAN DER SMAGT, P., AND HIRZINGER, G. 1998. Learning techniques in a DataGlove based telemanipulation system for the DLR hand. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). 1603-1608.
9. GREENLEAF, W. J. 1996. Developing the tools for practical VR applications. IEEE Engin. Med. Biol, 23-30.
10. GRIFFIN, W. B., FINDLEY, R. P., TURNER, M. L., AND CUTKOSKY, M. R. 2000. Calibration and mapping of a human hand for dexterous telemanipulation. In Proceedings of the ASME International Mechanical Engineering Congress and Exposition, Dynamics Systems and Controls. 1145-1152.
11. HUENERFAUTH, M. 2009a. Improving spatial reference in American sign language animation through data collection from native ASL signers. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction (UAHCI). Lecture Notes in Computer Science, vol.5616, 530-539, Springer-Verlag.
12. HUENERFAUTH, M. 2009b. A linguistically motivated model for speed and pausing in animations of American sign language. ACM Trans. Access. Comput. 2, 2, Art. 9.
13. IMMERSION TOUCHSENSE TECHNOLOGY. 2007. VirtualHand ® for MotionBuilder - User Guide. Ver. 1.10.
14. IMMERSION CORPORATION. 2006. Immersion CyberGlove Data Glove User Guide.
15. KADOUCHE, R. AND MOKHTARI, M. 2005. Modeling of the residual capability for people with severe motor disabilities: Analysis of hand posture. In Proceedings of the Conference on User Modeling. 231-235.
16. KAHLESZ, F., GABRIEL, Z., AND REINHARD, K. 2004. Visual-Fidelity DataGlove calibration. In Proceedings of the Computer Graphics International, IEEE Computer Society Press. 403-410.
17. KESSLER, G. D., HODGES, L. F., AND WALKER, N. 1995. Evaluation of the CyberGlove as a whole hand input device. ACM Trans. Comput.-Hum. Interact. 2, 4, 263-283.
18. KIM, J. S., JANG, W., AND BIEN, Z. 1996. A dynamic gesture recognition system for the Korean sign language (KSL), IEEE Trans. Syst. Man. Cybern. B, 26, 354-359.
19. KRAMER, J. 1991. Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove. U.S. patent 5,047,952. U.S. Patent Office, Washington, DC.
20. LEE, C.-S., BIEN, Z., PARK, G. T., JANG, W., KIM, J. S., AND KIM, S. K. 1997. Real-Time recognition system of Korean sign language based on elementary components. In Proceedings of the 6th IEEE International Conference on Fuzzy Systems. 1463-1468.
21. LEE, Y. H. AND TSAI, C. Y. 2007. Taiwan sign language (TSL) recognition based on 3D data and neural networks. Exp. Syst. Appl. 36, 2, 1123-1128.
22. LIANG, R. H. AND OUHYOUNG, M. 1998. A real-time continuous gesture recognition system for sign language. In Proceedings of the 3rd International Conference on Face & Gesture Recognition. IEEE Computer Society, Los Alamitos, CA, 558-565.
23. LU, P. 2010. Modeling animations of American sign language verbs through motion-capture of native ASL signers. SIGACCESS Accessibility Comput. 96, 41-45.
24. LU, P. AND HUENERFAUTH, M. 2009. Accessible motion-capture glove calibration protocol for recording sign language data from deaf subjects. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS'09). ACM, New York, 83-90.
25. LU, P. AND HUENERFAUTH, M. 2010. Collecting a motion-capture corpus of American sign language for data-driven generation research. In Proceedings of the 1st Workshop on Speech and Language Processing for Assistive Technologies (SLPAT), Human Language Technologies: In the 11th Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL'10), Association for Computational Linguistics, East Stroudsburg, PA.
26. MEIER, R. 1990. Person deixis in American sign language. In S. Fischer, P. Siple Eds., Theoretical Issues in Sign Language Research, Vol.1: Linguistics. University of Chicago Press, Chicago, 175-190.
27. MENON, A. S., BAMES, B.,MILLS, R., BRUYNS, C. D., TWOMBLY, A., SMITH, J.,MONTGOMERY, K., AND BOYLE, R. 2003. Using registration, calibration, and robotics to build a more accurate virtual reality simulation for astronaut training and telemedicine. In Proceedings of the 11th International Conference in Central Europe on Computer Graphics, Visualization, and Computer (WSCG'03).
28. MICERA, S., CAVALLARO, E., BELLI, R., ZACCONE, F., GUGLIELMELLI, E., DARIO, P., COLLARINI, D., MARTINELLI, B., SANTIN, C., AND MARCOVICH, R. 2003. Functional assessment of hand orthopedic disorders using a sensorised glove: Preliminary results. In Proceedings of the IEEE International Conference on Robotics and Automation. 2212-2217.
29. MITCHELL, R., YOUNG, T., BACHLEDA, B., AND KARCHMER, M. 2006. How many people use ASL in the United States? Why estimates need updating. Sign Lang. Stud. 6, 3, 306-335.
30. PADDEN, C. 1988. Interaction of morphology & syntax in American sign language. In Outstanding Dissertations in Linguistics, Series IV. Garland Press, New York.
31. TOLBA, A. S. AND ABU-REZQ, A. N. 1998. Arabic glove talk (AGT): A communication aid for vocally impaired. Patt. Anal. Appl. 1, 4, 218-230.
32. TRAXLER, C. B. 2000. The Stanford achievement test, 9th edition: National norming and performance standards for deaf and hard-of-hearing students. J. Stud. Deaf Educ. 5, 4, 337-348.
33. VAMPLEW, P. AND ADAMS, A. 1998. Recognition of sign language gestures using neural networks. Austral. J. Intell. Inform. Process. Syst. 5, 2, 94-102.
34. VIRTUAL TECHNOLOGIES. 1992. CyberGlove User's Manual Virtual Technologies. CA.
35. VOGLER, C. AND METAXAS, D. 2004. Handshapes and movements: Multiple-channel ASL recognition. In J. Carbonell, J. Siekmann Eds., Gesture-Based Communication in Human-Computer Interaction. Lecture Notes in Artificial Intelligence, vol.2915, Springer, 247-258.
36. WANG, C. L., GAO, W., AND SHAN, S. G. 2002. An approach based on phonemes to large vocabulary Chinese sign language recognition. In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 411-416.
37. WILLIAMS, N. W., PENROSE, J. M. T., CADDY, C. M., BAMES, E., HOSE, D. R., AND HARLEY, P. 2000. A goniometric glove for clinical hand assessment. J. Hand. Surg. 1, 25, 2, 200-207.