A web-based sign language translator using 3D video processing

Proceedings - 2011 International Conference on Network-Based Information Systems, NBiS 2011

Volumn , Issue , 2011, Pages 356-361

  Li, Kin Fun ^a   Lothrop, Kylee ^a   Gill, Ethan ^a   Lau, Stephen ^a  

^a UNIVERSITY OF VICTORIA   (Canada)

Author keywords

3D point pattern matching; American sign language; Gesture recognition; Motion capture

Indexed keywords

3D DATA; 3D VIDEO; AMERICAN SIGN LANGUAGE; ASSISTIVE TOOL; GESTURE INPUT DEVICES; HEARING IMPAIRED; INPUT DEVICES; MOTION CAPTURE; POINT PATTERN MATCHING; POTENTIAL APPLICATIONS; PROOF OF CONCEPT; SIGN LANGUAGE; TEACHING TOOLS; WEB-BASED APPLICATIONS;

AUDITION; GESTURE RECOGNITION; HANDICAPPED PERSONS; INFORMATION SYSTEMS; KNOBS; PATTERN MATCHING; THREE DIMENSIONAL; USER INTERFACES; VIDEO SIGNAL PROCESSING;

TRANSLATION (LANGUAGES);

EID: 80455134730     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NBiS.2011.60     Document Type: Conference Paper

References (25)

1. Canadian Association of the Deaf, "Statistics on Deaf Canadians," available at www.cad.ca/en/issues/statistics-on-deaf-canadians. asp,May 23, 2011.
2. Discovering Deaf Worlds, vol. 4, issue 2, available at www.discoveringdeafworlds.org/documents/ddwdec2010.pdf, May 23, 2011.
3. Hear-it AISBL, "More and More Hearing Impaired People," available at www.hear-it.org/page.dsp?area=134, May 23, 2011.
4. R.E. Mitchell, T.A. Young, B. Bachleda, and M.A. Karchmer, "How Many People Use ASL in the United States?" Sign Language Studies, vol. 6, no. 3, 2006.
5. S. Hay, J. Newman, and R. Harle, "Optical Tracking Using Commodity Hardware", IEEE International Symposium on Mixed and Augmented Reality, 2008, pp. 159-160.
6. M. Hoffman, P. Varcholik, and J.J. LaViola Jr., "Breaking the Status Quo: Improving 3D Gesture Recognition with Spatially Convenient Input Devices", IEEE Virtual Reality Conference, 2010, pp. 59-66.
7. Y. Wang, T. Yu, L. Shi, and L. Zhu, "Using Human Body Gestures as Inputs for Gaming via Depth Analysis", IEEE International Conference on Multimedia and Expo, 2008, pp. 993-996
8. Sony PlayStation, available at www.playstation.com, May 23, 2011.
9. Microsoft XBOX, available at www.xbox.com, May 23, 2011.
10. Nintendo Wii, available at wii.com, May 23, 2011.
11. T. Ni, R.P. McMahan, and D.A. Bowman, "Tech-note: rapMenu: Remote Menu Selection Using Freehand Gestural Input," IEEE Symposium on 3D User Interfaces, 2008, pp. 55-58.
12. T. Ishikawa, Y. Horry, and T. Hoshino, "Touchless Input Device and Gesture Commands," International Conference on Consumer Electronics, 2005, pp. 205-206. (Pubitemid 41688077)
13. M. Maebatake, I. Suzuki, M. Nishida, Y. Horiuchi, and S. Kuroiwa, "Sign Language Recognition Based on Position and Movement Using Multi-Stream HMM," Second International Symposium on Universal Communication, 2008, pp. 478-481.
14. Z. Huang, D. Jiang, and W. Zhao, "Study of Sign Language Recognition Based on Gabor Wavelet Transforms," International Conference On Computer Design And Applications, 2010, pp. V1-151-V1-154.
15. G. Fang, W. Gao, D. Zhao, "Large Vocabulary Sign Language Recognition based on Fuzzy Decision Trees," IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 34, issue 3, 2004, pp. 305-314.
16. G. Fang, W. Gao, D. Zhao, "Large Vocabulary Continuous Sign Language Recognition based on Transition-Movement Models," IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 37, issue 1, 2007, pp. 1-9. (Pubitemid 46002473)
17. Microsoft XBOX, "Introducing Kinect for XBOX 360," available at www.xbox.com/en-US/kinect, May 23, 2011.
18. PrimeSense, "The PrimeSensor Technology," available www.primesense.com/?p=486, May 23, 2011.
19. OpenNI, "OpenNI Framework," available at www.oppenni.org, May 23, 2011.
20. A. Antoniou and W.-S. Lu. Practical Optimization: Algorithms and Engineering Applications, Springer, 2007, pp.232-238.
21. W.-S. Lu, "Three-Dimensional (3D) Point Pattern Matching Algorithms," personal communication, March 17, 2011.
22. Evolce AG, "Control Windows 7 with KINECT," available at www.evoluce.com/en/3d0sensing/controlling-windows7-with-kinect.php, May 23, 2011.
23. H. Wassner, ESIEA, "Kinect + Reseau de Neurone = Reconnaissance de Gestes," available at professeurs.esiea.fr/wassner, May 23, 2011.
24. Z. Zafrulla, H. Brashear, P. Presti, H. Hamilton, and T. Starner, "CopyCat: An American Sign Language Game for Deaf Children," IEEE International Conference on Automatic Face and Gesture Recognition, 2011, pp. 647.
25. United States Patent and Trademark Office, #391145, available at appft.uspto.gov, May 23, 2011.