Real-time american sign language recognition using desk and wearable computer based video

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 20, Issue 12, 1998, Pages 1371-1375

  Starner, Thad ^a   Weaver, Joshua ^a   Pentland, Alex ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Gesture recognition; Hidden markov models; Motion and pattern analysis; Sign language; Wearable computers

Indexed keywords

CAMERAS; IMAGE ANALYSIS; IMAGE UNDERSTANDING; MARKOV PROCESSES; MATHEMATICAL MODELS; MOBILE COMPUTING; REAL TIME SYSTEMS;

HIDDEN MARKOV MODELS; REAL-TIME AMERICAN SIGN LANGUAGE RECOGNITIONS; WEARABLE COMPUTER BASED VIDEO;

PATTERN RECOGNITION;

EID: 0032304547     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.735811     Document Type: Article

References (23)

1. L. Baum, "An Inequality and Associated Maximization Technique in Statistical Estimation of Probabilistic Functions of Markov Processes," Inequalities, vol. 3, pp. 1-8,1972.
2. L. Campbell, D. Decker, A. Azarbayejani, A. Bobick, and A. Pentland, "Invariant Features for 3D Gesture Recognition," Second Int'l Conf. Face and Gesture Recognition, pp. 157-162,1996.
3. B. Dorner, "Hand Shape Identification and Tracking for Sign Language Interpretation," IJCAI Workshop on Looking at People, 1993.
4. I. Essa, T. Darrell, and A. Pentland, "Tracking Facial Motion," Proc. Workshop on Motion of Non-Rigid and Articulated Objects, Austin, Tex., Nov. 1994.
5. B. Horn, Robot Vision. Cambridge, Mass.: MIT Press, 1986.
6. X.D. Huang, Y. Ariki, and M.A. Jack, Hidden Markov Models for Speech Recognition. Edinburgh Univ. Press, 1990.
7. T. Humphries, C. Padden, and T. O'Rourke, A Basic Course in American Sign Language. Silver Spring, Md.: T. J. Publ., Inc., 1990.
8. R. Liang and M. Ouhyoung, "A Real-Time Continuous Gesture Interface for Taiwanese Sign Language," Submitted to UIST, 1997.
9. R. Picard, "Toward Agents That Recognize Emotion," Imagina98, 1998.
10. H. Poizner, U. Bellugi, and V. Lutes-Driscoll, "Perception of American Sign Language in Dynamic Point-Light Displays," J. Exp. Pyschol.: Human Perform., vol. 7, pp. 430-440,1981.
11. L.R. Rabiner and B.H. Juang, "An Introduction to Hidden Markov Models," IEEE ASSP Magazine, pp. 4-16, Jan. 1986.
12. J. M. Rehg and T. Kanade, "DigitEyes: Vision-Based Human Hand Tracking," School of Computer Science Technical Report CMUCS-93-220, Carnegie Mellon Univ., Dec. 1993.
13. J. Schlenzig, E. Hunter, and R. Jain, "Recursive Identification of Gesture Inputs Using Hidden Markov Models," Proc. Second Ann. Conf. Applications of Computer Vision, pp. 187-194, Dec. 1994.
14. G. Sperling, M. Landy, Y. Cohen, and M. Pavel, "Intelligible Encoding of ASL Image Sequences at Extremely Low Information Rates," Comp. Vision, Graphics, and Image Processing, vol. 31, pp. 335391,1985.
15. T. Starner, "Visual Recognition of American Sign Language Using Hidden Markov Models," Master's thesis, MIT, Media Laboratory, Feb. 1995.
16. T. Starner, J. Makhoul, R. Schwartz, and G. Chou, "On-Line Cursive Handwriting Recognition Using Speech Recognition Methods," ICASSP, pp. 125-128,1994.
17. T. Starner, S. Mann, B. Rhodes, J. Levine, J. Healey, D. Kirsch, R. Picard, and A. Pentland, "Augmented Reality Through Wearable Computing," Presence, vol. 6, no. 4, pp. 386-398,1997.
18. T. Starner and A. Pentland, "Real-Time American Sign Language Recognition From Video Using Hidden Markov Models," Technical Report 375, MIT Media Lab, Perceptual Computing Group, 1995. Earlier version appeared ISCV'95.
19. T. Starner, J. Weaver, and A. Pentland, "Real-Time American Sign Language Recognition Using Desktop and Wearable Computer Based Video," Technical Report 466, Perceptual Computing, MIT Media Laboratory, July 1998.
20. C. Vogler and D. Metaxas, "ASL Recognition Based on a Coupling Between HMMs and 3D Motion Analysis," ICCV, Bombay, 1998.
21. A.D. Wilson and A.F. Bobick, "Learning Visual Behavior for Gesture Analysis," Proc. IEEE Int'l Symp. Computer Vision, Coral Gables, Fla., Nov. 1995.
22. J. Yamato, J. Ohya, and K. Ishii, "Recognizing Human Action in Time-Sequential Images Using Hidden Markov Models," Proc. Computer Vision and Pattern Recognition, pp. 379-385,1992.
23. S. Young, "HTK: Hidden Markov Model Toolkit V1.5," Cambridge Univ. Eng. Dept., Speech Group, and Entropie Research Lab., Inc., Washington D.C., 1993.