American sign language (ASL) recognition based on Hough transform and neural networks

Expert Systems with Applications

Volumn 32, Issue 1, 2007, Pages 24-37

  Munib, Qutaishat ^a   Habeeb, Moussa ^a   Takruri, Bayan ^a   Al Malik, Hiba Abed ^a  

^a UNIVERSITY OF JORDAN   (Jordan)

Author keywords

American sign language; Canny edge detection; Feature extraction; Hough transform; Neural network; Sobel edge detection

Indexed keywords

DATABASE SYSTEMS; EDGE DETECTION; FEATURE EXTRACTION; HOUGH TRANSFORMS; IMAGE PROCESSING; NEURAL NETWORKS; TRANSLATION (LANGUAGES); VECTOR QUANTIZATION;

AMERICAN SIGN LANGUAGE (ASL); AUTOMATIC TRANSLATION; CANNY EDGE DETECTION; SOBEL EDGE DETECTION;

GESTURE RECOGNITION;

EID: 33748128359     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2005.11.018     Document Type: Article

References (57)

1. Aha D.W., Dennis K., and Marc A. Instance-based learning algorithms. Machine Learning 6 (1991) 37-66
2. Banarse, D. S. (1993). Hand posture recognition with the neocognitron network. Master's thesis, School of Electronic Engineering and Computer Systems, University College of North Wales, Bangor.
3. Birk, H., Moeslund, T. B., & Madsen, C. B. (1997). Real-time recognition of hand alphabet gestures using principal component analysis. In Proceedings of the 10th Scandinavian conference on image analysis.
4. Bowden R., and Sarhadi M. A non-linear model of shape and motion for tracking finger spelt American sign language. Image and Vision Computing IVC(20) 9-10 (2002) 597-607
5. Brand, M., & Irfan, E. (1995). Causal analysis for visual gesture understanding, MIT Media Laboratory Perceptual Computing Section Technical Report No. 327.
6. Canny J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8 6 (1986) 1986 November
7. Charayaphan C., and Marble A. Image processing system for interpreting motion in American sign language. Journal of Biomedical Engineering 14 (1992) 419-425
8. Charniak E. Statistical language learning (1993), MIT Press, Cambridge
9. Cutler, R., & Turk, M. (1998). View-based interpretation of real-time optical flow for gesture recognition. IEEE International Conference on Automatic Face and Gesture Recognition.
10. Darrell, T., & Pentland, A. (1993). Recognition of space-time gestures using a distributed representation. MIT Media Laboratory Vision and Modeling Group Technical Report No. 197.
11. Davis J., & Shah M. (1993). Gesture recognition, Technical Report, Department of Computer Science, University of Central Florida, CS-TR-93-11.
12. Dorner B., and Hagen E. Towards an American sign language interface. Artificial Intelligence Review 8 2-3 (1994) 235-253
13. Duda R.O., and Hart P.E. Use of the Hough transformation to detect lines and curves in pictures. Communications of the ACM 15 (1972) 11-15
14. Fels, S. (1994). Glove-TalkII: mapping hand gestures to speech using neural networks-an approach to building adaptive interfaces. PhD thesis, Computer Science Department, University of Toronto.
15. Fels S., and Hinton G. GloveTalk: a neural network interface between a DataGlove and a speech synthesizer. IEEE Transactions on Neural Networks 4 (1993) 2-8
16. Fukushima K. Analysis of the process of visual pattern recognition by the neocognitron. Neural Networks 2 (1989) 413-420
17. Gonzalez R.C., Woods R.E., and Eddins S.L. Digital image processing using MATLAB (2004), Prentice Hall
18. Grimes, G. (1983). Digital data entry glove interface device, Patent 4,414,537, AT & T Bell Labs.
19. Grobel, K., & Assan, M. (1996). Isolated sign language recognition using hidden Markov models. In Proceedings of the international conference of system, man and cybernetics, pp. 162-167.
20. Hand, C., Sexton, I., & Mullan, M. (1994). A linguistic approach to the recognition of hand gestures. In Proceedings of the designing future interaction conference, University of Warwick, UK.
21. Haykin S. Neural networks: a comprehensive foundation (1999), Prentice Hall
22. Heap, A. J., & Samaria, F. (1995). Real-time hand tracking and gesture recognition using smart snakes. In Proceedings of interface to real and virtual worlds, Montpellier.
23. Hong, P. et al. (2000). Gesture modeling and recognition using finite state machines. IEEE international conference on automatic face and gesture recognition, pp. 410-415.
24. Hough, P. (1962). Method and means for recognizing complex patterns, US Patent (3,069,654).
25. Imagawa, K., Matsuo, H., Taniguchi, R., Arita, D., & Igi, S. (2000). Recognition of local features for camera-based sign language recognition system. In International conference on pattern recognition (ICPR), pp. 4849-4853.
26. International Bibliography of Sign Language, (2005). http://www.sign-lang.uni-hamburg.de/bibweb/F-Journals.html.
27. International Journal of Language & Communication Disorders, (2005). Available from http://www.newcastle.edu.au/renwick/ROL/Jnlcontents/000mgmgf.htm.
28. Kadous, W. (1995). GRASP: recognition of Australian sign language using instrumented gloves. Bachelor's thesis, University of New South Wales.
29. Kadous, W. (1996). Machine recognition of Auslan signs using PowerGlove: towards large-lexicon recognition of sign language. In Proceeding of the workshop on the integration of gesture in language and speech, Wilmington, DE, pp. 165-174.
30. Kramer, J., & Leifer, L. (1990). A "Talking Glove" for nonverbal deaf individuals. Technical Report CDR TR 1990 0312, Centre For Design Research, Stanford University.
31. Liang, R. H., & Ouhyoung, M. (1998). A real-time continuous gesture recognition system for sign language. In Proceeding of the third international conference on automatic face and gesture recognition, Nara, Japan, pp. 558-565.
32. Martin, J., & James L. C. (1997). An appearance-based approach to gesture recognition. In Proceedings of the ninth international conference on image analysis and processing, pp. 340-347.
33. Murakami, K., & Taguchi, H. (1991). Gesture recognition using recurrent neural networks. In Proceedings of CHI'91 human factors in computing systems, pp. 237-242.
34. Nam Y., and Wohn K.Y. Recognition of space-time hand-gestures using hidden Markov model. Proceedings of the ACM symposium on virtual reality software and technology'96 (1996), ACM Press 51-58
35. National Institute on Deafness and Other Communication Disorders, (2005). Available from: http://www.nidcd.nih.gov/health/hearing/asl.asp.
36. Newby, G. (1993). Gesture recognition using statistical similarity. In Proceedings of virtual reality and persons with disabilities.
37. Ong S., and Ranganath S. Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 6 (2005)
38. PDF Reference, (2004). Addison-Wesley, 5th ed.
39. Quek F. Toward a vision-based gesture interface. Proceedings of the ACM symposium on virtual reality software and technology'94 (1994), ACM Press 17-31
40. Rangarajan K., and Shah M. Establishing motion correspondence. CVGIP: Image Understanding 54 (1991) 56-73
41. Rubine D. Specifying gestures by example. Proceedings of SIGGRAPH'91 (1991), ACM Press 329-337
42. Rung-Huei L., and Ouhyoung M. A sign language recognition system using hidden Markov model and context sensitive search. Proceedings of the ACM symposium on virtual reality software and technology'96 (1996), ACM Press 59-66
43. Seymore, K., McCallum, A., & Rosenfeld, R. (1999). Learning hidden Markov model structure for information extraction. AAAI 99 workshop on machine learning for information extraction.
44. Starner, T. (1995). Visual recognition of American sign language using hidden Markov models. Master's thesis, Massachusetts Institute of Technology.
45. Starner, T., & Pentland, A. (1995). Visual recognition of American sign language using hidden Markov models. International Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland, pp. 189-194.
46. Sturman, D. (1992). Whole-hand Input. Ph.D dissertation, Massachusetts Institute of Technology.
47. Sturman D., and Zeltzer D. A Survey of glove-based Input. IEEE Computer Graphics and Applications 14 1 (1994) 30-39
48. Symeonidis, K. (2000). Hand gesture recognition using neural networks. Master's thesis, University of Surrey.
49. Takahashi T., and Kishino F. Hand gesture coding based on experiments using a hand gesture interface device. SIGCHI Bulletin 23 2 (1991) 67-73
50. Vamplew, P. (1996). Recognition of sign language using neural networks. PhD Thesis, Department of Computer Science, University of Tasmania.
51. Vogler, C., & Metaxas, D. (1997). Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods. In Proceedings of the IEEE international conference on systems, man and cybernetics, Orlando, pp. 156-161.
52. Watson, R. (1993). A survey of gesture recognition techniques. Technical Report TCD-CS-93-11, Department of Computer Science, Trinity College Dublin.
53. Wexelblat, A. (1994). A feature-based approach to continuous-gesture analysis. Master's thesis, Massachusetts Institute of Technology.
54. Wexelblat A. An approach to natural gesture in virtual environments. ACM Transactions on Computer-Human Interaction 2 3 (1995) 179-200
55. Yang, M., & Ahuja, N. (1999). Recognizing hand gestures using motion trajectories. In IEEE international conference on computer vision and pattern recognition (CVPR), pp. 466-472.
56. Yoshinori, K., Tomoyuki I., Kang-Hyun, J., Nobutaka, S., & Yoshiaki, S. (1998). Vision-based human interface system: selectively recognizing intentional hand gestures. In Proceedings of the IASTED international conference on computer graphics and imaging, pp. 219-223.
57. Zimmerman T., Lanier J., Blanchard C., Bryson S., and Harvill Y. A hand gesture interface device. Proceedings of CHI + GI'87 human factors in computing systems and graphics interface (1987), ACM Press 189-192