Sign language recognition and translation: A multidisciplined approach from the field of artificial intelligence

Journal of Deaf Studies and Deaf Education

Volumn 11, Issue 1, 2006, Pages 94-101

  Parton, Becky Sue ^a  

^a UNIVERSITY OF NORTH TEXAS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER; COMPUTER PROGRAM; COMPUTER SIMULATION; EDUCATION; HEARING IMPAIRMENT; HUMAN; PATIENT; PROBABILITY; REVIEW; ROBOTICS; SIGN LANGUAGE; THREE DIMENSIONAL IMAGING;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; COMPUTERS; DEAFNESS; HEARING IMPAIRED PERSONS; HUMANS; IMAGING, THREE-DIMENSIONAL; MARKOV CHAINS; NEURAL NETWORKS (COMPUTER); ROBOTICS; SIGN LANGUAGE; SOFTWARE;

EID: 31144432586     PISSN: 10814159     EISSN: 14657325     Source Type: Journal    
DOI: 10.1093/deafed/enj003     Document Type: Review

References (53)

1. Akyol, S., & Alvarado, P. (2001). Finding relevant image content for mobile sign language recognition. Retrieved June 17,2005, from http://www.techinfo.rwth-aachen.de/Veroeffentlichungen/V001_2001.pdf
2. Augustine Su Project. (n.d.). Retrieved October 1, 2002, from http://www.csdl.tamu.edu/~su/asl
3. Bowden, R., Zisserman, A., Kadir, T., & Brady, M. (2003, April). Vision based interpretation of natural sign languages. Paper presented at the Third International Conference on Computer Vision Systems, Graz, Austria.
4. Brashear, H., Starner, T., Lukowicz, P., & Junker, H. (2003, October). Using multiple sensors for mobile sign language recognition. Paper presented at the Seventh IEEE International Symposium on Wearable Computers, White Plains, NY. Retrieved June 20, 2005, from http://www.cc.gatech.edu/ccg/publications/iswc2003-sign/iswc2003-sign.pdf
5. Computer program translates spoken English into sign language. (2002, August 12). National Geographic, p. 1-5.
6. Cox, S., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., et al. (2002, July). TESSA, a system to aid communication with deaf people. Paper presented at the Fifth International ACM Conference on Assistive Technologies, Edinburgh, Scotland.
7. CyberGlove (n.d.). Retrieved September 18, 2005 from http://www.mindflux.com.au/products/uti/cyberglove.html.
8. Davidson, M. (n.d.). Usability testing of computer animation of fingerspelling for American Sign Language. Unpublished manuscript, DePaul University.
9. Fels, S., & Hinton, G. (1993). Glove-Talk: A neural network interface between a data-glove and a speech synthesizer. IEEE Transactions on Neural Networks, 4, 2-8.
10. Feris, R., Turk, M., Raskar, R., Tan, K., & Ohashi, G. (2004). Exploiting depth discontinuities for vision-based fingerspelling recognition. Paper presented at the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Washington, DC.
11. Francik, J., & Fabian, P. (2002). Animating sign language in the real time. Paper presented at the 20th IASTED Conference on Applied Informatics, Innsbruck, Austria.
12. Furst, J. (2000). Database design for American Sign Language. Paper presented at the 15th International Conference on Computers and their Applications, New Orleans, LA.
13. Gleaves, R., & Sutton, V. (2004, May). SignWriter. Paper presented at the Workshop on the Representation and Processing of Sign Languages on the occasion of the Fourth International Conference on Language Resources and Evaluation, Lisbon, Portugal.
14. Glenn, C., Mandloi, D., Sarella, K., & Lonon, M. (2005, June). An image processing technique for the translation of ASL finger-spelling to digital audio or text. Paper presented at the Instructional Technology and Education of the deaf Symposium, Rochester, NY.
15. Hanke, T. (2004, May). HamNoSys - Representing sign language data in language resources and language processing contexts. Paper presented at the Workshop on the Representation and Processing of Sign Languages on the occasion of the Fourth International Conference on Language Resources and Evaluation, Lisbon, Portugal.
16. Hernandez-Rebollar, J., Kyriakopoulos, N., & Lindeman, R. (2004). A new instrumented approach for translating American Sign Language into sound and text. Paper presented at the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea.
17. ICICLE Project. (2002). Retrieved September 15, 2002, from http://www.eecis.udel.edu/research/icicle
18. Jaffe, D. (1994). Evolution of mechanical fingerspelling hands for people who are deaf-blind [Electronic version]. Journal of Rehabilitation Research and Development, 31, 236-244.
19. Kadous, W. (1995). GRASP: Recognition of Australian Sign Language using instrumented gloves. Unpublished manuscript, University of New South Wales, Sydney, Australia. Retrieved October 1, 2002, from http://www.cse.unsw.edu.au/waleed/phd/auslrec2.html
20. Kiernan, V. (1997). Linguists hope a new computer program will advance the study of sign language. The Chronicle of Higher Education, November 7, A27.
21. Lee, S., Henderson, V., Brashear, H., Starner, T., & Hamilton, S. (2005, June). User-centered development of a gesture-based American Sign Language game. Paper presented at the Instructional Technology and Education of the Deaf Symposium, Rochester, NY.
22. Lee, C., & Xu, Y. (1996). Hidden Markov models for interactive learning of hand gestures. Unpublished manuscript. Retrieved September 15, 2002, from http://www.cs.cmu.edu/afs/cs/project/space/www/hmm/hmm/html
23. Lockton, R., & Fitzgibbon, A. (2002). Real-time gesture recognition using deterministic boosting. Paper presented at the British Machine Vision Conference. Retrieved June 20, 2005 from http://www.bmva.ac.uk/ bmvc/2002/papers/175/full_175.pdf
24. McCoy, K., & Masterman, L. (1997, July). A tutor for teaching English as a second language for deaf users of American Sign Language. Paper presented at the Natural Language Processing for Communication Aids - An ACL/EACL Workshop, Madrid, Spain.
25. Michaud, L. (2000, November). An intelligent tutoring system for deaf learners of written English. Paper presented at ASSETS, Arlington, VA.
26. Michaud, L. (2001, July). Modeling the acquisition of English: An intelligent CALL approach. Paper presented at the Eight International Conference on User Modeling, Sonthofen, Germany.
27. Michaud, L., & McCoy, K. (2002). Error profiling: Toward a model of English acquisition for deaf learners. Unpublished manuscript. Retrieved October 1, 2002, from http://www.eecis.udel.edu/research/icicle
28. Naqvi, S., Ohene-Djan, J., & Spiegel, R. (2005, June). Testing the effectiveness of digital representations of sign language content. Paper presented at the Instructional Technology and Education of the Deaf Symposium, Rochester, NY.
29. Papadogiorgaki, M., Grammalidis, N., Sarris, N., & Strintzis, M. (2004, May). Synthesis of virtual reality animations from SWML using MPEG-4 body animation parameters. Paper presented at the Workshop on the Representation and Processing of Sign Languages on the occasion of the Fourth International Conference on Langauge Resources and Evaluation, Lisbon, Portugal.
30. Paula Project. (n.d.). Retrieved September 20, 2002, from http://asl.cs.depaul.edu.
31. Ralph: A fingerspelling hand. (n.d.). Retrieved September 20, 2002, from http://guide.stanford.edu/Ttran/ttralph.html
32. Seamless Solutions. (n.d.). Retrieved October 10, 2002, from http://www.signingbooks.org
33. Sedwick, E. (2001). Towards the effective animation of American sign language. Paper presented at the 8th International Conference in Central Europe on Computer Graphics, Visualization, and Interactive Digital Media, Plzen, Czech Republic.
34. Sign Stream. (n.d.). Retrieved November 1, 2002, from http://web.bu.edu/ asllrp/signstream
35. SignWriting. (n.d.). Retrieved November 1, 2002, from http://www.signwriting.org
36. Starner, T. (1996). Real-time American Sign Language recognition using desk and wearable computer based video. Unpublished manuscript, MIT Media Library.
37. Stergiou, C., & Siganos, D. (1996). Neural networks. Surveys and Presentations in Information Systems Engineering (SURPRISE), 96. Retrieved July 1, 2005, from http://www.doc.ic.ac.uk/~nd/surprise.html
38. Stokoe, W., Casterline, D., & Croneberg, C. (1965). A dictionary of American Sign Language on linguistic principles. Washington, DC: Gallaudet College Press.
39. Su, A. (1998). VRML-based representations of ASL fingerspelling on the word wide web. Paper presented at ASSETS, Marina del Rey, CA.
40. Suszczanska, N. (2002). Translating Polish texts into sign language in the TGT system. Paper presented at the 20th IASTED Conference on Applied Informatics, Innsbruck, Australia.
41. Szmal, P., & Suszczanska, N. (2001). Selected problems of translation from the Polish written language to the sign language. Archiwum Informatyki Teoretycznej I Stosowanej, 13, 37-51.
42. Terrillon, J., Pilpre, A., Niwa, Y., & Yamamoto, K. (2002, May). Robust FACE detection and Japanese Sign Language hand posture recognition for human-computer interaction in an 'intelligent' room. Paper presented at the Fifteenth International Conference on Vision Interface, Calgary, Canada.
43. Tessa and Simon Project. (n.d.). Retrieved September 1, 2002, from http://www.visicast.co.uk
44. THETOS: Text into sign language automatic translator for Polish. (n.d.). Retrieved September 20, 2002, from http://sun.iinf.polsl.gliwice.pl/sign
45. Thomas, K. (2002, January). Glove lends the deaf a hand. USA Today. Retrieved October 10, 2002, from http://www.usatoday.com/news/science/ 2002-01-16-deafglove.htm.
46. Tomuro, N. (2000, March). An alternative method for building a database for American Sign Language. Paper presented at the Technology and Persons with Disabilities Conference, California State University, Los Angeles.
47. Toro, J. (2001). A graphical environment for transcription of American Sign Language. Paper presented at the 16th International Conference on Computers and Their Applications, Seattle, WA.
48. Vassilia, P., & Konstantinos, M. (2003). Towards an assistive tool for Greek Sign Language communication. Paper presented at the Third IEEE International Conference on Advanced Learning Technologies, Athens, Greece.
49. Vcom3D. (n.d.). Retrieved September 15, 2002, from http://www.vcom3d.com
50. Vsign Project. (n.d.). Retrieved September 20, 2002, from http://vsign.nl/EN/vsignEN.htm
51. Weissmann, J., & Salomon, R. (1999). Gesture recognition for virtual reality applications using data gloves and neural networks. Paper presented at the 1999 International Joint Conference on Neural Networks, Washington, DC.
52. Yeates, S., Holden, E., & Owens, R. (n.d.). Auslan Tuition System. Retrieved October 1, 2002, from http://www.cs.uwa.edu.au/~eunjung/ausjam/ auslantut.html
53. Zhao, L. (n.d.). A machine translation system from English to American Sign Language. Unpublished manuscript, University of Pennsylvania.