Text generation from Taiwanese sign language using a PST-based language model for augmentative communication

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 12, Issue 4, 2004, Pages 441-454

  Wu, Chung Hsien ^a,b,c,d   Chiu, Yu Hsien ^a,e,f   Guo, Chi Shiang ^a,g  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d ROCLING   (Taiwan)

^e I SHOU UNIVERSITY   (Taiwan)

^f ROCLING ^*

^g NATIONAL CENTRAL UNIVERSITY   (Taiwan)

Author keywords

Hearing aids; Natural language; Sign language; Text processing

Indexed keywords

DEAF STUDENTS; ICONS; TAIWANESE SIGN LANGUAGE (TSL); VIRTUAL KEYBOARD;

DATABASE SYSTEMS; INTERFACES (COMPUTER); PERSONNEL TRAINING; PROBLEM SOLVING; STATISTICAL METHODS; STUDENTS;

AUDITION;

ACCURACY; ADOLESCENT; APTITUDE TEST; ARTICLE; CHINESE; COMMUNICATION AID; COMPREHENSION; COMPUTER INTERFACE; COMPUTER MODEL; CONTROLLED STUDY; EVALUATION; FEMALE; HEARING IMPAIRMENT; HUMAN; INTERPERSONAL COMMUNICATION; LINGUISTICS; MALE; PREDICTION; PRIORITY JOURNAL; READING; SCHOOL; SCHOOL CHILD; SIGN LANGUAGE; STATISTICS; STUDENT; TRAINING; WRITING;

ADOLESCENT; ALGORITHMS; CHILD; COMMUNICATION AIDS FOR DISABLED; COMPUTER-ASSISTED INSTRUCTION; DEAFNESS; DISABLED CHILDREN; HUMANS; INFORMATION STORAGE AND RETRIEVAL; MODELS, THEORETICAL; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; SIGN LANGUAGE; TAIWAN; TEACHING; TREATMENT OUTCOME; USER-COMPUTER INTERFACE; WORD PROCESSING;

EID: 10244279130     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2003.819930     Document Type: Article

References (25)

1. A. M. Cook and S. M. Hussey, Assistive Technologies: Principles and Practice. St. Louis, MO: Mosby-Year Book, 1995.
2. J. Reichle, Implementing Augmentative and Alternative Communication: Strategies for Learners with Severe Disabilities. Baltimore, MD: Paul H. Bookes, 1992.
3. M. D. Manoranjan and J. A. Robinson, "Practical low-cost visual communication using binary images for deaf sign language," IEEE Trans. Rehab. Eng., vol. 8, pp. 81-88, Mar. 2000.
4. M. H. Hsing, "An analysis on deaf-school teachers' utterance messages and morpheme semantic features between spoken and signed language channels," Bull. Special Educat. Rehab., vol. 8, pp. 27-52, June 2000.
5. P. Demasco and K. F. McCoy, "Generating text from compressed input: An intelligent interface for people with severe motor impairments," in Commun. ACM, vol. 35, 1992, pp. 68-78.
6. R. C. Simpson and H. H. Koester, "Adaptive one-switch row-column scanning," IEEE Trans. Rehab. Eng., vol. 7, pp. 464-473, Dec. 1999.
7. H. H. Koester and S. P. Levine, "Modeling the speed of text entry with a word prediction interface," IEEE Trans. Rehab, Eng., vol. 2, pp. 177-187, Sept. 1994.
8. A. L. Swiffin, J. L. Arnott, and A. F. Newell, "Adaptive and predictive techniques in a communication prosthesis," Augment. Altern. Commun., vol. 3, no. 4, pp. 181-191, 1987.
9. C. Morris, A. Newell, L. Booth, and J. Arnott, "Syntax pal - A system to improve the syntax of those with language dysfunction," in Proc. 14th Annu. RESNA Conf.. Washington, DC, 1991, pp. 105-106.
10. C. Sara and S. Yechayahu, "Semantic transparency and translucency in compound blissymbols," Augment. Altern. Commun., vol. 14, pp. 171-183, 1998.
11. S. K. Chang et al., "A methodology for iconic language design with application to augmentative communication," in Proc. IEEE Workshop on Visual Language, 1992, pp. 110-116.
12. Y. C. Wang and T. J. Chou, "A comparative study of reading comprehension strategies used by elementary reading disabled and proficient reading students," Bull. Special Educat. Rehab., vol. 8, pp. 161-182, June 2000.
13. T. Wilson and M. Hyde, "The use of signed English pictures to facilitate reading comprehension by deaf students," Amer. Ann. Deaf, vol. 142, pp. 333-341, 1997.
14. C. D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press, 1999.
15. M. Siu and M. Ostendorf, "Variable n-grams and extensions for conversational speech language modeling," IEEE Trans. Speech Audio Processing, vol. 8, pp. 63-75, Jan. 2000.
16. T. Niesler and P. Woodland, "Variable-length category n-gram language models," Comp. Speech Lang., vol. 21, pp. 1-26, 1999.
17. J. S. Hamaker, "Toward building a better language model for switchboard: The POS tagging task," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, 1999, pp. 579-582.
18. The Chinese Knowledge Information Processing Group, "Analysis of Chinese part of speech," (in Chinese), Institute of Information Science, Academic Sinica, Taipei, CKIP Tech. Rep. 93-05, 1993.
19. D. Zhendong, The HowNet Website, http://www.how-net.com/.
20. Q. Zhou and S. Feng, "Build a relation network representation for hownet," in Proc. Int. Conf, Multilingual information Processing, 2000, pp. 139-145.
21. R. Rosenfeld, "Adaptive statistical language modeling: A maximum entropy approach," Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, 1994.
22. I. S. MacKenzie and W. Buxton, "A tools for the rapid evaluation of input devices using Fitts' law models," SIGCHI Bull, vol. 25, no. 3, pp. 58-63, 1993.
23. J. G. Webster, A. M. Cook, W. J. Tompkins, and G. C. Vanderheiden, Electronic Devices for Rehabilitation. New York: Wiley, 1985.
24. G. C. Vanderheiden, "Computer can play a dual role for disabled individuals," BYTE, vol. 7, no. 9, pp. 136-62, 1982.
25. S. Oviatt, "Predicting spoken disfluencies during human-computer interaction," Comput. Speech Lang., vol. 9, pp. 19-35, 1995.