Toward communicating simple sentences using pictorial representations

Machine Translation

Volumn 22, Issue 3, 2008, Pages 153-173

  Mihalcea, Rada ^a   Leong, Chee Wee ^a  

^a UNIVERSITY OF NORTH TEXAS   (United States)

Author keywords

Augmentative and alternative communication; Illustrated dictionaries; Text to picture synthesis

Indexed keywords

AUGMENTATIVE AND ALTERNATIVE COMMUNICATION; AUTOMATIC CONSTRUCTION; AUTOMATIC MACHINES; COMPARATIVE EVALUATIONS; ILLUSTRATED DICTIONARIES; LANGUAGE BARRIERS; LINGUISTIC REPRESENTATIONS; ONLINE ACTIVITIES; PICTORIAL REPRESENTATION; TEXT-TO-PICTURE SYNTHESIS;

COMPUTER AIDED LANGUAGE TRANSLATION; HUMAN REHABILITATION ENGINEERING; INFORMATION THEORY; LINGUISTICS; SPEECH TRANSMISSION;

QUALITY CONTROL;

EID: 67349176341     PISSN: 09226567     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10590-009-9050-0     Document Type: Article

References (39)

1. Alm N, Iwabuchi M, Andreasen P, Nakamura K (2002) A multi-lingual augmentative communication system. In: Univeral access: theoretical perspectives, practice and experience, LNCS 2615. Springer, Berlin, pp 398-408 (Pubitemid 36316990)
2. Barnard K, Forsyth DA (2001) Learning the semantics of words and pictures. In: Proceedings of the IEEE international conference on computer vision. Vancouver, BC, Canada, pp 408-415
3. Barnard K, Johnson M, Forsyth D (2003) Word sense disambiguation with pictures. In: Proceedings of the HLT-NAACL 2003 Workshop on Learning Word Meaning from Non-Linguistic Data. Edmonton, AL, Canada, pp 13-30
4. Behrmann M, Byng S (1992) Cognitive neuropsychology in clinical practice. Oxford University Press, Oxford, UK
5. K Bloomberg G Karlan L Lloyd 1990 The comparative translucency of initial lexical items represented in five graphic symbol systems and sets J Speech Hear Res 33 4 717 725
6. Boshernitsan M, Downes M (1997) Visual programming languages: a survey. Technical report, U.C. Berkeley, Berkeley, CA
7. Brill E (1992) A simple rule-based part of speech tagger. In: Proceedings of the 3rd conference on applied natural language processing. Trento, Italy, pp 152-155
8. R Carney J Levin 2002 Pictorial illustration still improve students' learning from text Educ Psychol Rev 14 1 5 26 (Pubitemid 37134415)
9. Carpuat M, Ngai G, Fung P, Church K (2002) Creating a bilingual ontology: a corpus-based approach for aligning WordNet and HowNet. In: Proceedings of the 19th international conference on computational linguistics. Taipei, Taiwan, pp 284-292
10. Chang S, Costagliola G, Orefice S, Polese G, Baker B (1992) A methodology and interactive environment for iconic language design with applications to augmentative communication. In: Proceedings of the IEEE workshop on visual languages. Seattle, WA, pp 110-116
11. S Clay J Wilhelms 1996 Put: Language-based interactive manipulation of objects IEEE Comput Graph Appl 16 2 31 39 (Pubitemid 126619518)
12. M Coltheart 1981 The MRC psycholinguistic database Q J Exp Psychol 33 4 497 505
13. Coyne B, Sproat R (2001) Wordseye: an automatic text-to-scene conversion system. In: Proceedings of the ACM conference on computer graphics and interactive techniques. Los Angeles, CA, pp 487-496
14. Doddington G (2002) Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In: Proceedings of human language technology HLT-2002. San Diego, CA, pp 138-145
15. Evans D, Bowick L, Johnson M, Blenkhorn P (2006) Using iconicity to evaluate symbol use. In: Proceedings of the 10th international conference on computers helping people. Linz, Austria, pp 874-881 (Pubitemid 44365184)
16. WW Gibbs 2002 Saving dying languages Sci Am 287 2 79 86
17. AM Glenberg T Gutierrez JR Levin S Japuntich MP Kaschak 2004 Activity and imagined activity can enhance young children's reading comprehension J Educ Psychol 96 3 424 436 (Pubitemid 39216562)
18. E Hanson A Hartzema 1995 Evaluating pictograms as an aid for counselling elderly and low-literate patients J Pharm Mark Manage 9 3 41 54
19. L Haupt E Alant 2003 The iconicity of picture communication symbols for rural Zulu children S Afr J Commun Disord 49 40 49
20. M Huer 2000 Examining perceptions of graphic symbols across cultures: preliminary study of the impact of culture/ethnicity Augment Altern Commun 16 3 180 185
21. Johansson R, Berglund A, Danielsson M, Nugues P (2005) Automatic text-to-scene conversion in the traffic accident domain. In: Proceedings of the nineteenth international joint conference on artificial intelligence. Edinburgh, UK, pp 1073-1078
22. A Komlodi W Hou J Preece A Druin E Golub J Alburo S Liao A Elkiss P Resnik 2005 Evaluating a cross-cultural children's online book community: lessons learned for sociability, usability, and cultural exchange Interact Comput 19 4 494 511
23. Medhi I, Sagar A, Toyama K (2006) Text free user interfaces for illiterate and semi-literate users. In: International conference on information and communication technologies and development. Berkeley, CA, pp 72-82
24. Mihalcea R, Csomai A (2005) Senselearner: word sense disambiguation for all words in unrestricted text. In: 43rd annual meeting of the association for computational linguistics. Ann Arbor, MI, pp 53-56
25. Mihalcea R, Corley C, Strapparava C (2006) Corpus-based and knowledge-based approaches to text semantic similarity. In: Proceedings of the 21st national conference on artificial intelligence (AA AI-06). Boston, MA, pp 775-780
26. G Miller 1995 Wordnet: a lexical database Commun ACM 38 11 39 41
27. M Mizuko 1987 Transparency and ease of learning of symbols represented by blissymbols, pcs and picsyms Augment Altern Commun 3 3 129 136
28. C Musselwhite D Ruscello 1984 Transparency of three communication symbol systems J Speech Hear Res 27 3 436 443 (Pubitemid 14030812)
29. K Nakamura A Newell N Alm A Waller 1998 How do members of different language communities compose sentences with a picture-based communication system? A cross-cultural study of picture-based sentences constructed by English and Japanese speakers Augment Altern Commun 14 2 71 79
30. R Nigam 2003 Do individuals from diverse cultural and ethnic backgrounds perceive graphic symbols differently? Augment Altern Commun 19 2 135 136
31. Pan JY, Yang HJ, Faloutsos C, Duygulu P (2004) Gcap: graph-based automatic image captioning. In: Proceedings of the 4th international workshop on multimedia data and document engineering. Washington, DC, pp 146-155
32. Papineni K, Roukos S, Ward T, Zhu W (2002) Bleu: a method for automatic evaluation of machine translation. In: 40th annual meeting of the association for computational linguistics. Philadelphia, PA, pp 311-318
33. MC Potter JF Kroll B Yachzel E Carpenter J Sherman 1986 Pictures in sentences: understanding without words J Exp Psychol 115 3 281 294
34. Tufis D, Cristea D (2002) Methodological issues in building the Romanian WordNet and consistency checks in Balkanet. In: Proceedings of the LREC workshop on Wordnet structures and standardisation. Las Palmas, Canary Islands, Spain, pp 35-41
35. Turian J, Shen L, Melamed ID (2003) Evaluation of machine translation and its evaluation. In: MT Summit IX: Proceedings of the ninth machine translation summit. New Orleans, LA, pp 386-393
36. von Ahn L, Dabbish L (2004) Labeling images with a computer game. In: Proceedings of the conference on human factors in computing systems. Vienna, Austria, pp 319-326
37. Vossen P (1998) EuroWordNet: a multilingual database with lexical semantic networks. Kluwer Academic Publishers, Dordrecht, The Netherlands
38. Yamada A, Yamamoto T, Ikeda H, Nishida T, Doshita S (1992) Reconstructing spatial image from natural language texts. In: Proceedings of the fifteenth [sic] international conference on computational linguistics. Nantes, France, pp 1279-1283
39. Zhu X, Goldberg AB, Eldawy M, Dyer CR, Strock B (2007) A text-to-picture synthesis system for augmenting communication. In: Proceedings of the 22nd AAAI conference on artificial intelligence. Vancouver, BC, Canada, pp 1590-1595 (Pubitemid 350149792)