Multimodal summarization of complex sentences

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2011, Pages 43-52

  UzZaman, Naushad ^a   Bigham, Jeffrey P ^a   Allen, James F ^a  

^a University of Rochester   (United States)

Author keywords

AAC; Augmentative and alternative communication; Automatic illustration; Illustration; Multimodal summarization; Pictorial representation; Picture; ROC MMS; Sentence compression; Summarization; Text to picture; Visualization

Indexed keywords

AAC; AUGMENTATIVE-AND-ALTERNATIVE COMMUNICATION; AUTOMATIC ILLUSTRATION; ILLUSTRATION; MULTI-MODAL; PICTORIAL REPRESENTATION; PICTURE; ROC MMS; SENTENCE COMPRESSION; SUMMARIZATION; TEXT-TO-PICTURE;

HUMAN REHABILITATION ENGINEERING; VISUALIZATION;

USER INTERFACES;

EID: 79952763422     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1943403.1943412     Document Type: Conference Paper

References (27)

1. R. N. Carney and J. R. Levin, "Pictorial Illustrations Still Improve Students' Learning from Text," Educational Psychology Review, vol. 14, 2002.
2. B. Goldberg, et al., "Easy as ABC? Facilitating pictorial communication via semantically enhanced layout.," Twelfth International Conference on Computational Natural Language Learning, 2008.
3. R. Mihalcea and B. Leong, "Toward communicating simple sentences using pictorial representations," presented at the Association of Machine Translation in the Americas., 2006.
4. J. Zhu, et al., "A text-to-picture synthesis system for augmenting communication.," in The Integrated Intelligence Track of the Twenty-Second AAAI Conference on Artificial Intelligence, 2007.
5. K. Barnard, et al., "Matching words and pictures.," Machine Learning Research, vol. 3, pp. 1107-1135, 2003.
6. D. Joshi, et al., "The story picturing engine - a system for automatic text illustration.," ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 2(1), 2006.
7. Paivio, "Mental representations: A dual coding approach," New York: Oxford University Press., 1986.
8. M. Glenberg, "Component-levels theory of the effects of spacing of repetitions on recall and recognition.," Memory and Cognition, vol. 7, pp. 95-112, 1979.
9. R. G. Greene, "Spacing effects in memory: Evidence for a two-process account.," Journal of Experimental Psychology: Learning. Memory. and Cognition, vol. 15, pp. 371-377, 1989.
10. M. Glenberg and W. E. Langston, "Comprehension of illustrated text: pictures help to build mental models.," Memory and Language, vol. 31, pp. 129-151, 1992.
11. R. E. Mayer, Multimedia learning. Cambridge, UK: Cambridge University Press., 2001.
12. U. Frith, "A developmental framework for developmental dyslexia," Annals of Dyslexia, vol. 36, pp. 69-81, 1985.
13. S. L. H. Association, "Roles and responsibilities of speech-language pathologists with respect to augmentative and alternative communication: Technical report," ASHA Supplement, vol. 24, 2004.
14. N. UzZaman, et al., "Pictorial Temporal Structure of Documents to Help People who have Trouble Reading or Understanding.," International Workshop on Design to Read, CHI, Atlanta, GA, 2010.
15. J. P. Bigham, et al., "WebAnywhere: A Self-Voicing, Web-Browsing Web Application," International Conference on the World Wide Web, Beijing, China, 2008.
16. K. Knight and D. Marcu, "Summarization beyond sentence extraction: a probabilistic approach to sentence compression," Artificial Intelligence, vol. 139, pp. 91-107, 2002. (Pubitemid 34807822)
17. J. Pustejovsky, et al., "TimeML: Robust Specication of Event and Temporal Expressions in Text.," in New Directions in Question Answering, 2003.
18. J. Pustejovsky and M. Verhagen, "SemEval-2010 task 13: evaluating events, time expressions, and temporal relations (TempEval-2)," Workshop on Semantic Evaluations: Recent Achievements and Future Directions, 2010.
19. Y. Matsuo and M. Ishizuka, "Keyword Extraction from a Single Document Using Word Co-Occurrence Statistical Information," International Journal on Artificial Intelligence Tools, vol. 13, pp. 157-170, 2004. (Pubitemid 38411693)
20. R. Mihalcea and P. Tarau, "TextRank: Bringing Order into Texts," Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2004), Barcelona, Spain, 2004.
21. R. Datta, et al., "Image retrieval: Ideas, influences, and trends of the new age," ACM Comput. Surv., vol. 40, pp. 1-60, 2008.
22. Coyne and R. Sproat, "WordsEye: An automatic text-to-scene conversion system," SIGGRAPH, 2001.
23. K. Barnard and D. Forsyth, "Learning the Semantics of Words and Pictures," Eighth International Conference on Computer Vision (ICCV'01), 2001.
24. J. Lafferty, et al., "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," International Conference on Machine Learning, 2001.
25. N. UzZaman and J. F. Allen, "TRIPS and TRIOS System for TempEval-2: Extracting Temporal Information from Text," International Workshop on Semantic Evaluations, ACL 2010.
26. J. F. Allen, et al., "Deep semantic analysis of text," Symposium on Semantics in Systems for Text Processing (STEP), 2008.
27. Y. Lin, "ROUGE: A package for automatic evaluation of summaries," ACL Text Summarization Workshop, 2004.