AutoBrief: An experimental system for the automatic generation of briefings in integrated text and information graphics

International Journal of Human Computer Studies

Volumn 61, Issue 1, 2004, Pages 32-70

  Green, Nancy L ^a   Carenini, Giuseppe ^b   Kerpedjiev, Stephan ^c   Mattis, Joe ^c   Moore, Johanna D ^d   Roth, Steven F ^c,e  

^a UNIVERSITY OF NORTH CAROLINA AT GREENSBORO   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^c MAYA Viz   (United States)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

^e Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; GRAPH THEORY; HUMAN COMPUTER INTERACTION; INFORMATION RETRIEVAL; INTELLIGENT AGENTS; TEXT PROCESSING;

DATA EXPLORATION; EXPERIMENTAL INTELLIGENT MULTIMEDIA PRESENTATION SYSTEM; INFORMATION GRAPHICS; INTEGRATED TEXT;

MULTIMEDIA SYSTEMS;

EID: 3042524213     PISSN: 10715819     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2003.10.007     Document Type: Article

References (69)

1. André E., Rist T. Generating coherent presentations employing textual and visual material. Artificial Intelligence Review. 9:1994;147-165.
2. André, E., Rist, T., Mueller, J., 1999. Employing AI methods to control the behavior of animated interface agents. Applied AI 13, 4-5, 415-448.
3. Bertin J. Semiology of Graphics. Diagrams, Networks, Maps:1983;University of Wisconsin Press, Madison, WI.
4. Beshers, C., Feiner, S., 1993. AutoVisual: rule-based design of interactive multivariate visualizations. IEEE Computer Graphics and Applications, 41-49.
5. Card, S.K., Mackinlay, J., Shneiderman, B. (Eds.), 1999. Readings in Information Visualization: Using Vision to Think. Morgan-Kaufmann Publishers, Inc., Los Altos, CA (Chapter 1).
6. Carenini, G., Moore, D.J., 2001. An empirical study of the influence of user tailoring on evaluative argument effectiveness, Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI 2001).
7. Casner S.M. A task-analytic approach to the automated design of information graphic presentations. ACM Transactions on Graphics. 10(2):1991;111-151.
8. Cassell J. More than just another pretty face. embodied conversational interface agents Communications of the ACM. 43(4):2000;70-78.
9. Chuah, M.C., Roth, S.F., 2003. Visualizing common ground. In: Proceedings of the Seventh International Conference on Information Visualization (IV'03), London, July, 16-18, 2003.
10. Cleveland W.S. The Elements of Graphing Data. Revised Edition:1994;Hobart Press, Summit, NJ.
11. Cleveland W.S., McGill R. Graphical perception and graphical methods for analyzing scientific data. Science. 229:1985;828-833.
12. Dalal, M., Feiner, S.McKeown, K., Pan, S., Zhou, M., Hollerer, T., Shaw, J., Feng, Y., Fromer, J., 1996. Negotiation for automated generation of temporal multimedia presentations. In: Proceedings of ACM Multimedia, Boston, MA, November 1996, pp. 55-64.
13. Dale R., Reiter E. Computational interpretations of the Gricean maxims in the generation of referring expressions. Cognitive Science. 18:1995;233-263.
14. Donnellan K. Reference and definite descriptions. Philosophy Review. LXXV:1966;281-304.
15. Elhadad M., McKeown K., Robin J. Floating constraints in lexical choice. Computational Linguistics. 23(2):1997;195-240.
16. Elzer, S., Green, N., Carberry, S., 2003a. Exploiting cognitive psychology research for recognizing intention in information graphics. Proceedings of the Annual Conference of the Cognitive Science Society.
17. Elzer, S., Green, N., Carberry, S., McCoy, K., 2003b. Extending plan inference techniques to recognize intentions in information graphics. Proceedings of User Modeling 2003.
18. Fasciano, M., Lapalme, G., 1999. Intentions in the coordinated generation of graphics and text from tabular data. Knowledge and Information Systems 1999.
19. Feiner S., McKeown K. Automating the generation of coordinated multimedia explanations. IEEE Computer. 24(10):1991;33-40.
20. Goldstein J., Roth S.F., Kolojejchick J., Mattis J. A framework for knowledge-based, interactive data exploration. Journal of Visual Languages and Computing. 5:1994;339-363.
21. Green, N., 1999. Some layout issues for multimedia argument generation. In: Proceedings of the AAAI Fall Symposium on Using Layout for the Generation, Understanding or Retrieval of Documents, November 5-7, 1999. AAAI Technical Report, FS-99, pp. 47-51.
22. Green, N., 2001. An empirical study of multimedia argumentation. Proceedings of the International Conference on Computational Systems, Workshop on Computational Models of Natural Language Arguments, San Francisco, CA, May 2001. Springer Lecture Notes in Computer Science, Vol. 2073. Springer, Berlin, pp. 1009-1018.
23. Green, N., 2002. An experiment to evaluate the effectiveness of cross-media cues in computer media. Annual Meeting of Assoc. for Computational Linguistics Special Interest Group on Discourse and Dialogue (SIGDIAL 2002), Philadelphia, PA.
24. Green, N., 2003. Towards an Empirical Model of Argumentation in Medical Genetics. Proceedings of CMNA 2003 (IJCAI-03 Workshop on Computer Models of Natural Argumentation) Acapulco.
25. Green, N., Kerpedjiev, S., Roth, S., Carenini, G., Moore, J., 1998a. Generating visual arguments: a media-independent approach. In: AAAI98 Workshop on Representations for Multi-modal Human-Computer Interaction. Madison, Wisconsin, July 26-27, 1998. Technical Report WS-98-09.
26. Green, N., Carenini, G., Moore, J., 1998b. A principled representation of attributive descriptions for integrated text and information graphics presentations. In: Proceedings of the Ninth International Workshop on Natural Language Generation, Niagara-on-the-Lake, Ont., Canada, August 5-7, 1998.
27. Green, N., Carenini, G., Kerpedjiev, S., Roth, S., Moore, J., 1998c. A media-independent content language for integrated text and graphics generation. In: Proceedings of the Workshop on Content Visualization and Intermedia Representations (CVIR'98) of the 17th International Conference on Computational Linguistics (COLING '98) and the 36th Annual Meeting of the Association for Computational Linguistics (ACL'98).
28. Grice H.P. Meaning. Philosophical Review. 67:1957;377-388.
29. Grice H.P. Logic and conversation. Cole P., Morgan J. Syntax and Semantics, Speech Acts. Vol. 3:1975;Academic Press, New York.
30. Iverson G.R., Gurgen M. Statistics. The Conceptual Approach: 1997;Springer, New York.
31. Kerpedjiev, S., Roth, S.F., 2000. Mapping communicative goals into conceptual tasks to generate graphics in discourse. In: Proceedings of Intelligent User Interfaces (IUI2000), New Orleans, pp. 60-67.
32. Kerpedjiev, S., Carenini, G., Green, N., Moore, J., Roth, S., 1998a. Saying it in graphics: from intentions to visualizations. In: Proceedings of the IEEE Symposium on Information Visualization Research Triangle Park, NC, (InfoVis '98), pp. 97-101.
33. Kerpedjiev S., Carenini G., Roth S.F., Moore J.D. AutoBrief. a multimedia presentation system for assisting data analysis Computer Standards and Interfaces. 18:1998;583-593.
34. Kerpedjiev, S., Roth, S., Mattis, J., 2000. Functional unification approach to automated visualization design. In: AAAI Spring Symposium on Smart Graphics, Stanford, pp. 101-108.
35. Kolojejchick J.A., Roth S.F., Lucas P. Information appliances and tools in Visage. IEEE Computer Graphics and Applications. 17(4):1997;32-41.
36. Kosslyn S.M. Understanding charts and graphs. Applied Cognitive Psychology. 3:1989;185-226.
37. Levinson S. Pragmatics. 1983;Cambridge University Press, Cambridge, UK.
38. Mackinlay J. Automating the design of graphical presentations of relational information. ACM Transactions on Graphics. 5(2):1986;110-141.
39. Mann W.C., Thompson S.A. Rhetorical structure theory. toward a functional theory of text organization Text. 8(3):1988;243-281.
40. Marks, J., Reiter, E., 1990. Avoiding unwanted conversational implicatures in text and graphics. In: Proceedings of the Eighth National Conference on Artificial Intelligence (AAAI-1990), pp. 450-456.
41. Maybury, M., 1991. Planning multimedia explanations using communicative acts. In: Proceedings of the Ninth National Conference on Artificial Intelligence, pp. 61-66.
42. Mayer R.E. Multimedia Learning. 2001;Cambridge University Press, Cambridge, UK.
43. Mittal, V., 1997. Visual prompts and graphical design: a framework for exploring the design space of 2-D charts and graphs. In: Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI-1997), pp. 57-63.
44. Mittal V., Moore J., Carenini G., Roth S. Describing complex charts in natural language. a caption generation system Computational Linguistics. 24(3):1998;431-467.
45. Moore D. Statistics. Concepts and Controversies:1997;W.H. Freeman and Company, New York.
46. Moore J.D. Participating in Explanatory Dialogues. 1995;MIT Press, Cambridge, MA.
47. Oberlander J. Grice for graphics. pragmatic implicature in network diagrams Information Design Journal. 8:1996;163-179.
48. Pinker S.A. A theory of graph comprehension. Freedle R. Artificial Intelligence and the Future of Testing. 1990;73-126 Laurence Erlbaum Associates, Hillsdale, NJ.
49. Reed, C.A., Long, D.P., 1998. Generating the structure of argument. Proceedings of the 17th International Conference on Computational Linguistics and 36th Annual Meeting of the Association for Computational Linguistics (COLING-ACL98), pp. 1091-1097.
50. Reiter E., Dale R. Building Natural Language Generation Systems. 2000;Cambridge University Press, Cambridge, UK.
51. Rickel, J., Johnson, L., 2000. Task-oriented collaboration with embodied agents in virtual worlds. In: J. Cassell, et al. (Eds.), Embodied Conversational Agents. MIT Press, Cambridge, MA, pp. 95-122.
52. Roth S.F., Hefley W.E. Intelligent multimedia presentation systems. research and principles Maybury M. Intelligent Multimedia Interfaces. 1993;13-58 Morgan Kaufmann, San Francisco, CA.
53. Roth, S.F., Mattis, J., 1990. Data characterization for intelligent graphics presentation. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 193-200.
54. Roth, S.F., Kolojejchick, J., Mattis, J., Goldstein, J., 1994. Interactive graphic design using automatic presentation knowledge. In: Proceedings of the Conference on Human Factors in Computing Systems (SIGCHI '94), Boston, MA, pp. 112-117.
55. Roth S.F., Chuah M.C., Kerpedjiev S., Kolojejchick J.A., Lucas P. Towards an information visualization workspace. combining multiple means of expression Human-Computer Interaction Journal. 12(1 & 2):1997;131-185.
56. Seligman D., Feiner S. Automated generation of intent-based 3D illustrations. Computer Graphics. 25(4):1991;123-132.
57. Shneiderman, B., 1994. Dynamic queries for visual information seeking. Technical Report CAR-TR-655, University of Maryland.
58. Shneiderman B. Designing the User Interface. Strategies for Effective Human-Computer Interaction 3rd Edition:1998;Addison-Wesley, Reading, MA.
59. Smith S.F., Lassila O., Becker M. Configurable, mixed-initiative systems for planning and scheduling. Tate A. Advanced Planning Technology. 1996;AAAI Press, Menlo Park, CA.
60. Stone, B.A., Lester, J.C., 1996. Dynamically sequencing an animated pedagogical agent. In: Proceedings of the 13th National Conference on Artificial Intelligence, pp. 424-431.
61. Stone, M., Doran, C., 1996. Paying Heed to Collocations. Proceedings of INLG 1996, pp. 91-100.
62. Toulmin S. The Uses of Argument. 1969;Cambridge University Press, Cambridge, UK.
63. Tufte E. The Visual Display of Quantitative Information. 1983;Graphics Press, Cheshire, CT.
64. Vallduvi E., Engdahl E. The linguistic realization of information packaging. Linguistics. 34(3):1996;459-519.
65. Wahlster W., André E., Finkler W., Profitlich H.-J., Rist T. Plan-based integration of natural language and graphics generation. Artificial Intelligence. 63:1993;387-427.
66. Webber B.L. So what can we talk about now? Grosz B., Jones K.S., Webber B.L. Readings in Natural Language Processing. 1983;Morgan Kaufmann, Los Altos, CA.
67. Woods W. Semantics and quantification in natural language question answering. Grosz B., Jones K.S., Webber B.L. Readings in Natural Language Processing. 1983;Morgan Kaufmann, Los Altos, CA.
68. Young, M.R., Moore, J.D., Pollack, M.E., 1994. Towards a principled representation of discourse plans. In: Proceedings of the 16th Conference of the Cognitive Science Society, pp. 946-951.
69. Zhou, M., Feiner, S., 1997. Top-down hierarchical planning of coherent visual discourse. In: Proceedings of the Intelligent User Interfaces (IUI-97), pp. 129-136.