Cinematic visual discourse: Representation, generation, and evaluation

IEEE Transactions on Computational Intelligence and AI in Games

Volumn 2, Issue 2, 2010, Pages 69-81

  Jhala, Arnav ^a   Young, R Michael ^b  

^a University of California Santa Cruz   (United States)

^b North Carolina State University   (United States)

Author keywords

Discourse generation; machinima generation; planning

Indexed keywords

3-D VIRTUAL ENVIRONMENT; CAMERA PLANNING; COGNITIVE MODEL; GENERATION PLANNING; MACHINIMA; PLAN-BASED; PLANNING ALGORITHMS; TECHNIQUES USED; USER STUDY;

CAMERAS; MATHEMATICAL OPERATORS; VIRTUAL REALITY;

VISUALIZATION;

EID: 77955691827     PISSN: 1943068X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCIAIG.2010.2046486     Document Type: Article

References (46)

1. R. C. Schank and R. P. Abelson, Scripts, Plans, Goals and Understanding: An Inquiry Into Human Knowledge Structures. Hillsdale, NJ: L. Erlbaum, 1977.
2. J. R. Meehan, "Tale-spin, an interactive program that writes stories," in Proc. Int. Joint Conf. Artif. Intell., 1977, pp. 91-98.
3. M. O. Riedl and R. M. Young, "An intent-driven planner for multiagent story generation," in Proc. 3rd Int. Joint Conf. Autonom. Agents Multiagent Syst., New York, 2004, pp. 186-193.
4. C. B. Callaway, "Narrative prose generation," Artif. Intell., vol.139, pp. 213-252, 2002.
5. M. Christie, R. Machap, J. Normand, P. Olivier, and J. Pickering, "Virtual camera planning: A survey," in Smart Graphics, 2005, pp. 40-52.
6. A. C. Graesser, K. L. Lang, and R. M. Roberts, "Question answering in the context of stories," J. Exp. Psych., General, vol.120, no.3, pp. 255-277, 1991.
7. D. B. Christian and R. M. Young, "Comparing cognitive and computational models of narrative structure," in Proc. 19th Nat. Conf. Artif. Intell., 2003, pp. 385-390.
8. A. Jhala and R. M. Young, "Representational requirements for a planbased approach to virtual cinematography," in Proc. 2nd Conf. Artif. Intell. Interactive Digit. Entertainment, Marina Del Rey, CA, 2006, pp. 36-41.
9. A. Jhala and R. M.Young, "A discourse planning approach to cinematic camera control for narratives in virtual environments," in Proc. 20th Nat. Conf. Artif. Intell., Pittsburgh, PA, 2005, pp. 307-312.
10. G. Prince, A Dictionary of Narratology. Lincoln, NE: Univ. Nebraska Press, 1987.
11. S. Chatman, Story and Discourse: Narrative Structure in Fiction and Film. Ithaca, New York: Cornell Univ. Press, 1980.
12. W. H. Bares, S. McDermott, C. Boudreaux, and S. Thainimit, "Virtual 3D camera composition from frame constraints," in ACM Multimedia. New York: ACM Press, 2000, pp. 177-186.
13. H. Nicholas, H. Ralf, and S. Thomas, "A camera engine for computer games: Managing the trade-off between constraint satisfaction and frame coherence," in Proc. Eurographics, 2001, vol.20, pp. 174-183.
14. D. B. Christianson, S. E. Anderson, L. W. He, D. Salesin, D. S. Weld, and M. F. Cohen, "Declarative camera control for automatic cinematography," in Proc. AAAI/IAAI Nat. Conf. Artif. Intell., 1996, vol.1, pp. 148-155.
15. D. Amerson, S. Kime, and R. M. Young, "Real-time cinematic camera control for interactive narratives," in Proc. ACM SIGCHI Int. Conf. Adv. Comput. Entertain. Technol., 2005, p. 369.
16. W. Bares and J. Lester, "Cinematographic user models for automated realtime camera control in dynamic 3D environments," in Proc. 6th Int. Conf. User Model., 1997, pp. 215-226.
17. M. Christie and P. Olivier, "Camera control in computer graphics," Eurographics, vol.25, no.3, pp. 89-113, 2006.
18. C. Ware and S. Osborne, "Exploration and virtual camera control in virtual three dimensional environments," SIGGRAPH, vol.24, no.2, pp. 175-183, 1990.
19. J. Blinn, "Where am I? What am I looking at?," IEEE Comput. Graph. Appl., vol.8, no.4, pp. 76-81, Jul. 1988.
20. M. Gleicher and A. Witkin, "Through-the-lens camera control," in Proc. 19th Annu. Conf. Comput. Graph. Interactive Tech., 1992, pp. 331-340.
21. N. Halper and P. Olivier, "Camplan:Acamera planning agent," in Proc. AAAI Spring Symp. Smart Graph., 2000, pp. 92-100.
22. F. Jardillier and E. Languènou, "Screen-space constraints for camera movements: The virtual cameraman," Comput. Graph. Forum, vol.17, no.3, pp. 175-186, 1998.
23. W. H. Bares and J. C. Lester, "Intelligent multi-shot visualization interfaces for dynamic 3D worlds," in Proc. 4th Int. Conf. Intell. User Interfaces, 1999, pp. 119-126.
24. O. Bourne and A. Sattar, "Applying constraint weighting to autonomous camera control," in Proc. 1st Artif. Intell. Interactive Digit. Entertainment Conf., 2005, pp. 3-8.
25. J. Pickering, "Intelligent camera planning for computer graphics," Ph.D. dissertation, Dept. Comput., Univ. York, York, U.K., 2002.
26. M. Christie and J.-M. Normand, "A semantic space partitioning approach to virtual camera composition," Comput. Graph. Forum, vol.24, no.3, pp. 247-256, 2005.
27. P. Burelli, L. Di Gaspero, A. Ermetici, and R. Ranon, "Virtual camera composition with particle swarm optimization," in Smart Graphics. New York: Springer-Verlag, 2008, pp. 130-141.
28. H. Li-wei, C. Michael, and S. David, "The virtual cinematographer: A paradigm for real-time camera control and directing," in Proc. SIGGRAPH Comput. Graphics Conf., 1996, pp. 217-224.
29. B. Tomlinson, B. Blumberg, and D. Nain, "Expressive autonomous cinematography for interactive virtual environments," in Proc. 4th Int. Conf. Autonom. Agents, C. Sierra, M. Gini, and J. S. Rosenschein, Eds., Barcelona, Catalonia, Spain, 2000, pp. 317-324.
30. B. J. Grosz and C. L. Sidner, "Attention, intentions, and the structure of discourse," Comp. Linguistics, vol.12, no.3, pp. 175-204, 1986.
31. W. Mann and S. Thompson, "Rhetorical structure theory: A theory of text organization," USC/ISI Tech. Rep., 1987.
32. R. M. Young, J. D. Moore, and M. E. Pollack, "Towards a principled representation of discourse plans," in Proc. Int. Conf. AI Planning Syst., Atlanta, GA, 1994, pp. 188-193.
33. M. Maybury, "Communicative acts for explanation generation," Int. J. Man-Mach. Studies, vol.37, pp. 135-172, 1992.
34. J. D. Moore and C. Paris, "Planning text for advisory dialogues: Capturing intentional and rhetorical information," Comput. Linguistics, vol.19, no.4, pp. 651-694, 1994.
35. C. B. Callaway, E. Not, A. Novello, C. Rocchi, O. Stock, and M. Zancanaro, "Automatic cinematography and multilingual NLG for generating video documentaries," Artif. Intell., vol.165, no.1, pp. 57-89, 2005.
36. J. S. Penberthy and D. S. Weld, "UCPOP: A sound and complete partial- order planner for ADL," in Proc. Knowl. Represent. Reason., 1992, pp. 103-114.
37. D. Arijon, Grammar of the Film Language. Los Angeles, CA: Silman-James Press, 1976.
38. M. Joseph, The Five C's of Cinematography. Hollywood, CA: Cine/ Grafic, 1970.
39. J. V. Sijll, Cinematic Storytelling. Studio City, CA: Michael Wiese Productions, 2005.
40. E. D. Sacerdoti, "The nonlinear nature of plans," in Proc. Int. Joint Conf. Artif. Intell., 1975, pp. 206-214.
41. G. Polti, Thirty-Six Dramatic Situations. Boston, MA: The Writer Inc., 1921, 1977.
42. R. M. Young, M. E. Pollack, and J. D. Moore, "Decomposition and causality in partial-order planning," in Proc. AIPS, Chicago, IL, 1994, pp. 188-193.
43. M. Riedl and R. M. Young, "Character focused narrative planning," in Proc. Int. Conf. Virtual Storytelling, Toulouse, France, 2003, pp. 47-56.
44. D. Nau, M. Ghallab, and P. Traverso, Automated Planning: Theory and Practice. San Francisco, CA: Morgan-Kauffman, 2004.
45. N. Yorke-Smith, K. B. Venable, and F. Rossi, "Temporal reasoning with preferences and uncertainty," in Proc. Int. Joint Conf. Artif. Intell., 2003, pp. 1385-1386.
46. T. Vernieri, "A web services approach to generating and using plans in configurable execution environments," M.S. thesis, Dept. Comput. Sci., North Carolina State Univ., Raleigh, NC, 2006.