Re-cinematography: Improving the camerawork of casual video

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 5, Issue 1, 2008, Pages

  Gleicher, Michael L ^a   Liu, Feng ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

Casual video; Cinematography; Image stabilization

Indexed keywords

ALGEBRA; PHOTOGRAPHY; RHENIUM;

CAMERA MOTIONS; CAMERA MOVEMENTS; CASUAL VIDEO; CINEMATOGRAPHY; HOME VIDEOS; IMAGE STABILIZATION; MATRIX LOGARITHMS; POST-PROCESSING;

CAMERAS;

EID: 56349116768     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/1404880.1404882     Document Type: Article

References (53)

1. ACHANTA, R., YAN, W.-Q., AND KANKANHALLI, M. 2006. Modeling intent for home video repurposing. IEEE Multimedia 13, 46-55.
2. ADAMS, B., VENKATESH, S., AND JAIN, R. 2005. IMCE: Integrated media creation environment. ACM Trans. Multimed. Comput. Comm. Appl 1, 211-247.
3. ALEXA, M. 2002. Linear combinations of transformations. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. 380-387.
4. ANG, T. 2005. Digital Video Handbook. Dorling Kindersley.
5. ARIJON, D. 1991. Grammar of the Film Language. Silman-James Press.
6. BENNETT, E. P. AND MCMILLAN, L. 2003. Proscenium: A framework for spatio-temporal video editing. In Proceedings of the 11th ACM International Conference on Multimedia (MULTIMEDIA'03). ACM, New York, NY, 177-184.
7. BEVILACQUA, A. AND AZZARI, P. 2006. High-quality real time motion detection using ptz cameras. In Proceedings of the IEEE International Conference on Video and Signal Based Surveillance (AVSS'06). 23.
8. BLOCK, B. A. 2001. The Visual Story: Seeing the Structure of Film, TV, and New Media. Focal Press.
9. BORDWELL, D. AND THOMPSON, K. 1997. Film Art: An Introduction. McGraw-Hill.
10. BRANDON, B. 2005. The Complete Digital Video Guide. Reader's Digest.
11. BROWN, B. 2002. Cinematography: Theory and Practice: Imagemaking for Cinematographers, Directors & Videographers. Butterworth-Heinemann.
12. BUEHLER, C., BOSSE, M., AND MCMILLAN, L. 2001. Non-metric image-based rendering for video stabilization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Vol. 2. 609-614.
13. CASARES, J., LONG, A. C., MYERS, B. A., BHATNAGAR, R., STEVENS, S. M., DABBISH, L., YOCUM, D., AND CORBETT, A. 2002. Simplifying video editing using metadata. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. ACM, London, England, 157-166.
14. CHALFEN, R. 1987. Snapshot Versions of Life. Bowling Green State University Press.
15. CHEN, L.-Q., XIE, X., FAN, X., MA, W.-Y., ZHANG, H.-J., AND ZHOU, H.-Q. 2003. A visual attention model for adapting images on small displays. Multimed. Syst. 9, 4, 353-364.
16. CHRISTIE, M., MACHAP, R., NORMAND, J.-M., OLIVIER, P., AND PICKERING, J. 2005. Virtual camera planning: A survey. In Proceedings of Smart Graphics. 40-52.
17. CROW, F. C. 1984. Summed-area tables for texture mapping. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. 207-212.
18. DONY, R., MATEER, J., AND ROBINSON, J. 2005. Techniques for automated reverse storyboarding. IEE J. Vision, Image Signal Process. 152, 4, 425-436.
19. FISCHLER, M. A. AND BOLLES, R. C. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. ACM 24, 6, 381-395.
20. GIRGENSOHN, A., BORECZKY, J., CHIU, P., DOHERTY, J., FOOTE, J., GOLOVCHINSKY, G., UCHIHASHI, S., AND WILCOX, L. 2000. A semi-automatic approach to home video editing. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology. 81-89.
21. GLEICHER, M. 1997. Projective registration with difference decomposition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 331-337.
22. GLEICHER, M. AND LIU, F. 2007. Re-cinematography: Improving the camera dynamics of casual video. In Proceedings of the 15th International Conference on Multimedia.
23. GOVINDU, V. M. 2004. Lie-algebraic averaging for globally consistent motion estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
24. HANSEN, M. AND MCDOWEL, L. 2001. Apparatus and method for removing blank areas from real-time stabilized images by inserting background information. U.S. Patent 6211913.
25. HECK, R., WALLICK, M., AND GLEICHER, M. 2007. Virtual videography. ACM Trans. Multimed. Comput. Comm. Appl. 3, 1, 4.
26. HUA, X.-S., LU, L., AND ZHANG, H.-J. 2004. Optimization-based automated home video editing system. IEEE Trans. Circ. Syst. Video Tech. 14, 5 (May), 572-583.
27. IRANI, M. AND ANANDAN, P. 1998. Video indexing based on mosaic representations. Proc. IEEE 86, 5, 905-921.
28. IRANI, M., ANANDAN, P. AND HSU, S. 1995. Mosaic based representations of video sequences and their applications. In Proceedings of the International Conference on Computer Vision. 605-611.
29. IRANI, M., ROUSSO, B., AND PELEG, S. 1994. Recovery of ego-motion using image stabilization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 454-460.
30. JOHNSTON, O. AND THOMAS, F. 1981. The Illusion of Life: Disney Animation. Abbeville Press.
31. KATZ, S. D. 1991. Film Directing Shot by Shot: Visualizing from Concept to Screen. Michael Wiese Productions.
32. KAVAN, L., COLLINS, S., O'SULLIVAN, C., AND ZARA, J. 2006. Dual quaternions for rigid transformation blending. Tech. Rep. TCD-CS-2006-46, Trinity College Dublin.
33. KENDER, J. AND YEO, B.-L. 2000. On the structure and analysis of home video. In Proceedings of ACCV.
34. KIRK, D., SELLEN, A., HARPER, R., AND WOOD, K. 2007. Understanding videowork. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 61-70.
35. LITVIN, A., KONRAD, J., AND KARL, W. 2003. Probabilistic video stabilization using kalman filtering and mosaicking. In Proceedings of the IS&T/SPIE Symposium on Electronic Imaging, Image, and Video Comm. 663-674.
36. LIU, F. AND GLEICHER, M. 2006. Video retargeting: Automating pan and scan. In ACM Multimed. 241-250.
37. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2, 91-110.
38. MATSUSHITA, Y., OFEK, E., GE, W., TANG, X., AND SHUM, H.-Y. 2006. Full-frame video stabilization with motion inpainting. IEEE Trans. Pattern Anal. Mech. Intel. 28, 7, 1150-1163.
39. MEI, T., HUA, X.-S., AND ZHOU, H.-Q. 2005. Tracking users' capture intention: A novel complementary view for home video content analysis. In Proceedings of ACM Multimedia. 531-534.
40. MIKOLAJCZYK, K. AND SCHMID, C. 2005. A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mech. Intel. 27, 10, 1615-1630.
41. NISTÉR, D. 2005. Preemptive RANSAC for live structure and motion estimation. Machine Vision Appl. 16, 5, 321-329.
42. NOCEDAL, J. AND WRIGHT, S. J. 2006. Numerical Optimization, 2nd ed. Springer.
43. OSIAN, M. AND VAN GOOL, L. 2004. Video shot characterization. Machine Vision Appl. 15, 172-177.
44. PAN, Z. AND NGO, C.-W 2004. Structuring home video by snippet detection and pattern parsing. In Proceedings of the ACM SIGMM Workshop on Multimedia Information Retrieval. 69-76.
45. ROSENHOLTZ, R. 1999. A simple saliency model predicts a number of motion popout phenomena. Vision Research 39, 19, 3157-3163.
46. SUH, B., LING, H., BEDERSON, B. B., AND JACOBS, D. W. 2003. Automatic thumbnail cropping and its effectiveness. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology. 95-104.
47. SZELISKL, R. 1996. Video mosaics for virtual environments. IEEE Comput. Graph. Appl. 16, 2, 22-30.
48. SZELISKI, R. 2006. Image alignment and stitching: A tutorial. Tech. rep. MSR-TR-2004-92, Microsoft Research.
49. TEODOSIO, L. AND BENDER, W. 2005. Salient stills. ACM Trans. Multimed. Comput. Commun. Appl. 1, 1, 16-36.
50. VIOLA, P. AND JONES, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 511-518.
51. WEXLER, Y., SHECHTMAN, E., AND IRANI, M. 2007. Space-time completion of video. IEEE Trans. Pattern Anal. Mech. Intel. 29, 3, 463-476.
52. WOOD, D. N., FINKELSTEIN, A., HUGHES, J. F., THAYER, C. E., AND SALESIN, D. H. 1997. Multiperspective panoramas for cel animation. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. 243-250.
53. YAN, W.-Q. AND KANKANHALLI, M. S. 2002. Detection and removal of lighting and shaking artifacts in home videos. In Proceedings of ACM Multimedia. 107-116.