Personal photograph enhancement using internet photo collections

IEEE Transactions on Visualization and Computer Graphics

Volumn 20, Issue 2, 2014, Pages 262-275

  Zhang, Chenxi ^a   Gao, Jizhou ^a   Wang, Oliver ^b   Georgel, Pierre ^c   Yang, Ruigang ^a   Davis, James ^d   Frahm, Jan Michael ^c   Pollefeys, Marc ^e  

^a UNIVERSITY OF KENTUCKY   (United States)

^b DISNEY RESEARCH   (United States)

^c University of North Carolina   (United States)

^d University of California Santa Cruz   (United States)

^e ETH ZURICH   (Switzerland)

Author keywords

2D to 3D conversion; field of view expansion; geotagging and locating; Image enhancement; Internet photo collections; photometric enhancement; segmentation

Indexed keywords

2D TO 3D CONVERSION; AUTOMATIC ANNOTATION; FIELD OF VIEWS; FOREGROUND SEGMENTATION; GEO-TAGGING; INTERNET PHOTO COLLECTIONS; PHOTO COLLECTIONS; STATE-OF-THE-ART TECHNIQUES;

CAMERAS; IMAGE ENHANCEMENT; IMAGE SEGMENTATION; INTERNET; PHOTOGRAPHY; PHOTOMETRY;

THREE DIMENSIONAL;

EID: 84891505775     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2013.77     Document Type: Article

References (35)

1. N. Snavely, S.M. Seitz, and R. Szeliski, "Photo Tourism: Exploring Photo Collections in 3D," ACM Trans. Graphics, vol. 25, no. 3, pp. 835-846, 2006. (Pubitemid 44481045)
2. Y. Furukawa, B. Curless, S.M. Seitz, and R. Szeliski, "Towards Internet-Scale Multi-View Stereo," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1434-1441, 2010.
3. J.-M. Frahm, P.F. Georgel, D. Gallup, T. Johnson, R. Raguram, C. Wu, Y.H. Jen, E. Dunn, B. Clipp, and S. Lazebnik, "Building Rome on a Cloudless Day," Proc. European Conf. Computer Vision (ECCV), pp. 368-381, 2010.
4. R. Kaminsky, N. Snavely, S.M. Seitz, and R. Szeliski, "Alignment of Third Point Clouds to Overhead Images," Proc. Workshop Internet Vision in Conjunction with CVPR, 2009.
5. S. Agarwal, N. Snavely, I. Simon, S.M. Seitz, and R. Szeliski, "Building Rome in a Day," Proc. Int'l Conf. Computer Vision (ICCV), pp. 72-79, 2009.
6. X. Liu, L. Wan, Y. Qu, T.-T. Wong, S. Lin, C.-S. Leung, and P.-A. Heng, "Intrinsic Colorization," ACM Trans. Graphics, vol. 27, no. 5, pp. 152:1-152:9, Dec. 2008.
7. Y.S. Chia, S. Zhuo, R.K. Gupta, Y.-W. Tai, S.-Y. Cho, P. Tan, and S. Lin, "Semantic Colorization with Internet Images," ACM Trans. Graphics, vol. 30, article 156, 2011.
8. M.K. Johnson, K. Dale, S. Avidan, H. Pfister, W.T. Freeman, and W. Matusik, "CG2real: Improving the Realism of Computer Generated Images Using a Large Collection of Photographs," IEEE Trans. Visualization and Computer Graphics, vol. 17, no. 9, pp. 1273-1285, Sept. 2011.
9. N. Joshi, W. Matusik, E. Adelson, and D. Kriegman, "Personal Photo Enhancement Using Example Images," ACM Trans. Graphics, vol. 29, no. 2, pp. 1-15, 2010.
10. J. Hays and A.A. Efros, "Scene Completion Using Millions of Photographs," Comm. ACM, vol. 51, no. 10, pp. 87-94, 2008.
11. O. Whyte, J. Sivic, and A. Zisserman, "Get Out of My Picture! Internet-Based Inpainting," Proc. British machine Vision Conf. (BMVC), 2009.
12. R. Garg, H. Du, S.M. Seitz, and N. Snavely, "The Dimensionality of Scene Appearance," Proc. Int'l Conf. Computer Vision (ICCV), pp. 1917-1924, 2009.
13. K. Dale, M.K. Johnson, K. Sunkavalli, W. Matusik, and H. Pfister, "Image Restoration Using Online Photo Collections," Proc. Int'l Conf. Computer Vision, pp. 2217-2224, 2009.
14. P.-Y. Laffont, A. Bousseau, S. Paris, F. Durand, and G. Drettakis, "Coherent Intrinsic Images from Photo Collections," Proc. ACM SIGGRAPH, 2012.
15. C.L. Zitnick, S.B. Kang, M. Uyttendaele, S.A.J. Winder, and R. Szeliski, "High-Quality Video View Interpolation Using a Layered Representation, " ACM Trans. Graphics, vol. 23, no. 3, pp. 600-608, 2004.
16. L. Zhang, W.J. Tam, and D. Wang, "Stereoscopic Image Generation Based on Depth Images," Proc. Int'l Conf. Image Processing, pp. 2993-2996, 2004. (Pubitemid 40820703)
17. O. Wang, M. Lang, M. Frei, A. Hornung, A. Smolic, and M.H. Gross, "Stereobrush: Interactive 2D to 3D Conversion Using Discontinuous Warps," Proc. Eighth Eurographics Symp. Sketch-Based Interfaces and Modeling, pp. 47-54, 2011.
18. J. Hays and A.A. Efros, "IM2GPS: Estimating Geographic Information from a Single Image," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
19. E. Kalogerakis, O. Vesselova, J. Hays, A.A. Efros, and A. Hertzmann, "Image Sequence Geolocation with Human Travel Priors," Proc. IEEE 12th Int'l Conf. Computer Vision, pp. 253-260, 2009.
20. J. Kopf, B. Neubert, B. Chen, M.F. Cohen, D. Cohen-Or, O. Deussen, M. Uyttendaele, and D. Lischinski, "Deep Photo: Model-Based Photograph Enhancement and Viewing," ACM Trans. Graphics, vol. 27, no. 5, article 116, 2008.
21. C. Rother, V. Kolmogorov, and A. Blake, ""Grabcut": Interactive Foreground Extraction Using Iterated Graph Cuts," ACM Trans. Graphics, vol. 23, no. 3, pp. 309-314, 2004.
22. V.S. Lempitsky, P. Kohli, C. Rother, and T. Sharp, "Image Segmentation with a Bounding Box Prior," Proc. Int'l Conf. Computer Vision (ICCV), pp. 277-284, 2009.
23. Y. Boykov and M.-P. Jolly, "Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in n-d Images," Proc. Int'l Conf. Computer Vision (ICCV), pp. 105-112, 2001. (Pubitemid 32794944)
24. Y. Li, J. Sun, C.-K. Tang, and H.-Y. Shum, "Lazy Snapping," ACM Trans. Graphics, vol. 23, no. 3, pp. 303-308, 2004.
25. M. Raginsky and S. Lazebnik, "Locality Sensitive Binary Codes from Shift-Invariant Kernels," Proc. Advances in Neural Information Processing Systems (NIPS), 2009.
26. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
27. D. Comaniciu, P. Meer, and S. Member, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
28. A. Irschara, C. Zach, J.-M. Frahm, and H. Bischof, "From Structure-from-Motion Point Clouds to Fast Location Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1-8, Mar. 2009.
29. R. Raguram, J.-M. Frahm, and M. Pollefeys, "A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus," Proc. European Conf. Computer Vision, pp. 500-513, 2008.
30. R.M. Haralick, C. Lee, K. Ottenberg, and M. Nö lle, "Analysis and Solutions of the Three Point Perspective Pose Estimation Problem," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1991.
31. G.R. Jones, D. Lee, N.S. Holliman, and D. Ezra, "Controlling Perceived Depth in Stereoscopic Images," Proc. SPIE Stereoscopic Displays and Virtual Reality Systems VIII, vol. 4297, pp. 42-53, June 2001. (Pubitemid 32794388)
32. P. Pérez, M. Gangnet, and A. Blake, "Poisson Image Editing," ACM Trans. Graphics, vol. 22, no. 3, pp. 313-318, 2003.
33. S. Avidan and A. Shamir, "Seam Carving for Content-Aware Image Resizing," ACM Trans. Graphics, vol. 26, no. 3, article 10, 2007.
34. A.A. Efros and W.T. Freeman, "Image Quilting for Texture Synthesis and Transfer," Proc. ACM SIGGRAPH, pp. 341-346, Aug. 2001. (Pubitemid 33047318)
35. K. Tuite, N. Snavely, D. yu Hsiao, N. Tabing, and Z. Popovic, "PhotoCity: Training Experts at Large-Scale Image Acquisition through a Competitive Game," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 1383-1392, 2011.