Virtual rephotography: Novel view prediction error for 3D reconstruction

ACM Transactions on Graphics

Volumn 36, Issue 1, 2017, Pages

  Waechter, Michael ^a   Beljan, Mate ^a   Fuhrmann, Simon ^a   Moehrle, Nils ^a   Kopf, Johannes ^b   Goesele, Michael ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b NONE   (United States)

Author keywords

3d reconstruction; Image based modeling; Image based rendering; Multi view stereo; Novel view prediction error

Indexed keywords

ERRORS; FORECASTING; GEOMETRY; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; QUALITY CONTROL; RENDERING (COMPUTER GRAPHICS); STEREO IMAGE PROCESSING;

3D RECONSTRUCTION; IMAGE BASED RENDERING; IMAGE-BASED MODELING; MULTI-VIEW STEREO; VIEW PREDICTIONS;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 85010720873     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2999533     Document Type: Article

References (50)

1. Henrik Aanæs, Rasmus Ramsbøl Jensen, George Vogiatzis, Engin Tola, and Anders Bjorholm Dahl. 2016. Large-scale data for multiple-view stereopsis. IJCV 120, 2, 153-168.
2. Tunç Ozan Aydin, Rafal Mantiuk, Karol Myszkowski, and Hans-Peter Seidel. 2008. Dynamic range independent image quality assessment. In SIGGRAPH.
3. Soonmin Bae, Aseem Agarwala, and Frédo Durand. 2010. Computational rephotography. ACM Transactions on Graphics 29, 3, 24:1-24:15.
4. Simon Baker, Daniel Scharstein, J. P. Lewis, Stefan Roth, Michael J. Black, and Richard Szeliski. 2011. A database and evaluation methodology for optical flow. IJCV 92, 1, 1-31.
5. Kai Berger, Christian Lipski, Christian Linz, Anita Sellent, and Marcus Magnor. 2010. A ghosting artifact detector for interpolated image quality assessment. In International Symposium on Consumer Electronics.
6. Chris Buehler, Michael Bosse, Leonard McMillan, Steven Gortler, and Michael F. Cohen. 2001. Unstructured Lumigraph rendering. In SIGGRAPH.
7. Fatih Calakli, Ali O. Ulusoy, Maria I. Restrepo, Gabriel Taubin, and Joseph L. Mundy. 2012. High resolution surface reconstruction from multi-view aerial imagery. In 3DIMPVT.
8. Neill D. Campbell, George Vogiatzis, Carlos Hernández, and Roberto Cipolla. 2008. Using multiple hypotheses to improve depth-maps for multi-view stereo. In ECCV.
9. Scott Daly. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision.
10. Andrew Fitzgibbon, Yonatan Wexler, and Andrew Zisserman. 2005. Imagebased rendering using image-based priors. IJCV 63, 2, 141-151.
11. Wolfgang Förstner. 1996. 10 pros and cons against performance characterization of vision algorithms. In Workshop on Performance Characteristics of Vision Algorithms.
12. Simon Fuhrmann and Michael Goesele. 2011. Fusion of depth maps with multiple scales. In SIGGRAPH Asia.
13. Simon Fuhrmann, Fabian Langguth, Nils Moehrle, Michael Waechter, and Michael Goesele. 2015. MVE - An image-based reconstruction environment. Computers & Graphics 53, Part A (2015).
14. Yasutaka Furukawa, Brian Curless, Steven M. Seitz, and Richard Szeliski. 2010. Towards internet-scale multi-view stereo. In CVPR.
15. Yasutaka Furukawa and Jean Ponce. 2010. Accurate, dense, and robust multi-view stereopsis. PAMI 32, 8, 1362-1376.
16. Michael Goesele, Noah Snavely, Brian Curless, Hugues Hoppe, and Steven M. Seitz. 2007. Multi-view stereo for community photo collections. In ICCV.
17. Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. 1996. The Lumigraph. In SIGGRAPH.
18. Stefan Guthe, Douglas Cunningham, Pascal Schardt, and Michael Goesele. 2016. Ghosting and popping detection for image-based rendering. In 3DTV Conference.
19. Tom Haber, Christian Fuchs, Philippe Bekaert, Hans-Peter Seidel, Michael Goesele, and Hendrik P. A. Lensch. 2009. Relighting objects from image collections. In CVPR.
20. Christian Hofsetz, Kim Ng, George Chen, Peter McGuinness, Nelson Max, and Yang Liu. 2004. Image-based rendering of range data with estimated depth uncertainty. Computer Graphics and Applications 24, 4, 34-42.
21. Yuan Hongxing, Guo Li, Yu Li, and Cheng Long. 2010. Multi-view reconstruction using band graph-cuts. Journal of Computer-Aided Design & Computer Graphics 4 (2010).
22. Christof Hoppe, Manfred Klopschitz, Markus Rumpler, Andreas Wendel, Stefan Kluckner, Horst Bischof, and Gerhard Reitmayr. 2012a. Online feedback for structure-from-motion image acquisition. In BMVC.
23. Christof Hoppe, Andreas Wendel, Stefanie Zollmann, Katrin Pirker, Arnold Irschara, Horst Bischof, and Stefan Kluckner. 2012b. Photogrammetric camera network design for micro aerial vehicles. In Computer Vision Winter Workshop.
24. Michael Kazhdan, Matthew Bolitho, and Hugues Hoppe. 2006. Poisson surface reconstruction. In SGP.
25. Johannes Kopf, Michael F. Cohen, and Richard Szeliski. 2014. First-person hyper-lapse videos. In SIGGRAPH.
26. Yvan G. Leclerc, Quang-Tuan Luong, and Pascal Fua. 2000. Measuring the self-consistency of stereo algorithms. In ECCV.
27. Marc Levoy and Pat Hanrahan. 1996. Light field rendering. In SIGGRAPH.
28. Rafal Mantiuk. 2013. Quantifying image quality in graphics: Perspective on subjective and objective metrics and their performance. In SPIE, Vol. 8651.
29. Rafal Mantiuk, Kil Joong Kim, Allan G. Rempel, and Wolfgang Heidrich. 2011. HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. In SIGGRAPH.
30. Paul Merrell, Amir Akbarzadeh, Liang Wang, Philippos Mordohai, Jan-Michael Frahm, Ruigang Yang, David Nistér, and Marc Pollefeys. 2007. Real-time visibility-based fusion of depth maps. In ICCV.
31. Ken Perlin. 2002. Improving noise. In SIGGRAPH.
32. Jens Preiss, Felipe Fernandes, and Philipp Urban. 2014. Color-image quality assessment: From prediction to optimization. IEEE Transactions on Image Processing 23, 3, 1366-1378.
33. Ganesh Ramanarayanan, James Ferwerda, Bruce Walter, and Kavita Bala. 2007. Visual equivalence: Towards a new standard for image fidelity. In SIGGRAPH.
34. Michael Schwarz and Marc Stamminger. 2009. Onpredicting visual popping in dynamic scenes. In Applied Perception in Graphics and Visualization.
35. Steven M. Seitz, Brian Curless, James Diebel, Daniel Scharstein, and Richard Szeliski. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR.
36. Qi Shan, Riley Adams, Brian Curless, Yasutaka Furukawa, and Steven M. Seitz. 2013. The visual Turing test for scene reconstruction. In 3DV.
37. Noah Snavely, Steven M. Seitz, and Richard Szeliski. 2006. Photo tourism: Exploring photo collections in 3D. In SIGGRAPH.
38. Christoph Strecha, Wolfgang von Hansen, Luc Van Gool, Pascal Fua, and Ulrich Thoennessen. 2008. On benchmarking camera calibration and multi-view stereo for high resolution imagery. In CVPR.
39. Richard Szeliski. 1999. Prediction error as a quality metric for motion and stereo. In ICCV.
40. James Tompkin, Min H. Kim, Kwang In Kim, Jan Kautz, and Christian Theobalt. 2013. Preference and artifact analysis for video transitions of places. ACM Transactions on Applied Perception 10, 3, 13:1-13:19.
41. Kathleen Tuite, Noah Snavely, Dun-yu Hsiao, Nadine Tabing, and Zoran Popović. 2011. PhotoCity: Training experts at large-scale image acquisition through a competitive game. In SIGCHI.
42. Peter Vangorp, Gaurav Chaurasia, Pierre-Yves Laffont, Roland Fleming, and George Drettakis. 2011. Perception of visual artifacts in image-based rendering of façades. In Eurographics Symposium on Rendering.
43. Peter Vangorp, Christian Richardt, Emily A. Cooper, Gaurav Chaurasia, Martin S. Banks, and George Drettakis. 2013. Perception of perspective distortions in image-based rendering. In SIGGRAPH.
44. Kenneth Vanhoey, Basile Sauvage, Pierre Kraemer, Frédéric Larue, and Jean-Michel Dischler. 2015. Simplification of meshes with digitized radiance. The Visual Computer 31, 6, 1011-1021.
45. Michael Waechter, Nils Moehrle, and Michael Goesele. 2014. Let there be color! Large-scale texturing of 3D reconstructions. In ECCV.
46. Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4, 600-612.
47. Robert H. Webb, Diane E. Boyer, and Raymond M. Turner. 2010. Repeat Photography. Island Press.
48. Yizhou Yu, Paul Debevec, Jitendra Malik, and Tim Hawkins. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In SIGGRAPH.
49. Ramin Zabih and John Woodfill. 1994. Non-parametric local transforms for computing visual correspondence. In ECCV.
50. Matthias Zwicker, Hanspeter Pfister, Jeroen van Baar, and Markus Gross. 2001. Surface splatting. In SIGGRAPH.