Efficient three-dimensional scene modeling and mosaicing

Journal of Field Robotics

Volumn 26, Issue 10, 2009, Pages 759-788

  Nicosevici, Tudor ^a   Gracias, Nuno ^a   Negahdaripour, Shahriar ^b   Garcia, Rafael ^a  

^a UNIVERSITY OF GIRONA   (Spain)

^b UNIVERSITY OF MIAMI   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

3D MODELS; 3D RECONSTRUCTION; 3D SCENES; 3D SURFACE; DATA SETS; END-TO-END SOLUTIONS; ERROR ACCUMULATION; FEATURE ASSOCIATION; GEOMETRIC INFORMATION; GROUND TRUTH; HIGH QUALITY; ILLUMINATION CHANGES; IMAGE TEXTURE; LOCAL SHAPE; MAPPING APPLICATIONS; MONOCULAR VIDEO SEQUENCES; MOSAICING; REALISTIC SCENARIO; RECONSTRUCTION ACCURACY; SCENE MODELING; SEQUENTIAL STRUCTURE; STRUCTURE FROM MOTION; THREE-DIMENSIONAL (3D); THREE-DIMENSIONAL SCENES; VERTEX SELECTION; VISUAL INFORMATION; VISUAL MAP; VISUAL MAPPING;

AUGMENTED REALITY; BLENDING; CAMERAS; IMAGE RECONSTRUCTION; MAPPING; TEXTURES; VIDEO RECORDING; VIRTUAL REALITY; VISUAL COMMUNICATION;

THREE DIMENSIONAL;

EID: 70450161981     PISSN: 15564959     EISSN: 15564967     Source Type: Journal    
DOI: 10.1002/rob.20305     Document Type: Article

References (68)

1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., & Cohen, M. (2004, August). Interactive digital photomontage. In Proceedings SIGGRAPH04, Los Angeles, CA.
2. Armangue, X., & Salvi, J. (2003). Overall view regarding fundamental matrix estimation. Image and Vision Computing, 21, 205-220.
3. Arya, S., Mount, D. M., Netanyahu, N. S., Silverman, R., & Wu, A. (1998). An optimal algorithm for approximate nearest neighbor searching. Journal of the Association for Computing Machinery, 45, 891-923.
4. Baumberg, A. (2000, June). Reliable feature matching across widely separated views. In IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head, SC (pp. 774-781).
5. Baumberg, A. (2002, September). Blending images for texturing 3D models. In Proceedings of the British Machine Vision Conference, Cardiff, UK.
6. Beardsley, P. A., Zisserman, A., & Murray, D. W. (1994, May). Navigation using affine structure from motion. In European Conference on Computer Vision, Stockholm, Sweden (vol. 801, pp. 85-96).
7. Boykov, Y., Veksler, O., & Zabih, R. (1998, June). Markov random fields with efficient approximations. In IEEE Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA (pp. 648-655).
8. Brown, M., & Lowe, D. (2005, May). Unsupervised 3D object recognition and reconstruction in unordered datasets. In 3D Digital Imaging and Modeling, Ottawa, Canada (pp. 56-63).
9. Burt, P., & Adelson, E. (1983). A multiresolution spline with application to image mosaics. ACM Transactions on Graphics, 2(4), 217-236.
10. Davis, J. (1998, June). Mosaics of scenes with moving objects. In Proceedings of the Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA.
11. Delaunoy, O., Gracias, N., & Garcia, R. (2008, April). Towards detecting changes in underwater image sequences. MTS/IEEE OCEANS Conference, Kobe, Japan.
12. Deschênes, J., & Ziou, D. (2000). Detection of line junctions and line terminations using curvilinear features. Pattern Recognition Letters, 21, 637-649.
13. Eck, M., DeRose, T., Duchamp, T., Hoppe, H., Lounsbery, M., & Stuetzle, W. (1995, August). Multiresolution analysis of arbitrary meshes. In SIGGRAPH, Los Angeles, CA (vol. 29, pp. 173-182).
14. Eustice, R. M., Singh, H., & Leonard, J. J. (2006). Exactly sparse delayed-state filters for view-based SLAM. IEEE Transactions on Robotics, 22, 1100-1114.
15. Faugeras, O., & Lustman, F. (1988). Motion and structure from motion in a piecewise planar environment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2, 485-508.
16. Fitzgibbon, A., & Zisserman, A. (1998, June). Automatic camera recovery for closed or open image sequences. In European Conference on Computer Vision, Freiburg, Germany (pp. 311-326).
17. Floater, M., & Hormann, K. (2005). Surface parameterization: A tutorial and survey. In Advances in multiresolution for geometric modelling (pp. 157-186). Berlin: Springer Verlag.
18. Fowler, R., & Little, J. (1979). Automatic extraction of irregular network digital terrain models. SIGGRAPH Computer Graphics, 13(2), 199-207.
19. Garcia, R., Nicosevici, T., & Cufi, X. (2002, October). On the way to solve lighting problems in underwater imaging. In MTS/IEEE OCEANS Conference, Biloxi, MS (pp. 1018-1024).
20. Garland, M., & Heckbert, P. S. (1998, October). Simplifying surfaces with color and texture using quadric error metrics. In Proceedings Visualization, Research Triangle Park, NC (pp. 99-188).
21. Gonzalez, C., Castello, P., & Chover, M. (2007, March). A texture-based metric extension for simplification methods. In Proceedings GRAPP, Barcelona, Spain (pp. 69-76).
22. Goshtasby, A. (2005). Fusion of multi-exposure images. Image and Vision Computing, 23(6), 611-618.
23. Gracias, N., Mahoor, M., Negahdaripour, S., & Gleason, A. (2009). Fast image blending using watersheds and graph cuts. Image and Vision Computing, 27(5), 597-607.
24. Gracias, N., Negahdaripour, S., Neumann, L., Prados, R., & Garcia, R. (2008, September). A motion compensated filtering approach to remove sunlight flicker in shallow water images. In MTS/IEEE OCEANS Conference Quebec City Canad.
25. Greig, D., Porteous, B., & Seheult, A. (1989). Exact maximum a posteriori estimation for binary images. Journal of the Royal Statistical Society, 51(2), 271-279.
26. Gu, F., & Rzhanov, Y. (2006, September). Optimal image blending for underwater mosaics. In MTS/IEEE OCEANS Conference, Boston, MA.
27. Haralick, R. (1994). Propagating covariance in computer vision. Pattern Recognition, 1, 493-498.
28. Hartley, R., & Zisserman, A. (2004). Multiple view geometry in computer vision. Cambridge, UK: Cambridge University Press.
29. Hoppe, H. (1996, August). Progressive meshes. In SIG-GRAPH, Boston, MA (vol. 30, pp. 99-188).
30. Hoppe, H. (1997, August). View-dependent refinement of progressive meshes. In SIGGRAPH, Los Angeles, CA (vol. 31, pp. 189-198).
31. Jankó, Z., Kós, G., & Chetverikov, D. (2005). Creating entirely textured 3D models of real objects using surface flattening. International Journal of Machine Graphics and Vision, 14(4), 379-398.
32. Kolmogorov, V., & Zabih, R. (2004). What energy functions can be minimized via graph cuts? IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(2), 147-159.
33. Kwatra, V., Schodl, A., Essa, I., Turk, G., & Bobick, A. (2003, July). Graphcut textures: Image and video synthesis using graph cuts. In SIGGRAPH, San Diego, CA (vol. 22, pp. 277-286).
34. Lafortune, E. P., & Willems, Y. D. (1993, December). Bidirectional path tracing. In Proceedings Compugraphics, Alvor, Portugal.
35. Lam, L., Lee, S., & Suen, Y. (1992). Thinning methodologies - A comprehensive survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(9), 869-885.
36. Levin, A. A., Zomet, S. P., & Weiss, Y. (2004, May). Seamless image stitching in the gradient domain. In Proceedings of the European Conference on Computer Vision (ECCV04), Prague, Czech Republic.
37. Li, Y., Sun, J., Tang, C.-K., & Shum, H.-Y. (2004). Lazy snapping. ACM Transactions on Graphics, 23(3), 303-308.
38. Lin, M. H. (2002). Surfaces with occlusions from layered stereo. Ph.D. thesis, Stanford University.
39. Lourakis, M., & Deriche, R. (1999, January). Camera self-calibration using the singular value decomposition of the fundamental matrix. In Asian Conference on Computer Vision, Taipei, Taiwan (pp. 403-408).
40. Low, K. L., & Tan, T. S. (1997, April). Model simplification using vertex clustering. In Symposium on Interactive 3D Graphics, Providence, RI (pp. 75-82).
41. Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91-110.
42. Ma, Y., Huang, K., & Kosecka, J. (2002, January). Rank deficiency condition of the multiple view matrix for mixed point and line features. In Asian Conference on Computer Vision, Melbourne, Australia.
43. Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., & Gool, L. V. (2005). A comparison of affine region detectors. International Conference on Computer Vision, 65, 43-72.
44. Najman, L., & Schmitt, M. (1996). Geodesic saliency of watershed contours and hierarchical segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(12), 1163-1173.
45. Negahdaripour, S., & Madjidi, H. (2003a, September). Robust optical flow estimation using underwater color images. In MTS/IEEE OCEANS Conference, San Diego, CA (vol. 4, pp. 2309-2316).
46. Negahdaripour, S., & Madjidi, H. (2003b). Stereovision imaging on submersible platforms for 3-D mapping of benthic habitats and sea-floor structures. IEEE Journal of Oceanic Engineering, 28(4), 625-650.
47. Negahdaripour, S., Xu, X., Khamene, A., & Awan, Z. (1998, August). 3-D motion and depth estimation from sea-floor images for mosaic-based station-keeping and navigation of ROVs/AUVs and high-resolution sea-floor mapping. In Workshop on Autonomous Underwater Vehicles AUV, Cambridge, MA (pp. 191-200).
48. Nicosevici, T., Garcia, R., Negahdaripour, S., Kudzinava, M., & Ferrer, J. (2007, April). Identification of suitable interest points using geometric photometric cues in motion video for efficient 3-D environmental modeling. In IEEE International Conference on Robotics and Automation, Rome, Italy (pp. 4969-4974).
49. Nicosevici, T., Negahdaripour, S., & Garcia, R. (2005, September). Monocular-based 3-D seafloor reconstruction and ortho-mosaicing by piecewise planar representation. In MTS/IEEE OCEANS Conference, Washington, DC (vol. 2, pp. 1279-1286).
50. Pizarro, O. (2004). Large scale structure from motion for autonomous underwater vehicle surveys. Ph.D. thesis, Massachusetts Institute of Technology.
51. Pizarro, O., Eustice, R., & Singh, H. (2004, November). Large area 3D reconstructions from underwater surveys. In MTS/IEEE OCEANS Conference, Kobe, Japan (pp. 678-687).
52. Robert, L., & Faugeras, O. D. (1993, May). Relative 3D positioning and 3D convex hull computation from a weakly calibrated stereo pair. In International Conference on Computer Vision, Berlin, Germany (pp. 540-544).
53. Rossignac, J., & Borrel, P. (1993). Multi-resolution 3D approximations for rendering complex scenes. Geometric Modeling in Computer Graphics (pp. 455-465). Berlin: Springer-Verlag.
54. Roy, S. (1999). Stereo without epipolar lines: A maximum flow formulation. International Journal of Computer Vision, 1(2), 1-15.
55. Ruiz, I. T., de Raucourt, S., Petillot, Y., & Lane, D. M. (2004). Concurrent mapping and localization using sidescan sonar. IEEE Journal of Oceanic Engineering, 29(2), 442-456.
56. Sampson, P. D. (1982). Fitting conic sections to "very scattered" data: An iterative refinement of the Bookstein algorithm. Computer Vision, Graphics and Image Processing, 18, 97-108.
57. Schroeder, W., Zarge, J., & Lorenson, W. (1992, July). Decimation of triangle meshes. In SIGGRAPH, Chicago, IL vol. 26, pp. 65-70).
58. Sheffer, A., Praun, E., & Rose, K. (2006). Mesh parameterization methods and their applications. Foundations and Trends in Computer Graphics and Vision, 2(2), 227-232.
59. Snavely, N., Seitz, S. M., & Szeliski, R. (2008). Modeling the world from internet photo collections. International Journal of Computer Vision, 80(2), 189-210.
60. Stone, W. C., Greenberg, R. J., Durda, D. D., & Franke, E. A. (2005, March). The DEPTHX Project: Pioneering technologies for exploration of extraterrestrial aqueous channels. In 36th Annual Lunar and Planetary Science Conference, League City, TX.
61. Strasser, W. (1974). Flaechendarstellung auf graphischen Sichtgeraeten. Ph.D. thesis, TU Berlin.
62. Vincent, L., & Soille, P. (1991). Watersheds in digital spaces: An efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(6), 583-598.
63. Williams, S. B., & Mahon, I. J. (2004, September). Design of an unmanned underwater vehicle for reef surveying. In 3rd IFAC Symposium on Mechatronic Systems, Sydney, Australia.
64. Xu, A., Sun, S., & Xu, K. (2005, August). Texture information driven triangle mesh simplification. In Computer Graphics and Imaging, Honolulu, HI (pp. 43-48).
65. Yoerger, D. R., Jakuba, M., Bradley, A. M., & Bingham, B. (2007). Techniques for deep sea near bottom survey using an autonomous underwater vehicle. International Journal of Robotics Research, 26(2), 41-54.
66. Zhang, Z. (1994). Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision, 13, 119-152.
67. Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1330-1334.
68. Zigelman, G., Kimmel, R., & Kiryati, N. (2002). Texture mapping using surface flattening via multidimensional scaling. IEEE Transactions on Visualization and Computer Graphics, 8(2), 198-207.