Dense height map estimation from oblique aerial image sequences

Computer Vision and Image Understanding

Volumn 109, Issue 2, 2008, Pages 204-225

  Le Besnerais, G ^a   Sanfourche, M ^a   Champagnat, F ^a  

^a ONERA   (France)

Author keywords

Geometric calibration; Images sequence analysis; Occlusions; Structure from motion; Surface reconstruction

Indexed keywords

COLLISION AVOIDANCE; DIGITAL SIGNAL PROCESSING; PHOTOGRAMMETRY; PIXELS; SURFACE RECONSTRUCTION; TRACKING (POSITION);

DIGITAL SURFACE MODEL; GEOMETRIC CALIBRATION; IMAGES SEQUENCE ANALYSIS; TRAJECTORY PLANNING;

IMAGE SEGMENTATION;

EID: 37849006369     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.07.003     Document Type: Article

References (52)

1. D. Canu, N. Ayache, J. Sirat, Accurate and robust stereovision with a large number of aerial images, in: European Symposium on Satellite Remote Sensing, 1995, pp. 152-160.
2. Paparoditis N., Maillet G., Taillandier F., Jibrini H., Guigues L., and Boldo D. Multi-image 3d feature and DSM extraction for change detection and building reconstruction. In: Baltsavias E., Grün A., and Van Gool L. (Eds). Automatic Extraction of Man-made Objets from Aerial and Satellite Images (III) (2001), Balkema Publishers, The Netherlands 217-230
3. Cochran S. Adaptive vergence for the stero matching of oblique imagery. Journal of photogrammetry and remote sensing 50 4 (1995) 21-28
4. A. Moe, Passive Aircraft Altitude Estimation using Computer Vision, Lic. Thesis LiU-Tek-Lic-2000:43, Dept. EE, Linköping University, SE-581 83 Linköping, Sweden, thesis No. 847, ISBN 91-7219-827-3, Sep. 2000.
5. P. Fabiani, A. Piquereau, V. Fuertes, P.-M. Passet, The ReSSAC autonomous rotorcraft: from autonomy demonstration to out-of-sight flights, in: Proceedings of AHS Specialists meeting on Unmanned Rotorcraft, Chandler in Arizona, USA, 2005.
6. P. Fabiani, V. Fuertes, A. Piquereau, R. Mampey, F. Teicheteil-Königsbuch, The ReSSAC autonomous exploration aircraft project, in: 3ème journée ROBEA, Montpellier, France, 2005.
7. M. Sanfourche, G. Le Besnerais, S. Philipp-Foliguet, Height estimation using aerial side looking image, in: Photogrammetric Image Analysis, vol. 34, ISPRS, München, Germany, 2003.
8. M. Sanfourche, G. Le Besnerais, F. Champagnat, On the choice of correlation term for multi-baseline stereo-vision, in: British Machine Vision Conference, vol. 2, BMVA, Kingston upon Thames, United Kingdom, 2004, pp. 697-706.
9. Rudin L.I., Osher S., and Fatemi E. Nonlinear total variation based noise removal algorithms. Physics D 60 (1992) 259-268
10. Y. Nakamura, T. Matsuura, K. Satoh, Y. Ohta, Occlusion detectable stereo-occlusion patterns in camera matrix, in: Conference on Computer Vision and Pattern Recognition, San Francisco, USA, 1996, pp. 371-378.
11. S. Kang, R. Szeliski, J. Chai, Handling occlusions in dense multi-view stereo, in: Conference on Computer Vision and Pattern Recognition, vol. 1, 2001, pp. 103-110.
12. Park S.C., Park M.K., and Kang M.G. Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20 3 (2003) 21-36
13. Faugeras O., Laveau S., Robert L., Csurka G., and Zeller C. 3-d reconstruction of urban scene from sequences of images. In: Gruen K., and Agouris P. (Eds). Automatic Extraction of Man-made Objects from Aerial and Space Images (1995), BirkhSuser-Verlag, Ascona, Switzerland 145-168
14. R. Koch, M. Pollefeys, L. Van Gool, Multi viewpoint stereo from uncalibrated video sequences, in: European Conference on Computer Vision, vol. 1, Freibourg, Germany, 1998, pp. 55-71.
15. M. Pollefeys, R. Koch, L. Van Gool, Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters, in: International Conference on Computer Vision, Bombay, India, 1998, pp. 90-95.
16. Lhuillier M., and Quan L. A quasi-dense approach surface reconstruction from uncalibrated images. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 (2005) 418-433
17. Paris S., Sillion F., and Quan L. A surface reconstruction method using global graph cut optimization. International Journal of Computer Vision 66 2 (2006) 141-161
18. K. Hanna, Direct multi-resolution estimation of ego-motion and structure from motion, in: Workshop on Visual Motion, 1991, pp. 156-162.
19. J. Bergen, P. Anandan, K. Hanna, R. Hingorani, Hierarchical model-based motion estimation, in: European Conference on Computer Vision, Santa Margherita Ligure, Italy, 1992, pp. 237-252.
20. K. Hanna, N. Okamoto, Combining stereo and motion analysis for direct estimation of scene structure, in: International Conference on Computer Vision, Berlin, Germany, 1993, pp. 357-365.
21. R. Mandelbaum, G. Salgian, H. Sawhney, Correlation-based estimation of ego-motion and structure from motion and stereo, in: International Conference on Computer Vision, Corfu, Greece, 1999, pp. 544-550.
22. K. Wong, Basic mathematics of photogrammetry, in: C. Slama (Ed.), Manual of Photogrammetry, fourth ed., American Society for Photogrammetry and Remote Sensing, 1994.
23. B. Triggs, P. McLauchlan, R. Hartley, A. Fitzgibbon, Bundle adjustment-a modern synthesis, in: Vision Algorithms: Theory and Practice, 1999, pp. 298-375.
24. M. Lourakis, A. Argyros, The design and implementation of a generic sparse bundle adjustment software package based on the levenberg-marquardt algorithm, Tech. Rep. 340, Institute of Computer Science-FORTH, Heraklion, Crete, Greece, Available from: , Aug. 2004.
25. S. Roy, I. Cox, A maximum-flow formulation of the n-camera correspondence problem, in: International Conference on Computer Vision, Bombay, India, 1998, pp. 492-502.
26. R. Szeliski, Scene reconstruction from multiple cameras, in: Proceedings of IEEE ICIP'00, Vancouver, BC, Canada, 2000, pp. 13-16.
27. V. Kolmogorov, R. Zabih, S. Gortler, Generalized multi-camera scene reconstruction using graph-cuts, in: Proceedings of EMMCVPR'03, Lisbon, Portugal, 2003, pp. 501-516.
28. A. Yao, A. Calway, Interpolating novel views from image sequences by probabilistic depth carving, in: European Conference on Computer Vision, vol. 2, Prague, Czech Republic, 2004, pp. 379-390.
29. M.-A. Drouin, M. Trudeau, S. Roy, Geo-consistency for wide multi-camera stereo, in: Proceedings of CVPR'05, vol. 1, San-Diego, CA, 2005, pp. 351-358.
30. P. Gargallo, P. Sturm, Bayesian 3d modeling from images using multiple depth-maps, in: Proceedings of CVPR'05, vol. 2, San-Diego, CA, 2005, pp. 885-891.
31. S. Seitz, B. Curless, J. Diebel, D. Scharstein, R. Szeliski, A comparison and evaluation of multi-view stereo reconstruction algorithms, in: Proceedings of CVPR'06, New York, NY, 2006, pp. 519-526.
32. Paparoditis N., Cord M., Jordan M., and Cocquerez J.-P. Building detection and reconstruction from mid and high resolution aerial images. Journal of Computer Vision and Image Understanding 72 (1998) 122-142
33. O. Veksler, Efficient graph based energy minimization methods in computer vision, Ph.D. thesis, Cornel University, 1999.
34. Sun J., Zheng N.-N., and Schum H.Y. Stereo matching using belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 7 (2003) 769-778
35. S. Paris, F. Sillion, Robust acquisition of 3d informations from short image sequences, in: Pacific graphics, Beijing, China, 2002.
36. Seitz S., and Dyer C. Photorealistic scene reconstruction by voxel coloring. International Journal of Computer Vision 35 2 (1999) 151-173
37. Kutulakos K., and Seitz S. A theory of shape by space carving. International Journal of Computer Vision 38 3 (2000) 199-218
38. A. Broadhurst, R. Cipolla, A statistical consistency check for the space carving algorithm, in: BMVC, BMVA, Bristol, United Kingdom, 2000, pp. 282-291.
39. M. Agrawal, L. Davis, A probabilistic framework for surface reconstruction from multiple images, in: Conference on Vision and Pattern Recognition, vol. 2, Kauai, Hawaï, 2001, pp. 470-476.
40. R. Collins, A space-sweep approach to true multi-image matching, in: Conference on Computer Vision and Pattern Recognition, San Francisco, USA, 1996, pp. 358-363.
41. Shi J., and Tomasi C. Good features to track. Conference on Computer Vision and Pattern Recognition (1994), IEEE, Seattle, USA 593-600
42. S. Birchfield, Download website for klt tracker, Available from: , 1999.
43. R. Szeliski, S.B. Kang, Recovering 3d shape and motion from image streams using non linear least squares, Tech. Rep. CRL93/3, Cambridge research laboratory, Digital equipment corporation, March 1993.
44. Okutomi M., and Kanade T. A multiple-baseline stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence 15 4 (1993) 353-363
45. Demoment G. Image reconstruction and restoration: overview of common estimation structure and problems. IEEE Transactions on Acoustics, Speech and Signal Processing ASSP-37 12 (1989) 2024-2036
46. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame stereocorrespondence algorithms. International Journal of Computer Vision 47 1/2/3 (2002) 7-42
47. Y. Boykov, V. Kolmogorov, An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision, in: EMMCVPR'2001, 2001, pp. 359-374.
48. H. Ishikawa, Optimization using embedded graphs, Ph.D. thesis, New York University, Mai 2000.
49. Winkler G., Aurich V., Hahn K., and Martin A. Noise reduction in images: some recent edge-preserving methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 9 4 (1999) 749-766
50. B. Géraud, G. Le Besnerais, G. Foulon, Determination of dense depth map from an image sequence: application to aerial imagery, in: European Symposium on Remote Sensing, Image and Signal processing for Remote sensing, vol. IV, 1998.
51. Rochefort G., Champagnat F., Le Besnerais G., and Giovannelli J.-F. An improved observation model for super-resolution under affine motion. IEEE Transactions on Image Processing 15 11 (2006) 3325-3337
52. Le Besnerais G., and Champagnat F. Dense optical flow estimation by iterative local window registration. Proceedings of ICIP'05 (2005), IEEE, Genova, Italy 4p