UAV-Based Autonomous Image Acquisition with Multi-view Stereo Quality Assurance by Confidence Prediction

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

Volumn , Issue , 2016, Pages 1-10

  Mostegel, Christian ^a   Rumpler, Markus ^a   Fraundorfer, Friedrich ^a   Bischof, Horst ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; FORECASTING; IMAGE ACQUISITION; IMAGE RECONSTRUCTION; PATTERN RECOGNITION; QUALITY ASSURANCE; UNMANNED AERIAL VEHICLES (UAV);

3D RECONSTRUCTION; AUTONOMOUS SYSTEMS; AUTONOMOUS UNMANNED AERIAL VEHICLES; CONFIDENCE PREDICTIONS; GROUND RESOLUTION; GROUND TRUTH; HIGH RESOLUTION IMAGE; MULTI-VIEW STEREO;

STEREO IMAGE PROCESSING;

EID: 85010204559     PISSN: 21607508     EISSN: 21607516     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2016.8     Document Type: Conference Paper

References (51)

1. A. H. A., B. Sargeant, T. Erfani, S. Robson, M. Shortis, M. Hess, and J. Boehm. Towards fully automatic reliable 3d acquisition: From designing imaging network to a complete and accurate point cloud. Robotics and Autonomous Systems, 62(8):1197-1207, 2014
2. A. H. Ahmadabadian, S. Robson, J. Boehm, and M. Shortis. Image selection in photogrammetric multi-view stereo methods for metric and complete 3d reconstruction. Proc. SPIE, 8791:879107-879107-11, 2013
3. A. H. Ahmadabadian, S. Robson, J. Boehm, and M. Shortis. Stereo-imaging network design for precise and dense 3D reconstruction. The Photogrammetric Record, 29(147):317-336, 2014
4. K. Alexis, C. Papachristos, R. Siegwart, and A. Tzes. Uniform coverage structural inspection path-planning for micro aerial vehicles. In Intelligent Control (ISIC), 2015 IEEE International Symposium on, pages 59-64, Sept 2015
5. A. Bircher, M. Kamel, K. Alexis, M. Burri, P. Oettershagen, S. Omari, T. Mantel, and R. Siegwart. Three-dimensional coverage path planning via viewpoint resampling and tour optimization for aerial robots. Autonomous Robots, pages 1-20, 2015
6. D. J. Butler, J. Wulff, G. B. Stanley, and M. J. Black. A naturalistic open source movie for optical flow evaluation. In European Conference on Computer Vision (ECCV), 2012
7. C. Dornhege, A. Kleiner, and A. Rolling. Coverage search in 3D. In Safety, Security, and Rescue Robotics (SSRR), 2013 IEEE International Symposium on, pages 1-8, Oct 2013
8. E. Dunn and J.-M. Frahm. Next best view planning for active model improvement. In British Machine Vision Conference (BMVC), pages 1-11, 2009
9. B. Englot and F. Hover. Planning complex inspection tasks using redundant roadmaps. In Int. Symp. Robotics Research, 2011
10. C. Forster, M. Pizzoli, and D. Scaramuzza. Appearancebased active, monocular, dense reconstruction for micro aerial vehicles. In Proceedings of Robotics: Science and Systems, Berkeley, USA, July 2014
11. Y. Furukawa and J. Ponce. Accurate, dense, and robust multiview stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 2010
12. E. Galceran, R. Campos, N. Palomeras, D. Ribas, M. Carreras, and P. Ridao. Coverage path planning with real-time replanning and surface reconstruction for inspection of threedimensional underwater structures using autonomous underwater vehicles. Journal of Field Robotics, 32(7):952-983, 2015
13. E. Galceran and M. Carreras. A survey on coverage path planning for robotics. Robotics and Autonomous Systems, 61(12):1258-1276, 2013
14. A. Geiger, P. Lenz, and R. Urtasun. Are we ready for Autonomous Driving The KITTI Vision Benchmark Suite. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012
15. R. Haeusler, R. Nair, and D. Kondermann. Ensemble learning for confidence measures in stereo vision. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 305-312, June 2013
16. S. Haner and A. Heyden. Optimal view path planning for visual SLAM. In Proceedings of the 17th Scandinavian Conference on Image Analysis, SCIA'11, pages 370-380, Ystad, Sweden, 2011. Springer-Verlag
17. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2 edition, Apr. 2004
18. L. Heng, A. Gotovos, A. Krause, and M. Pollefeys. Efficient visual exploration and coverage with a micro aerial vehicle in unknown environments. In IEEE International Conference on Robotics and Automation (ICRA), pages 1071-1078. IEEE, 2015
19. G. A. Hollinger, B. Englot, F. Hover, U. Mitra, and G. S. Sukhatme. Uncertainty-Driven View Planning for Underwater Inspection. In IEEE International Conference on Robotics and Automation (ICRA), 2012
20. C. Hoppe, M. Klopschitz, M. Donoser, and H. Bischof. Incremental surface extraction from sparse structure-frommotion point clouds. In British Machine Vision Conference (BMVC), pages 94-1, 2013
21. C. Hoppe, M. Klopschitz, M. Rumpler, A.Wendel, S. Kluckner, H. Bischof, and G. Reitmayr. Online feedback for structure-from-motion image acquisition. In British Machine Vision Conference (BMVC), volume 2, page 6, 2012
22. C. Hoppe, A. Wendel, S. Zollmann, K. Pirker, A. Irschara, H. Bischof, and S. Kluckner. Photogrammetric camera network design for micro aerial vehicles. In Proceedings of the Computer Vison Winterworkshop, Mala Nedelja, Slovenia, 2012
23. P. Labatut, J.-P. Pons, and R. Keriven. Efficient multi-view reconstruction of large-scale scenes using interest points, delaunay triangulation and graph cuts. In International Conference on Computer Vision (ICCV), pages 1-8, Oct 2007
24. L. Ladick, P. Sturgess, C. Russell, S. Sengupta, Y. Bastanlar, W. Clocksin, and P. Torr. Joint optimization for object class segmentation and dense stereo reconstruction. International Journal of Computer Vision, 100(2):122-133, 2012
25. B. Lau, C. Sprunk, and W. Burgard. Efficient grid-based spatial representations for robot navigation in dynamic environments. Robotics and Autonomous Systems, 61(10):1116-1130, 2013. Selected Papers from the 5th European Conference on Mobile Robots (ECMR 2011)
26. M. Liu, M. Salzmann, and X. He. Discrete-continuous depth estimation from a single image. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 716-723, June 2014
27. R. A. Martin, I. Rojas, K. Franke, and J. D. Hedengren. Evolutionary view planning for optimized uav terrain modeling in a simulated environment. Remote Sensing, 8(1):26, 2016
28. M. Menze and A. Geiger. Object scene flow for autonomous vehicles. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
29. C. Mostegel, M. Rumpler, F. Fraundorfer, and H. Bischof. Using self-contradiction to learn confidence measures in stereo vision. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
30. C. Mostegel, A. Wendel, and H. Bischof. Active Monocular Localization: Towards Autonomous Monocular Exploration for Multirotor MAVs In IEEE International Conference on Robotics and Automation (ICRA), 2014
31. C. Munkelt, A. Breitbarth, G. Notni, and J. Denzler. Multi-View Planning for Simultaneous Coverage and Accuracy Optimisation. In British Machine Vision Conference (BMVC), 2010
32. M. Nieuwenhuisen and S. Behnke. Layered mission and path planning for mav navigation with partial environment knowledge. In Intelligent Autonomous Systems 13, pages 307-319. Springer, 2014
33. M.-G. Park and K.-J. Yoon. Leveraging stereo matching with learning-based confidence measures. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 101-109, June 2015
34. M. Peris, A. Maki, S. Martull, Y. Ohkawa, and K. Fukui. Towards a simulation driven stereo vision system. In International Conference on Pattern Recognition (ICPR), 2012
35. M. Pistellato, F. Bergamasco, A. Albarelli, and A. Torsello. Dynamic Optimal Path Selection for 3D Triangulation with Multiple Cameras. In International Conference on Image Analysis and Processing (ICIAP), pages 468-479. Springer, 2015
36. D. Rainville, J.-P. Mercier, C. Gagné, P. Giguere, D. Laurendeau, et al. Multisensor placement in 3D environments via visibility estimation and derivative-free optimization. In IEEE International Conference on Robotics and Automation (ICRA), pages 3327-3334. IEEE, 2015
37. M. Rothermel, K. Wenzel, D. Fritsch, and N. Haala. SURE: Photogrammetric Surface Reconstruction from Imagery. In Proceedings LC3D Workshop, 2012
38. M. Rumpler, S. Daftry, A. Tscharf, R. Prettenthaler, C. Hoppe, G. Mayer, and H. Bischof. Automated end-to-end workflow for precise and geo-accurate reconstructions using fiducial markers. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2(3):135, 2014
39. S. A. Sadat, J. Wawerla, and R. Vaughan. Fractal trajectories for online non-uniform aerial coverage. In IEEE International Conference on Robotics and Automation (ICRA), pages 2971-2976, May 2015
40. D. Scharstein, H. Hirschmller, Y. Kitajima, G. Krathwohl, N. Nei, X. Wang, and P. Westling. High-resolution stereo datasets with subpixel-accurate ground truth. In X. Jiang, J. Hornegger, and R. Koch, editors, Pattern Recognition, volume 8753 of Lecture Notes in Computer Science, pages 31-42. Springer International Publishing, 2014
41. K. Schmid, H. Hirschmüller, A. Dömel, I. Grixa, M. Suppa, and G. Hirzinger. View Planning for Multi-View Stereo 3D Reconstruction Using an Autonomous Multicopter. Journal of Intelligent and Robotic Systems, 65:309-323, 2012
42. S. Schulter, C. Leistner, P. Wohlhart, P. M. Roth, and H. Bischof. Accurate object detection with joint classification-regression random forests. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014
43. W. R. Scott, G. Roth, and J.-F. Rivest. Pose error effects on range sensing. In 15th International Conference on Vision Interface, 2002
44. W. R. Scott, G. Roth, and J.-F. Rivest. View planning for automated three-dimensional object reconstruction and inspection. ACM Computing Surveys (CSUR), 35:64-96, 2003
45. J. Shotton, M. Johnson, and R. Cipolla. Semantic texton forests for image categorization and segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8, June 2008
46. A. Spyropoulos, N. Komodakis, and P. Mordohai. Learning to detect ground control points for improving the accuracy of stereo matching. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1621-1628, June 2014
47. C. Strecha, W. von Hansen, L. Van Gool, P. Fua, and U. Thoennessen. On benchmarking camera calibration and multi-view stereo for high resolution imagery. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8, June 2008
48. G. H. Tarbox and S. N. Gottschlich. Planning for complete sensor coverage in inspection. Computer Vision and Image Understanding, 61:84-111, 1995
49. M. Trummer, C. Munkelt, and J. Denzler. Online Next-Best-View Planning for Accuracy Optimization Using an Extended E-Criterion. In International Conference on Pattern Recognition (ICPR), pages 1642-1645, 2010
50. J. I. Vasquez-Gomez, L. E. Sucar, and R. Murrieta-Cid. Hierarchical Ray Tracing For Fast Volumetric Next-Best-View Planning. In International Conference on Computer and Robot Vision, 2013
51. H.-H. Vu, P. Labatut, J.-P. Pons, and R. Keriven. High accuracy and visibility-consistent dense multiview stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(5):889-901, May 2012.