Integration of UAV-based photogrammetry and terrestrial laser scanning for the three-dimensional mapping and monitoring of open-pit mine areas

Remote Sensing

Volumn 7, Issue 6, 2015, Pages 6635-6662

  Tong, Xiaohua ^a   Liu, Xiangfeng ^a   Chen, Peng ^a   Liu, Shijie ^a   Luan, Kuifeng ^a   Li, Lingyun ^a   Liu, Shuang ^a   Liu, Xianglei ^a   Xie, Huan ^a   Jin, Yanmin ^a   Hong, Zhonghua ^a  

^a TONGJI UNIVERSITY   (China)

Author keywords

Accuracy; Geo positioning; Open pit mine areas; Photogrammetric processing; Terrestrial laser scanning (TLS); Unmanned aerial vehicle (UAV)

Indexed keywords

AERIAL PHOTOGRAPHY; GLOBAL POSITIONING SYSTEM; IMAGE ACQUISITION; IMAGE PROCESSING; INTEGRATION; LAND RECLAMATION; LASER APPLICATIONS; MAPPING; OBJECT RECOGNITION; PHOTOGRAMMETRY; ROCK MECHANICS; SCANNING; SEEBECK EFFECT; STEEL BEAMS AND GIRDERS; STEREO IMAGE PROCESSING; SURFACE ANALYSIS; SURVEYING INSTRUMENTS; SURVEYS; UNMANNED AERIAL VEHICLES (UAV);

ACCURACY; GEO-POSITIONING; OBJECT BASED IMAGE ANALYSIS; OBJECT ORIENTED CLASSIFICATION; OPEN PIT; SCALE INVARIANT FEATURE TRANSFORMS; TERRESTRIAL LASER SCANNING; THREE DIMENSIONAL MAPPING;

OPEN PIT MINING;

EID: 84933575462     PISSN: None     EISSN: 20724292     Source Type: Journal    
DOI: 10.3390/rs70606635     Document Type: Article

References (70)

1. American Institute of Aeronautics and Astronautics (AIAA). Committee of Standards "Terminology for Unmanned Aerial Vehicles and Remotely Operated Aircraft"; AIAA: Reston, VA, USA, 2004.
2. Zhou, G.Q. Geo-referencing of video flow from small low-cost civilian UAV. IEEE Trans. Autom. Sci. Eng. 2010, 7, 156-166.
3. Turner, D.; Lucieer, A.; Watson, C. An automated technique for generating georectified mosaics from ultra-high resolution unmanned aerial vehicle (UAV) imagery, based on Structure from Motion (SfM) point clouds. Remote Sens. 2012, 4, 1392-1410.
4. Blyenburgh, P.V. UAVs: An overview. Air Space Eur. 1999, 1, 43-47.
5. Rango, A.; Laliberte, A.; Steele, C.; Herrick, J.E.; Bestelmeyer, B.; Schmugge, T.; Roanhorse, A.; Jenkins, V. Using unmanned aerial vehicles for rangelands: Current applications and future potentials. Environ. Pract. 2006, 8, 159-168.
6. Vericat, D.; Brasington, J.; Wheaton, J.; Cowie, M. Accuracy assessment of aerial photographs acquired using lighter-than-air blimps: Low-cost tools for mapping river corridors. River. Res. Applic. 2009, 25, 985-1000.
7. Chiabrando, F.; Nex, F.; Piatti, D.; Rinaudo, F. UAV and RPV systems for photogrammetric surveys in archaelogical areas: Two tests in the Piedmont region (Italy). J. Archaeol. Sci. 2011, 38, 697-710.
8. Watts, A.C.; Ambrosia, V.G.; Hinkley, E.A. Unmanned aircraft systems in remote sensing and scientific research: Classification and considerations of use. Remote Sens. 2012, 4, 1671-1692.
9. Nagai, M.; Chen, T.; Shibasaki, R.; Kumugai, H.; Ahmed, A. UAV-borne 3-D mapping system by multisensory integration. IEEE Trans. Geosci. Remote Sens. 2009, 47, 701-708.
10. Laliberte, A.S.; Herrick, J.E.; Rango, A.; Winters, C. Acquisition, orthorectification, and object-based classification of unmanned aerial vehicle (UAV) imagery for rangeland monitoring. Photogramm. Eng. Remote Sens. 2010, 76, 661-672.
11. Rango, A.; Laliberte, A.S. Impact of flight regulations on effective use of unmanned aircraft systems for natural resources applications. J. Appl. Remote Sens. 2010, 4, 043539.
12. Peterson, D.L.; Brass, J.A.; Smith, W.H.; Langford, G.; Wegener, S.; Dunagan, S.; Hammer, P.; Snook, K. Platform options of free-flying satellites, UAVs or the International Space Station for remote sensing assessment of the littoral zone. Int. J. Remote Sens. 2003, 24, 2785-2804.
13. Wang, J.Z.; Li, C.M. Acquisition of UAV images and the application in 3D city modeling. Proc. SPIE 2008, doi:10.1117/12.791426.
14. Eisenbeiss, H. UAV Photogrammetry. Ph.D. Thesis, University of Technology Dresden, Dresden, Germany, 2009.
15. Laliberte, A.S.; Rango, A. Texture and scale in object-based analysis of subdecimeter resolution unmanned aerial vehicle (UAV) imagery. IEEE Trans. Geosci. Remote Sens. 2009, 47, 761-770.
16. Zhang, Y.J.; Xiong, J.X.; Hao, L.J. Photogrammetric processing of low-altitude images acquired by unpiloted aerial vehicles. Photogramm. Rec. 2011, 26, 190-211.
17. Przybilla, H.-J.; Wester-Ebbinghaus, W. Bildflug Mit Ferngelenktem Kleinflugzeug. In Bildmessung und Luftbildwesen; Zeitschrift fuer Photogrammetrie und Fernerkundung, Herbert Wichman Verlag: Karlsruhe, Germany, 1979; Volume 47, pp. 137-142.
18. Herwitz, S.R.; Johnson, L.F.; Dunagan, S.E.; Higgins, R.G.; Sullivan, D.V.; Zheng, J.; Lobitz, B.M.; Leung, J.G.; Gallmeyer, B.A.; Aoyagi, M.; et al. Imaging from an unmanned aerial vehicle: Agricultural surveillance and decision support. Comput. Electron. Agric. 2004, 44, 49-61.
19. Xiang, H.; Tian, L. Development of a low-cost agricultural remote sensing system based on an autonomous unmanned aerial vehicle (UAV). Biosyst. Eng. 2011, 108, 174-190.
20. Wallace, L.; Lucieer, A.; Watson, C.; Turner, D. Development of a UAV-LiDAR system with application to forest inventory. Remote Sens. 2012, 4, 1519-1543.
21. Watai, T.; Machida, T.; Ishizaki, N.; Inoue, G. A lightweight observation system for atmospheric carbon dioxide concentration using a small unmanned aerial vehicle. J. Atmos. Ocean. Technol. 2006, 23, 700-710.
22. McGonigle, A.J.S.; Aiuppa, A.; Giudice, G.; Tamburello, G.; Hodson, A.J.; Gurrieri, S. Unmanned aerial vehicle measurements of volcanic carbon dioxide fluxes. Geophys. Res. Lett. 2008, 35, L06303.
23. Hardin, P.J.; Jensen, R.R. Small-scale unmanned aerial vehicles in environmental remote sensing: Challenges and opportunities. GISci. Remote Sens. 2011, 48, 99-111.
24. Khan, A.; Schaefer, D.; Tao, L.; Miller, D.J.; Sun, K.; Zondlo, M.A.; Harrison, W.A.; Roscoe, B.; Lary, D.J. Low power greenhouse gas sensors for unmanned aerial vehicles. Remote Sens. 2012, 4, 1355-1368.
25. Zhang, Z.X.; Zhang, Y.J.; Ke, T.; Guo, D.H. Photogrammetry for first response in Wenchuan earthquake. Photogramm. Eng. Remote Sens. 2009, 75, 510-513.
26. Zhou, G.Q. Near real-time orthorectification and mosaic of small UAV video flow for time-critical event response. IEEE Trans. Geosci. Remote Sens. 2009, 47, 739-747.
27. Niethammer, U.; James, M.R.; Rothmund, S.; Travelletti, J.; Joswig, M. UAV-based remote sensing of the Super-Sauze landslide: Evaluation and results. Eng. Geol. 2012, 128, 2-11.
28. Marzolff, I.; Poesen, J. The potential of 3D gully monitoring with GIS using high-resolution aerial photography and a digital photogrammetry system. Geomorphology 2009, 111, 48-60.
29. Verhoeven, G.J.J.; Loenders, J.; Vermeulen, F.; Docter, R. Helikite aerial photography-A versatile means of unmanned, radio controlled, low-altitude aerial archaeology. Archaeol. Prospect. 2009, 16, 125-138.
30. Eisenbeiss, H; Sauerbier, M. Investigation of UAV systems and flight modes for photogrammetric applications. Photogramm. Rec. 2011, 26, 400-421.
31. Salvini, R.; Riccucci, S.; Gullì, D.; Giovannini, R.; Vanneschi, C.; Francioni, M. Geological Application of UAV photogrammetry and terrestrial laser scanning in Marble Quarrying (Apuan Alps, Italy). In Engineering Geology for Society and Territory-Urban Geology, Sustainable Planning and Landscape Exploitation; Springer International Publishing: Cham, Switzerland, 2015; Volume 5, pp. 979-983.
32. Shan, B.; Luo, X.; Liang, L. Application of UAV in open-pit mine disaster monitoring. Opencast Min. Technol. 2013, 6, 69-71.
33. González-Aguilera, D.; Fernández-Hernández, J.; Mancera-Taboada, J.; Rodríguez-Gonzálvez, P.; Hernández-López, D.; Felipe-García, B.; Arias-Perez, B. 3D modelling and accuracy assessment of granite quarry using unmannend aerial vehicle. In Proceedings of the ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, Melbourne, VIC, Australia, 25 August-1 September 2012; Volume I-3, pp. 37-42.
34. McLeod, T.; Samson, C.; Labrie, M.; Shehata, K.; Mah, J.; Lai, P.; Wang, L.; Elder, J. Using video data acquired from an unmanned aerial vehicle to measure fracture orientation in an open-pit mine. Geomatica 2013, 67, 163-171.
35. Harwin, S.; Lucieer, A. Assessing the accuracy of georeferenced point clouds produced via multi-view stereopsis from unmanned aerial vehicle (UAV) imagery. Remote Sens. 2012, 4, 1573-1599.
36. Rosnell, T.; Honkavaara, E. Point cloud generation from aerial image data acquired by a quadrocopter type micro unmanned aerial vehicle and a digital still camera. Sensors 2012, 12, 453-480.
37. Wang, J.P.; Gao, J.X.; Liu, C.; Wang, J. High precision slope deformation monitoring model based on the GPS/Pseudolites technology in open-pit mine. Min. Sci. Technol. (China) 2010, 20, 126-132.
38. Lowe, D.G. Object recognition from local scale-invariant features. In Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, 20-27 September 1999, Volume 2, pp. 1150-1157.
39. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM. 1981, 24, 381-395.
40. Kraus, K. Photogrammetry: Geometry from Images and Laser Scans; Walter de Gruyter: Goettingen, Germany, 2007.
41. Fraser, C.S. Digital camera self-calibration. ISPRS J. Photogramm. Remote Sens. 1997, 52, 149-159.
42. Skaloud, J. Optimizing Georeferencing of Airborne Survey Systems by INS/DGPS. Ph.D. Thesis, The University of Calgary, Calgary, Alberta, 1999.
43. Kocaman, S. GPS and INS Integration with kalman Filtering for Direct Georeferencing of Airborne Imagery. Ph.D. Thesis, Institute of Geodesy and Photogrammetry, ETH Hönggerberg, Zurich, Switzerland, 2003.
44. Tong, X.H.; Hong, Z.H.; Liu, S.J.; Zhang, X.; Xie, H.; Li, Z.Y.; Yang, S.L.; Wang, W.; Bao, F. Building-damage detection using pre-and post-seismic high-resolution satellite stereo imagery: A case study of the May 2008 Wenchuan earthquake. ISPRS J. Photogramm. Remote Sens. 2012, 68, 13-27.
45. Xiang, H.; Tian, L. Method for automatic georeferencing aerial remote sensing (RS) images from an unmanned aerial vehicle (UAV) platform. Biosyst. Eng. 2011, 108, 104-113.
46. Lichti, D.; Gordon, S. Error propagation in directly georeferenced terrestrial laser scanner point clouds for cultural heritage recording. In Proceedings of the FIG Working Week, Athens, Greece, 22-27 May 2004.
47. Reshetyuk, Y. Self-Calibration and Direct Georeferencing in Terrestrial Laser Scanners. Ph.D. Thesis, Royal Institute of Technology, Stockholm, Sweden, 2009.
48. Harvey, B.R. Registration and transformation of multiple site terrestrial laser scanning. Geomat. Res. Aust. 2004, 80, 33-50.
49. Wang, Y.; Wang, G. Integrated registration of range images from terrestrial LiDAR. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2008, XXXVII, Part B3b, pp. 361-365.
50. Hodge, R.A. Using simulated terrestrial laser scanning to analyse errors in high-resolution scan data of irregular surfaces. ISPRS J. Photogramm. Remote Sens. 2010, 65, 227-240.
51. Zhang, Y.; Gong, L.; Yan, L. Research on error propagation of point cloud registration. In Proceedings of the 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE), Zhangjiajie, China, 25-27 May 2012; Volume 2, pp. 18-21.
52. Lingua, A.; Marenchino, D.; Nex, F. Performance analysis of the SIFT operator for automatic feature extraction and matching in photogrammetric applications. Sensors 2009, 9, 3745-3766.
53. Hartley, R.; Zisserman, A. Multiple View Geometry in Computer Vision, 2nd ed.; Cambridge University Press: New York, NY, USA, 2004.
54. Pesci, A.; Fabris, M.; Conforti, D.; Loddo, F.; Baldi, P.; Anzidei, M. Integration of ground-based laser scanner and aerial digital photogrammetry for topographic modelling of Vesuvio volcano. J. Volcanol. Geotherm. Res. 2007, 162, 123-138.
55. Baltsavias, E.P. A comparison between photogrammetry and laser scanning. ISPRS J. Photogramm. Remote Sens. 1999, 54, 83-94.
56. Wang, J.; Di, K.; Li, R. Evaluation and improvement of geopositioning accuracy of IKONOS stereo imagery. J. Surv. Eng. 2005, 131, 35-42.
57. Tong, X.H.; Liang, D.; Xu, G.S.; Zhang, S.L. Positional accuracy improvement: A comparative study in Shanghai, China. Int. J. Geogr. Inf. Sci. 2011, 25, 1147-1171.
58. Tong, X.H.; Liu, S.J.; Weng, Q.H. Bias-corrected rational polynomial coefficients for high accuracy geo-positioning of QuickBird stereo imagery. ISPRS J. Photogramm. Remote Sens. 2010, 65, 218-226.
59. Liu, S.J.; Fraser, C.S.; Zhang, C.S.; Ravanbakhsh, M.; Tong, X.H. Georeferencing performance of THEOS satellite imagery. Photogramm. Rec. 2011, 26, 250-262.
60. Henry, J.B.; Malet, J.-P.; Maquaire, O.; Grussenmeyer, P. The use of small-format and low-altitude aerial photos for the realization of high-resolution DEMs in mountainous areas: Application to the Super-Sauze earthflow (Alpes-de-Haute-Provence, France). Earth Surf. Process. Landf. 2002, 27, 1339-1350.
61. Guarnieri, A.; Remondino, F.; Vettore, A. Digital photogrammetry and TLS data fusion applied to cultural heritage 3D modelling. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2006, XXXVI, Part 5.
62. Burnett, C.; Blaschke, T. A multi-scale segmentation/object relationship modeling methodology for landscape analysis. Ecol. Model. 2003, 168, 233-249.
63. Yu, Q.; Gong, P.; Clinton, N.; Biging, G.; Kelly, M.; Schirokauer, D. Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery. Photogramm. Eng. Remote Sens. 2006, 72, 799-811.
64. Laliberte, A.S.; Rango, A. Image processing and classification procedures for analysis of sub-decimeter imagery acquired with an unmanned aircraft over arid rangelands. GISci. Remote Sens. 2011, 48, 4-23.
65. Laliberte, A.S.; Winters, C.; Rango, A. UAS remote sensing missions for rangeland applications. Geocarto Int. 2011, 26, 141-156.
66. Definiens. eCognition Developer 8.0 User Guide; Definiens AG.: Munich, Germany, 2009.
67. Stumpf, A.; Kerle, N. Object-oriented mapping of landslides using random forests. Remote Sens. Environ. 2011, 115, 2564-2577.
68. Congalton, R.G.; Green, K. Assessing the Accuracy of Remotely Sensed Data: Principles and Practices; CRC Press: Boca Raton, FL, USA, 2009.
69. Tong, X.; Li, X.; Xu, X.; Xie, H.; Feng, T.; Sun, T.; Jin, Y.; Liu, X. A two-phase classification of urban vegetation using airborne LiDAR data and aerial photography. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2014, doi:10.1109/JSTARS.2014.2312717.
70. Dunford, R.; Michel, K.; Gagnage, M.; Piégay, H.; Trémelo, M.L. Potential and constraints of unmanned aerial vehicle technology for the characterization of Mediterranean riparian forest. Int. J. Remote Sens. 2009, 30, 4915-4935.