Spatiotemporal inferences for use in building detection using series of very-high-resolution space-borne stereo images

International Journal of Remote Sensing

Volumn 37, Issue 15, 2016, Pages 3455-3476

  Qin, Rongjun ^a   Tian, Jiaojiao ^b   Reinartz, Peter ^b  

^a FUTURE CITIES LABORATORY   (Singapore)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BUILDINGS; CLASSIFICATION (OF INFORMATION); EXTRACTION; IMAGE ENHANCEMENT; PIXELS; PROBABILITY; REMOTE SENSING;

AUTOMATIC BUILDING DETECTION; DIGITAL SURFACE MODELS; RECEIVER OPERATING CHARACTERISTICS; REMOTE SENSING IMAGE INTERPRETATIONS; SOURCES OF UNCERTAINTY; SPATIO-TEMPORAL INFERENCE; SPECTRAL INFORMATION; VERY HIGH RESOLUTION;

STEREO IMAGE PROCESSING;

BUILDING; DETECTION METHOD; IMAGE RESOLUTION; PATTERN RECOGNITION; REMOTE SENSING; SATELLITE IMAGERY; STEREO IMAGE;

EID: 84957892059     PISSN: 01431161     EISSN: 13665901     Source Type: Journal    
DOI: 10.1080/01431161.2015.1066527     Document Type: Article

References (58)

1. D.Akca,, M.Freeman, I.Sargent, and A.Gruen. 2010. “Quality Assessment of 3D Building Data.” The Photogrammetric Record 25 (132): 339–355. doi:10.1111/phor.2010.25.issue-132.
2. J.A.Benediktsson,, M.Pesaresi, and K.Amason. 2003. “Classification and Feature Extraction for Remote Sensing Images from Urban Areas Based on Morphological Transformations.” IEEE Transactions on Geoscience and Remote Sensing 41 (9): 1940–1949. doi:10.1109/TGRS.2003.814625.
3. A.Blake,, P.Kohli, and C.Rother. 2011. Markov Random Fields for Vision and Image Processing, 463. Cambridge, MA: The MIT Press.
4. L.Breiman, 2001. “Random Forests.” Machine Learning 45 (1): 5–32. doi:10.1023/A:1010933404324.
5. L.Chen,, S.Zhao, W.Han, and Y.Li. 2012. “Building Detection in an Urban Area Using Lidar Data and QuickBird Imagery.” International Journal of Remote Sensing 33 (16): 5135–5148. doi:10.1080/01431161.2012.659355.
6. P.Coppin,, I.Jonckheere, K.Nackaerts, B.Muys, and E.Lambin. 2004. “Digital Change Detection Methods in Ecosystem Monitoring: A Review.” International Journal of Remote Sensing 25 (9): 1565–1596. doi:10.1080/0143116031000101675.
7. D.Crispell,, J.Mundy, and G.Taubin. 2012. “A Variable-Resolution Probabilistic Three-Dimensional Model for Change Detection.” IEEE Transactions onGeoscience and Remote Sensing 50 (2): 489–500. doi:10.1109/TGRS.2011.2158439.
8. P.d’Angelo,, and P.Reinartz. 2011. “Semiglobal Matching Results on the ISPRS Stereo Matching Benchmark.” ISPRS Hannover Workshop 2011: High-Resolution Earth Imaging for Geospatial Information, 79–84. Hannover, Germany, 14–17June.
9. I.Dópido,, J.Li, P.R.Marpu, A.Plaza, J.Bioucas Dias, and J.A.Benediktsson. 2013. “Semisupervised Self-Learning for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 51 (7): 4032–4044. doi:10.1109/TGRS.2012.2228275.
10. ENVI, 2014. Gram-Schmidt Pan Sharpening. Accessed December 10, 2014. http://www.exelisvis.com/docs/GramSchmidtSpectralSharpening.html.
11. C.S.Fraser,, and H.B.Hanley. 2003. “Bias Compensation in Rational Functions for IKONOS Satellite Imagery.” Photogrammetric Engineering & Remote Sensing 69 (1): 53–57. doi:10.14358/PERS.69.1.53.
12. S.Gehrke,, K.Morin, M.Downey, N.Boehrer, and T.Fuchs. 2010. “Semi-Global Matching: An Alternative to LIDAR for DSM Generation.” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Calgary, AB 38 (B1): 6.
13. D.Grigillo,, M.Kosmatin Fras, and D.Petrovič. 2011. “Automatic Extraction and Building Change Detection from Digital Surface Model and Multispectral Orthophoto.” Geodetski Vestnik 55 (1): 28–45. doi:10.15292/geodetski-vestnik.2011.01.028-045.
14. A.Gruen, 2012. “Development and Status of Image Matching in Photogrammetry.” The Photogrammetric Record 27 (137): 36–57. doi:10.1111/phor.2012.27.issue-137.
15. D.J.Hand,, and R.J.Till. 2001. “A Simple Generalisation of the Area under the ROC Curve for Multiple Class Classification Problems.” Machine Learning 45 (2): 171–186. doi:10.1023/A:1010920819831.
16. M.Herold,, N.C.Goldstein, and K.C.Clarke. 2003. “The Spatiotemporal Form of Urban Growth: Measurement, Analysis and Modeling.” Remote Sensing of Environment 86 (3): 286–302. doi:10.1016/S0034-4257(03)00075-0.
17. H.Hirschmüller, 2005. “Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information.” In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 807–814.
18. H.Hirschmüller, 2008. “Stereo Processing by Semiglobal Matching and Mutual Information.” IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (2): 328–341. doi:10.1109/TPAMI.2007.1166.
19. H.Hirschmüller,, and D.Scharstein. 2009. “Evaluation of Stereo Matching Costs on Images with Radiometric Differences.” IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (9): 1582–1599. doi:10.1109/TPAMI.2008.221.
20. X.Huang,, and L.Zhang. 2011. “A Multidirectional and Multiscale Morphological Index for Automatic Building Extraction from Multispectral Geoeye-1 Imagery.” Photogrammetric Engineering & Remote Sensing 77 (7): 721–732. doi:10.14358/PERS.77.7.721.
21. X.Huang,, and L.Zhang. 2012. “Morphological Building/Shadow Index for Building Extraction from High-Resolution Imagery over Urban Areas.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5 (1): 161–172. doi:10.1109/JSTARS.2011.2168195.
22. X.Huang,, L.Zhang, and W.Gong. 2011. “Information Fusion of Aerial Images and LIDAR Data in Urban Areas: Vector-Stacking, Re-Classification and Post-Processing Approaches.” International Journal of Remote Sensing 32 (1): 69–84. doi:10.1080/01431160903439882.
23. X.Huang,, L.Zhang, and T.Zhu. 2013. “Building Change Detection From Multitemporal High-Resolution Remotely Sensed Images Based on a Morphological Building Index.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing PP (99): 1–11.
24. G.H.Joblove,, and D.Greenberg. 1978. “Color Spaces for Computer Graphics.” Proceedings of ACM SIGGRAPH 1978, 20–25, Atlanta, GA, August23–25.
25. I.Jolliffe, 2005. “Principal Component Analysis.” Encyclopedia of Statistics in Behavioral Science 3 (1): 1580–1584.
26. J.H.Kastens,, and D.R.Legates. 2002. “Time Series Remote Sensing of Landscape-Vegetation Interactions in the Southern Great Plains.” Photogrammetric Engineering & Remote Sensing 68 (10): 1021–1030.
27. T.Krauß,, P.d’Angelo, M.Schneider, and V.Gstaiger. 2013. “The Fully Automatic Optical Processing System CATENA at DLR.” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 177–181. doi:10.5194/isprsarchives-XL-1-W1-177-2013.
28. D.S.Lee,, J.Shan, and J.S.Bethel. 2003. “Class-Guided Building Extraction from Ikonos Imagery.” Photogrammetric Engineering & Remote Sensing 69 (2): 143–150. doi:10.14358/PERS.69.2.143.
29. D.Lu,, P.Mausel, E.Brondizio, and E.Moran. 2004. “Change Detection Techniques.” International Journal of Remote Sensing 25 (12): 2365–2401. doi:10.1080/0143116031000139863.
30. Y.H.Lu,, J.C.Trinder, and K.Kubik. 2006. “Automatic Building Detection Using the Dempster-Shafer Algorithm.” Photogrammetric Engineering & Remote Sensing 72 (4): 395–403. doi:10.14358/PERS.72.4.395.
31. X.Meng,, N.Currit, W.Le, and X.Yang. 2012. “Detect Residential Buildings from Lidar and Aerial Photographs through Object-Oriented Land-Use Classification.” Photogrammetric Engineering and Remote Sensing 78 (1): 35–44. doi:10.14358/PERS.78.1.35.
32. X.Meng,, L.Wang, and N.Currit. 2009. “Morphology-Based Building Detection from Airborne Lidar Data.” Photogrammetric Engineering & Remote Sensing 75 (4): 437–442. doi:10.14358/PERS.75.4.437.
33. A.O.Ok,, C.Senaras, and B.Yuksel. 2013. “Automated Detection of Arbitrarily Shaped Buildings in Complex Environments from Monocular VHR Optical Satellite Imagery.” IEEE Transactions on Geoscience and Remote Sensing 51 (3): 1701–1717. doi:10.1109/TGRS.2012.2207123.
34. F.Pacifici,, N.Longbotham, and W.J.Emery. 2014. “The Importance of Physical Quantities for the Analysis of Multitemporal and Multiangular Optical Very High Spatial Resolution Images.” IEEE Transactions on Geoscience and Remote Sensing 52 (10): 6241–6256. doi:10.1109/TGRS.2013.2295819.
35. F.Petitjean,, J.Inglada, and P.Gançarski. 2012. “Satellite Image Time Series Analysis under Time Warping.” IEEE Transactions onGeoscience and Remote Sensing 50 (8): 3081–3095. doi:10.1109/TGRS.2011.2179050.
36. R.Qin, 2014a. “Change Detection on LOD 2 Building Models with Very High Resolution Spaceborne Stereo Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 96: 179–192. doi:10.1016/j.isprsjprs.2014.07.007.
37. R.Qin, 2014b. “A Mean Shift Vector-Based Shape Feature for Classification of High Spatial Resolution Remotely Sensed Imagery.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. Advance online publication. doi:10.1109/JSTARS.2014.2357832.
38. R.Qin, 2014c. “An Object-Based Hierarchical Method for Change Detection Using Unmanned Aerial Vehicle Images.” Remote Sensing 6 (9): 7911–7932. doi:10.3390/rs6097911.
39. R.Qin,, and W.Fang. 2014. “A Hierarchical Building Detection Method for Very High Resolution Remotely Sensed Images Combined with DSM Using Graph Cut Optimization.” Photogrammetry Engineering and Remote Sensing 80 (8): 37–48. doi:10.14358/PERS.80.9.000.
40. R.Qin,, J.Gong, and C.Fan. 2010. “Multi-Frame Image Super-Resolution Based on Knife-Edges.” In IEEE International Conference on Signal Processing (ICSP), 972–975. Beijing, China. 24–28, October.
41. R.Qin,, J.Gong, H.Li, and X.Huang. 2013. “A Coarse Elevation Map-based Registration Method for Super-resolution of Three-line Scanner Images.” Photogrammetric Engineering & Remote Sensing 79 (8): 717–730. doi:10.14358/PERS.79.8.717.
42. R.Qin,, and A.Gruen. 2014. “3D Change Detection at Street Level Using Mobile Laser Scanning Point Clouds and Terrestrial Images.” ISPRS Journal of Photogrammetry and Remote Sensing 90 (2014): 23–35. doi:10.1016/j.isprsjprs.2014.01.006.
43. F.Rottensteiner,, J.Trinder, S.Clode, and K.Kubik. 2005. “Using the Dempster–Shafer Method for the Fusion of Lidar Data and Multi-Spectral Images for Building Detection.” Information Fusion 6 (4): 283–300. doi:10.1016/j.inffus.2004.06.004.
44. G.Schindler,, and F.Dellaert. 2010. “Probabilistic Temporal Inference on Reconstructed 3d Scenes.” In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, 1410–1417.
45. G.Shafer, 1976. A Mathematical Theory of Evidence, 314. Princeton, NJ: Princeton University Press.
46. B.Sirmacek,, and C.Unsalan. 2011. “A Probabilistic Framework to Detect Buildings in Aerial and Satellite Images.” IEEE Transactions on Geoscience and Remote Sensing 49 (1): 211–221. doi:10.1109/TGRS.2010.2053713.
47. A.Taneja,, L.Ballan, and M.Pollefeys. 2011. “Image Based Detection of Geometric Changes in Urban Environments.” In Proceedings of IEEE International Conference on Computer Vision, 2336–2343. Barcelona, Spain, November 6–13.
48. J.Tian,, S.Cui, and P.Reinartz. 2014. “Building Change Detection Based on Satellite Stereo Imagery and Digital Surface Models.” IEEE Transactions on Geoscience and Remote Sensing 52 (1): 406–417. doi:10.1109/TGRS.2013.2240692.
49. J.Tian,, and P.Reinartz. 2013. “Fusion of Multi-Spectral Bands and DSM from WorldView-2 Stereo Imagery for Building Extraction.” In 2013 Joint Urban Remote Sensing Event (JURSE), Sao Paulo, April 21–23, 135–138.
50. J.Tian,, P.Reinartz, P.d’Angelo, and M.Ehlers. 2013. “Region-Based Automatic Building and Forest Change Detection on Cartosat-1 Stereo Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 79: 226–239. doi:10.1016/j.isprsjprs.2013.02.017.
51. C.Tomasi,, and R.Manduchi. 1998. “Bilateral Filtering for Gray and Color Images.” In International Conference on Computer Vision, 839–846.
52. D.Tuia,, F.Ratle, A.Pozdnoukhov, and G.Camps-Valls. 2010. “Multisource Composite Kernels for Urban-Image Classification.” IEEE Geoscience and Remote Sensing Letters 7 (1): 88–92. doi:10.1109/LGRS.2009.2015341.
53. M.Turker,, and K.San. 2010. “Building Detection from Pan-Sharpened Ikonos Imagery through Support Vector Machines Classification.” In ISPRS Technical Commission VIII Symposium, Networking the World with Remote Sensing International, ISPRS Archives, 841–846.
54. A.Turlapaty,, B.Gokaraju, Q.Du, N.H.Younan, and J.V.Aanstoos. 2012. “A Hybrid Approach for Building Extraction from Spaceborne Multi-Angular Optical Imagery.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5 (1): 89–100. doi:10.1109/JSTARS.2011.2179792.
55. L.Vincent, 1993. “Morphological Grayscale Reconstruction in Image Analysis: Applications and Efficient Algorithms.” IEEE Transactions on Image Processing 2 (2): 176–201. doi:10.1109/83.217222.
56. L.Wang, 2005. Support Vector Machines: Theory and Applications, 431. Berlin: Springer.
57. L.Zhang,, X.Huang, B.Huang, and P.Li. 2006. “A Pixel Shape Index Coupled with Spectral Information for Classification of High Spatial Resolution Remotely Sensed Imagery.” IEEE Transactions on Geoscience and Remote Sensing 44 (10): 2950–2961. doi:10.1109/TGRS.2006.876704.
58. Y.Zhang, 1999. “Optimisation of Building Detection in Satellite Images by Combining Multispectral Classification and Texture Filtering.” ISPRS Journal of Photogrammetry and Remote Sensing 54 (1): 50–60. doi:10.1016/S0924-2716(98)00027-6.