Hyperspectral and LiDAR data fusion: Outcome of the 2013 GRSS data fusion contest

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 7, Issue 6, 2014, Pages 2405-2418

  Debes, Christian ^a   Merentitis, Andreas ^a   Heremans, Roel ^a   Hahn, Jurgen ^c   Frangiadakis, Nikolaos ^a   Van Kasteren, Tim ^a   Liao, Wenzhi ^b   Bellens, Rik ^b   Pizurica, Aleksandra ^b   Gautama, Sidharta ^b   Philips, Wilfried ^b   Prasad, Saurabh ^d   Du, Qian ^e   Pacifici, Fabio ^f  

^a AGT Group (RandD) GmbH   (Germany)

^b GHENT UNIVERSITY   (Belgium)

^c DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^d UNIVERSITY OF HOUSTON   (United States)

^e MISSISSIPPI STATE UNIVERSITY   (United States)

^f DigitalGlobe Inc   (United States)

Author keywords

Data fusion; hyperspectral; Light Detection And Ranging (LiDAR); multi modal; urban; VHR imagery

Indexed keywords

DATA FUSION; REMOTE SENSING; SPECTROSCOPY;

HYPERSPECTRAL; LIGHT DETECTION AND RANGING; MULTI-MODAL; URBAN; VHR IMAGERY;

OPTICAL RADAR;

ELEVATION; IMAGE CLASSIFICATION; LIDAR; REMOTE SENSING; SATELLITE IMAGERY; SPATIAL RESOLUTION; SPECTRAL ANALYSIS; SPECTRAL RESOLUTION;

EID: 84905924444     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2014.2305441     Document Type: Article

References (72)

1. S. Prasad and L. Bruce, "Limitations of principal component analysis for hyperspectral target recognition," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 4, pp. 625-629, Oct. 2008.
2. S. Prasad and L. M. Bruce, "Decision fusion with confidence-based weight assignment for hyperspectral target recognition," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1448-1456, May 2008.
3. M. Chi and L. Bruzzone, "Semisupervised classification of hyperspectral images by svms optimized in the primal," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 6, pp. 1870-1880, Jun. 2007. (Pubitemid 46853295)
4. W. Di and M. Crawford, "View generation for multiview maximum disagreement based active learning for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 5, pp. 1942-1954,May 2012.
5. W. Di and M. M. Crawford, "Active learning via multi-view and local proximity co-regularization for hyperspectral image classification," IEEE J. Sel. Topics Signal Process., vol. 5, no. 3, pp. 618-628, Jun. 2011.
6. Y. Tarabalka, M. Fauvel, J. Chanussot, and J. Benediktsson, "SVM-and MRF-based method for accurate classification of hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 736-740, Oct. 2010.
7. D. Tuia, F. Ratle, F. Pacifici, M. Kanevski, and W. Emery, "Active learning methods for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 7, pp. 2218-2232, Jul. 2009.
8. M. Cui, S. Prasad, W. Li, and L. Bruce, "Locality preserving genetic algorithms for spatial-spectral hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 3, pp. 1688-1697, Jun. 2013.
9. S. Serpico and L. Bruzzone, "Anew search algorithm for feature selection in hyperspectral remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 7, pp. 1360-1367, Jul. 1994.
10. A. Plaza, P. Martinez, J. Plaza, and R. Perez, "Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 466-479, Mar. 2005. (Pubitemid 40320269)
11. G. Licciardi, P. R. Marpu, J. Chanussot, and J. A. Benediktsson, "Linear versus nonlinear pca for the classification of hyperspectral data based on the extended morphological profiles," IEEE Geosci. Remote Sens. Lett., vol. 9, no. 3, pp. 447-451, May 2012.
12. M. A. Vaughan, S. A. Young, D. M. Winker, K. A. Powell, A. H. Omar, Z. Liu, Y. Hu, and C. A. Hostetler, "Fully automated analysis of space-based lidar data: An overview of the calipso retrieval algorithms and data products," in Proc. Remote Sens. International Society for Optics and Photonics, 2004, pp. 16-30. (Pubitemid 40565149)
13. T. Brandtberg, T. A. Warner, R. E. Landenberger, and J. B. McGraw, "Detection and analysis of individual leaf-off tree crowns in small footprint, high sampling density lidar data from the eastern deciduous forest in north America," Remote Sens. Environ., vol. 85, no. 3, pp. 290-303, 2003. (Pubitemid 36533256)
14. S. A. White and Y. Wang, "Utilizing DEMs derived from lidar data to analyze morphologic change in the North Carolina coastline," Remote Sens. Environ., vol. 85, no. 1, pp. 39-47, 2003. (Pubitemid 36421080)
15. J. Reitberger, P. Krzystek, and U. Stilla, "Analysis of full waveform lidar data for the classification of deciduous and coniferous trees," Int. J. Remote Sens., vol. 29, no. 5, pp. 1407-1431, 2008. (Pubitemid 351321083)
16. M. Fauvel, J. A. Benediktsson, J. Chanussot, and J. R. Sveinsson, "Spectral and spatial classification of hyperspectral data using SVMs and morphological profile," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 11, pp. 3804-3814, Nov. 2008.
17. G. F. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol. 14, no. 1, pp. 55-63, Jan. 1968.
18. H. Kalluri, S. Prasad, and L. Bruce, "Decision-level fusion of spectral reflectance and derivative information for robust hyperspectral land cover classification," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 4047-4058, Nov. 2010.
19. J. Bao, M. Chi, and J. Benediktsson, "Spectral derivative features for classification of hyperspectral remote sensing images: Experimental evaluation," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 2, pp. 594-601, Apr. 2013.
20. U. G. Mangai, S. Samanta, S. Das, and P. R. Chowdhury, "A survey of decision fusion and feature fusion strategies for pattern classification," ETE Tech. Rev., vol. 27, no. 4, pp. 293-307, 2010.
21. L. Alparone, L. Wald, J. Chanussot, C. Thomas, P. Gamba, and L. Bruce, "Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3012-3021, Oct. 2007.
22. F. Pacifici, F. Del Frate, W. Emery, P. Gamba, and J. Chanussot, "Urban mapping using coarse SAR and optical data: Outcome of the 2007 GRSS data fusion contest," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 3, pp. 331-335, Jul. 2008.
23. G. Licciardi, F. Pacifici, D. Tuia, S. Prasad, T. West, F. Giacco et al., "Decision fusion for the classification of hyperspectral data: Outcome of the 2008 GRS-S data fusion contest," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3857-3865, Nov. 2009.
24. N. Longbotham, F. Pacifici, T. Glenn, A. Zare, M. Volpi, D. Tuia et al., "Multi-modal change detection, application to the detection of flooded areas: Outcome of the 2009-2010 data fusion contest," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 1, pp. 331-342, Feb. 2012.
25. C. Berger, M. Voltersen, R. Eckardt, J. Eberle, T. Heyer, N. Salepci et al., "Multi-modal and multi-temporal data fusion: Outcome of the 2012 GRSS data fusion contest," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 3, pp. 1324-1340, Jun. 2013.
26. A. F. Elakshe, "Fusion of hyperspectral images and lidar-based DEMs for coastal mapping," Optics Lasers Eng., vol. 46, no. 7, pp. 493-498, 2008.
27. A. Swatantrana, R. Dubayaha, D. Robertsb, M. Hoftona, and J. B. Blairc, "Mapping biomass and stress in the Sierra Nevada using lidar and hyperspectral data fusion," Remote Sens. Environ., vol. 115, no. 11, pp. 2917-2930, 2011.
28. M. Shimoni, G. Tolt, C. Perneel, and J. Ahlberg, "Detection of vehicles in shadow areas," in Proc. 3rd Workshop Hyperspectral Image Signal Process.: Evol. Remote Sens. (WHISPERS), 2011, pp. 1-4.
29. Q. Zhang, V. P. Pauca, R. J. Plemmons, and D. D. Nikic, "Detecting objects under shadows by fusion of hyperspectral and lidar data: A physical model approach," in Proc. 5th Workshop Hyperspectral Image Signal Process.: Evol. Remote Sens. (WHISPERS), 2013, pp. 1-4.
30. E. Simental, D. J. Ragsdale, E. Bosch, R. Dodge et al., "Hyperspectral dimension reduction and elevation data for supervised image classification," in Proc. 14th ASPRS Conf. Anchorage, AK, USA, 2003.
31. D. Lemp and U. Weidner, "Improvements of roof surface classification using hyperspectral and laser scanning data," in Proc. ISPRS Joint Conf.: 3rd Int. Symp. Remote Sens. Data Fusion Over Urban Areas (URBAN), 5th Int. Symp. Remote Sens. Urban Areas (URS). Tempe, AZ, USA, 2005, pp. 14-16.
32. J. Mundt, D. R. Streutker, and N. F. Glenn, "Mapping sagebrush distribution using fusion of hyperspectral and lidar classifications," Photogramm. Eng. Remote Sens., vol. 72, no. 1, pp. 47-54, 2006. (Pubitemid 43076091)
33. R. Sugumaran and M. Voss, "Object-oriented classification of lidar fused hyperspectral imagery for tree species identification in an urban environment," in Proc. Urban Remote Sens. Joint Event (JURSE). Paris, France, 2007, pp. 1-6.
34. B. Koetz, G. Sun, F. Morsdorf, K. J. Ranson, M. Kneubhler, K. Itten et al., "Fusion of imaging spectrometer and lidar data over combined radiative transfer models for forest canopy characterization," Remote Sens. Environ., vol. 106, no. 4, pp. 449-459, 2007. (Pubitemid 46175926)
35. M. Dalponte, L. Bruzzone, and D. Gianelle, "Fusion of hyperspectral and lidar remote sensing data for classification of complex forest areas," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1416-1427, May 2008.
36. A. Castrodad, T. Khuon, R. Rand, and G. Sapiro, "Sparse modeling for hyperspectral imagery with lidar data fusion for subpixel mapping," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), 2012, pp. 7275-7278.
37. L. Naidooa, M. Choa, R. Mathieua, and G. Asner, "Classification of savanna tree species, in the greater kruger national park region, by integrating hyperspectral and lidar data in a random forest data mining environment," ISPRS J. Photogramm. Remote Sens., vol. 69, pp. 167-179, 2012.
38. M. Pedergnana, P. R. Marpu, M. D. Mura, J. A. Benediktsson, and L. Bruzzone, "Classification of remote sensing optical and lidar data using extended attribute profiles," IEEE J. Sel. Topics Signal Process., vol. 6, no. 7, pp. 856-865, Nov. 2012.
39. M. Dalla Mura, J. A. Benediktsson, B. Waske, and L. Bruzzone, "Extended profiles with morphological attribute filters for the analysis of hyperspectral data," Int. J. Remote Sens., vol. 31, no. 22, pp. 5975-5991, 2010.
40. M. Dalla Mura, A. Villa, J. A. Benediktsson, J. Chanussot, and L. Bruzzone, "Classification of hyperspectral images by using extended morphological attribute profiles and independent component analysis," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 3, pp. 542-546, May 2011.
41. J. Besag, "On the statistical analysis of dirty pictures," J. R. Stat. Soc., vol. 48, pp. 259-302, 1986.
42. Q. Jackson and D. Landgrebe, "Adaptive Bayesian contextual classification based on Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 11, pp. 2454-2463, Nov. 2002.
43. C. Debes, J. Hahn, A. Zoubir, and M. Amin, "Target discrimination and classification in through-the-wall radar imaging," IEEE Trans. Signal Process., vol. 59, no. 10, pp. 4664-4676, Oct. 2011.
44. C. Debes, A. Zoubir, and M. Amin, "Enhanced detection using target polarization signatures in through-the-wall radar imaging," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 5, pp. 1968-1979, May 2012.
45. R. O. Duda and P. E. Hart, "Use of the hough transformation to detect lines and curves in pictures," Commun.ACM, vol. 15, no. 1, pp. 11-15, Jan. 1972.
46. H. Ren and C.-I. Chang, "Automatic spectral target recognition in hyperspectral imagery," IEEE Trans. Aerosp. Electron. Syst., vol. 39, no. 4, pp. 1232-1249, Oct. 2003.
47. A. Green, M. Berman, P. Switzer, and M. Craig, "A transformation for ordering multispectral data in terms of image quality with implications for noise removal," IEEE Trans. Geosci. Remote Sens., vol. 26, no. 1, pp. 65-74, Jan. 1988. (Pubitemid 18596008)
48. B. Luo and J. Chanussot, "Hyperspectral image classification based on spectral and geometrical features," in Proc. IEEE Int. Workshop Mach. Learn. Signal Process. (MLSP), 2009, pp. 1-6.
49. Q. Du and C.-I. Chang, "Linear mixture analysis-based compression for hyperspectral image analysis," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 4, pp. 875-891, Apr. 2004.
50. I. Dopido, A. Villa, A. Plaza, and P. Gamba, "A quantitative and comparative assessment of unmixing-based feature extraction techniques for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 2, pp. 421-435, Apr. 2012.
51. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001. (Pubitemid 32933532)
52. V. Svetnik, A. Liaw, C. Tong, J. Culberson, R. Sheridan, and B. Feuston, "Random forest: A classification and regression tool for compound classification and QSAR modeling," J. Chem. Inf. Comput. Sci., vol. 43, pp. 1947-1958, 2003.
53. R. Diaz-Uriarte and S. A. de Andres, "Gene selection and classification of microarray data using random forest," BMC Bioinformat., vol. 7, no. 3, pp. 1-13, 2006.
54. R. Genuer, J.-M. Poggi, and C. Tuleau, "Random forests: Some methodological insights," INRIA Saclay, RR-6729, Tech. Rep., 2008, arXiv:0811.3619 [Online]. Available: http://hal.inria.fr/inria-00340725/fr/.
55. R. Genuer, J.-M. Poggi, and C. Tuleau-Malot, "Variable selection using random forests," Pattern Recognit. Lett., vol. 31, pp. 2225-2236, 2010.
56. N. Longbotham, C. Chaapel, L. Bleiler, C. Padwick, W. Emery, and F. Pacifici, "Very high resolution multiangle urban classification analysis," IEEE Trans.Geosci. Remote Sens., vol. 50, no. 4, pp. 1155-1170,Apr. 2012.
57. R. E. Schapire, "The strength of weak learnability," Mach. Learn., vol. 5, no. 2, pp. 197-227, Jul. 1990, doi: 10.1023/A:1022648800760. (Pubitemid 20721695)
58. Y. Freund and R. Shapire, "Experiments with a new boosting algorithm," in Proc. 13th Int. Conf. Mach. Learn., I. L. Saitta, Ed. San Francisco, CA, USA, 1996, pp. 14-156.
59. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge. UK: Cambridge Univ. Press, 2004.
60. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
61. J. Benediktsson, P. Swain, and O. Ersoy, "Neural network approaches versus statistical methods in classification of multisource remote sensing data," IEEE Trans. Geosci. Remote Sens., vol. 28, no. 4, pp. 540-552, Jul. 1990. (Pubitemid 20737861)
62. F. Pacifici, M. Chini, and W. J. Emery, "A neural network approach using multi-scale textural metrics from very high resolution panchromatic imagery for urban land-use classification," Remote Sens. Environ., vol. 113, no. 4, pp. 1276-1292, 2009.
63. G. Marchisio, F. Pacifici, and C. Padwick, "On the relative predictive value of the new spectral bands in the worldwiew-2 sensor," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), 2010, pp. 2723-2726.
64. W. Liao, R. Bellens, A. Pižurica, W. Philips, and Y. Pi, "Classification of hyperspectral data over urban areas using directional morphological profiles and semi-supervised feature extraction," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 4, pp. 1177-1190, Aug. 2012.
65. R. Bellens, S. Gautama, L. Martinez-Fonte, W. Philips, J.-W. Chan, and F. Canters, "Improved classification of VHR images of urban areas using directional morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 10, pp. 2803-2812, Oct. 2008.
66. W. Liao, R. Bellens, A. Pižurica, W. Philips, and Y. Pi, "Classification of hyperspectral data over urban areas based on extended morphological profile with partial reconstruction," in Proc. Adv. Concepts Intell. Vision Syst. (ACIVS). Brno, Czech Republic, 2012, pp. 278-289.
67. B. Scholkopf, A. J. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998. (Pubitemid 128463674)
68. M. Belkin and P. Niyogi, "Laplacia eigenmaps and spectral techniques for embedding and clustering," in Advances in Neural Information Processing Systems, vol. 14. Cambridge, MA, USA: MIT Press, 2002, pp. 558-591.
69. X. F. He and P. Niyogi, "Locality preserving projections," in Advances in Neural Information Processing Systems, vol. 16. Cambridge, MA, USA: MIT Press, 2003, pp. 153-160.
70. C. C. Chang and C. J. Lin. (2001). Libsvm: A Library for Support Vector Machines[Online]. Available: http://www.csie.ntu.edu.tw/\~{}cjlin/libsvm.
71. M. Dalponte, L. Bruzzone, and D. Gianelle, "Tree species classification in the southern alps based on the fusion of very high geometrical resolution multispectral/hyperspectral images and lidar data," Remote Sens. Environ., vol. 123, pp. 258-270, 2012.
72. B. C. Kuo and D. A. Landgrebe, "Nonparametric weighted feature extraction for classification," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 5, pp. 1096-1105, May 2004.