Recent Developments in High Performance Computing for Remote Sensing: A Review

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 4, Issue 3, 2011, Pages 508-527

  Lee, Craig A ^a   Gasster, Samuel D ^a   Plaza, Antonio ^b   Chang, Chein I ^c,d   Huang, Bormin ^e  

^a AEROSPACE CORPORATION   (United States)

^b UNIVERSITY OF EXTREMADURA   (Spain)

^c UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

^d NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

^e UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Cloud; distributed computing infrastructures (DCIs); field programmable gate arrays (FPGAs); graphics processing units (GPUs); grids; high performance computing (HPC); multiprocessor systems; remote sensing applications; service architectures; specialized hardware architectures

Indexed keywords

FIELD PROGRAMMABLE GATE ARRAYS (FPGAS); GRAPHICS PROCESSING UNITS; GRIDS; HIGH-PERFORMANCE COMPUTING; MULTI PROCESSOR SYSTEMS; REMOTE SENSING APPLICATIONS; SERVICE ARCHITECTURE; SPECIALIZED HARDWARE;

ARTS COMPUTING; COMPUTER HARDWARE; COMPUTER SOFTWARE SELECTION AND EVALUATION; FIELD PROGRAMMABLE GATE ARRAYS (FPGA); HETEROGENEOUS NETWORKS; LOGIC GATES; MULTIPROCESSING SYSTEMS; NETWORK ARCHITECTURE; PROGRAM PROCESSORS; REMOTE SENSING;

CLOUD COMPUTING;

COMPUTER SYSTEM; HARDWARE; INFORMATION TECHNOLOGY; REMOTE SENSING;

EID: 80052319893     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2011.2162643     Document Type: Article

References (105)

1. R. A. Schowengerdt, Remote Sensing: Models and Methods for Image Processing, 2nd ed. New York: Academic Press, 1997.
2. D. A. Landgrebe, Signal Theory Methods in Multispectral Remote Sensing. New York: Wiley, 2003.
3. C.-I. Chang, Hyperspectral Imaging: Techniques for Spectral Detection and Classification. New York: Kluwer Academic/Plenum, 2003.
4. J. A. Richards and X. Jia, Remote Sensing Digital Image Analysis: An Introduction. New York: Springer, 2006.
5. A. Plaza, J. A. Benediktsson, J. Boardman, J. Brazile, L. Bruzzone, G. Camps-Valls, J. Chanussot, M. Fauvel, P. Gamba, J. Gualtieri, M. Marconcini, J. C. Tilton, and G. Trianni, “Recent advances in techniques for hyperspectral image processing,” Remote Sens. Environ., vol. 113, pp. 110–122, 2009.
6. S. Kalluri, Z. Zhang, J. JaJa, S. Liang, and J. Townshend, “Characterizing land surface anisotropy from AVHRR data at a global scale using high performance computing,” Int. J. Remote Sens., vol. 22, pp. 2171–2191, 2001.
7. A. Plaza and C.-I. Chang, High Performance Computing in Remote Sensing. Boca Raton, FL: Taylor & Francis, 2007.
8. A. Plaza, “Special issue on architectures and techniques for real-time processing of remotely sensed images,” J. Real-Time Image Process., vol. 4, pp. 191–193, 2009.
9. A. Plaza and C.-I. Chang, “Preface to the special issue on high performance computing for hyperspectral imaging,” Int. J. High Performance Computing Applications, vol. 22, no. 4, pp. 363–365, 2008.
10. R. Brightwell, L. Fisk, D. Greenberg, T. Hudson, M. Levenhagen, A. Maccabe, and R. Riesen, “Massively parallel computing using commodity components,” Parallel Computing, vol. 26, pp. 243–266, 2000.
11. J. Dorband, J. Palencia, and U. Ranawake, “Commodity computing clusters at goddard space flight center,” J. Space Commun., vol. 3, p. 1, 2003.
12. K. Itoh, “Massively parallel fourier-transform spectral imaging and hyperspectral image processing,” Optics and Laser Technology, vol. 25, p. 202, 1993.
13. T. El-Ghazawi, S. Kaewpijit, and J. L. Moigne, “Parallel and adaptive reduction of hyperspectral data to intrinsic dimensionality,” Cluster Computing, vol. 1, pp. 102–110, 2001.
14. A. Plaza, D. Valencia, J. Plaza, and P. Martinez, “Commodity cluster-based parallel processing of hyperspectral Imagery,” J. Parallel and Distributed Computing, vol. 66, no. 3, pp. 345–358, 2006.
15. A. Plaza, J. Plaza, and D. Valencia, “Impact of platform heterogeneity on the design of parallel algorithms for morphological processing of high-dimensional image data,” J. Supercomputing, vol. 40, no. 1, pp. 81–107, 2007.
16. A. Lastovetsky and J. Dongarra, High-Performance Heterogeneous Computing. New York: Wiley, 2009.
17. A. Plaza, D. Valencia, and J. Plaza, “An experimental comparison of parallel algorithms for hyperspectral analysis using homogeneous and heterogeneous networks of workstations,” Parallel Computing, vol. 34, no. 2, pp. 92–114, 2008.
18. S. Tehranian, Y. Zhao, T. Harvey, A. Swaroop, and K. Mckenzie, “A robust framework for real-time distributed processing of satellite data,” J. Parallel and Distributed Computing, vol. 66, pp. 403–418, 2006.
19. W. Rivera, C. Carvajal, and W. Lugo, “Service oriented architecture grid based environment for hyperspectral imaging analysis,” Int. J. Information Technology, vol. 11, no. 4, pp. 104–111, 2005.
20. J. Brazile, R. A. Neville, K. Staenz, D. Schlaepfer, L. Sun, and K. I. Itten, “Cluster versus grid for operation generation of ATCOR's MODTRAN-based look up table,” Parallel Computing, vol. 34, pp. 32–46, 2008.
21. S. Hauck, “The roles of FPGAs in reprogrammable systems,” Proc. IEEE, vol. 86, pp. 615–638, 1998.
22. E. Lindholm, J. Nickolls, S. Oberman, and J. Montrym, “NVIDIA Tesla: A unified graphics and computing architecture,” IEEE Micro, vol. 28, pp. 39–55, 2008.
23. A. Plaza, J. Plaza, A. Paz, and S. Sanchez, “Parallel hyperspectral image and signal processing,” IEEE Signal Process. Mag., vol. 28, pp. 119–126, 2011.
24. J. Nickolls and W. J. Dally, “The GPU computing era,” IEEE Micro, vol. 30, pp. 56–69, 2010.
25. T. Balz and U. Stilla, “Hybrid GPU-based single- and double-bounce SAR simulation,” IEEE Trans. Geosci. Remote Sens., vol. 47, no. 10, pp. 3519–3529, 2009.
26. T. Hobiger, R. Ichikawa, Y. Koyama, and T. Kondo, “Computation of troposphere slant delays on a GPU,” IEEE Trans. Geosci. Remote Sens., vol. 47, no. 10, pp. 3313–3318, 2009.
27. M. W. Govett, J. Middlecoff, and T. Henderson, “Running the NIM next-generation weather model on GPUs,” in Proc. 10th IEEE/ACM Int. Conf. Cluster, Cloud and Grid Computing (CCGrid), 2010, vol. 1, pp. 792–796.
28. J. Mielikainen, R. Honkanen, B. Huang, P. Toivanen, and C. Lee, “Constant coefficients linear prediction for lossless compression of ultra-spectral sounder data using a graphics processing unit,” J. Applied Remote Sens., vol. 4, no. 1, pp. 751–774, 2010.
29. J. Setoain, M. Prieto, C. Tenllado, and F. Tirado, “GPU for parallel on-board hyperspectral image processing,” Int. J. High Performance Computing Applications, vol. 22, no. 4, pp. 424–437, 2008.
30. J. Setoain, M. Prieto, C. Tenllado, A. Plaza, and F. Tirado, “Parallel morphological endmember extraction using commodity graphics hardware,” IEEE Geosci. Remote Sens. Lett., vol. 43, no. 3, pp. 441–445, 2007.
31. A. Plaza, J. Plaza, and H. Vegas, “Improving the performance of hyperspectral image and signal processing algorithms using parallel, distributed and specialized hardware-based systems,” J. Signal Process. Syst., vol. 61, pp. 293–315, 2010.
32. B. Huang, J. Mielikainen, H. Oh, and H.-L. Huang, “Development of a GPU-based high-performance radiative transfer model for the infrared atmospheric sounding interferometer (IASI),” J. Comput. Phys., vol. 230, pp. 2207–2221, 2011.
33. J. Mielikainen, B. Huang, and A.H.-L. Huang, “GPU-accelerated multi-profile radiative transfer model for the infrared atmospheric sounding interferometer,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. (JSTARS), vol. 4, no. 3, pp. 691–700, Sep. 2011.
34. C. Song, Y. Li, and B. Huang, “A GPU-accelerated wavelet decompression system with SPIHT and Reed-Solomon decoding for satellite images,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. (JSTARS), vol. 4, no. 3, pp. 683–690, Sep. 2011.
35. S.-C. Wei and B. Huang, “GPU acceleration of predictive partitioned vector quantization for ultraspectral sounder data compression,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. (JSTARS), vol. 4, no. 3, pp. 677–682, Sep. 2011.
36. C.-C. Chang, Y.-L. Chang, M.-Y. Huang, and B. Huang, “Accelerating regular LDPC code decoders on GPUs,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. (JSTARS), vol. 4, no. 3, pp. 653–659, Sep. 2011.
37. Y. Tarabalka, T. V. Haavardsholm, I. Kasen, and T. Skauli, “Real-time anomaly detection in hyperspectral images using multivariate normal mixture models and gpu processing,” J. Real-Time Image Process., vol. 4, pp. 1–14, 2009.
38. D. A. Buell, T. A. El-Ghazawi, K. Gaj, and V. V. Kindratenko, “Guest editors' introduction: High-performance reconfigurable computing,” IEEE Computer, vol. 40, pp. 23–27, 2007.
39. U. Thomas, D. Rosenbaum, F. Kurz, S. Suri, and P. Reinartz, “A new software/hardware architecture for real time image processing of wide area airborne camera images,” J. Real-Time Image Process., vol. 5, pp. 229–244, 2009.
40. A. Plaza and C.-I. Chang, “Clusters versus FPGA for parallel processing of hyperspectral imagery,” Int. J. High Performance Computing Applications, vol. 22, no. 4, pp. 366–385, 2008.
41. M. Hsueh and C.-I. Chang, “Field programmable gate arrays (FPGA) for pixel purity index using blocks of skewers for endmember extraction in hyperspectral imagery,” Int. J. High Performance Computing Applications, vol. 22, pp. 408–423, 2008.
42. E. El-Araby, T. El-Ghazawi, J. L. Moigne, and R. Irish, “Reconfigurable processing for satellite on-board automatic cloud cover assessment,” J. Real-Time Image Process., vol. 5, pp. 245–259, 2009.
43. C. Gonzalez, J. Resano, D. Mozos, A. Plaza, and D. Valencia, “FPGA implementation of the pixel purity index algorithm for remotely sensed hyperspectral image analysis,” EURASIP J. Advances in Signal Processing, vol. 969806, pp. 1–13, 2010.
44. A. Paz and A. Plaza, “Clusters versus GPUs for parallel automatic target detection in remotely sensed hyperspectral images,” EURASIP J. Advances in Signal Processing, vol. 915639, pp. 1–18, 2010.
45. J. Resano, J. A. Clemente, C. Gonzalez, D. Mozos, and F. Catthoor, “Efficiently scheduling runtime reconfigurations,” ACM Trans. Design Automation of Electronic Systems, vol. 13, pp. 58–69, 2008.
46. A. Plaza, J. A. Benediktsson, J. Boardman, J. Brazile, L. Bruzzone, G. Camps-Valls, J. Chanussot, M. Fauvel, P. Gamba, J. Gualtieri, M. Marconcini, J. C. Tilton, and G. Trianni, “Recent advances in techniques for hyperspectral image processing,” Remote Sens. Environ., vol. 113, pp. 110–122, 2009.
47. J. C. Tilton, W. T. Lawrence, and A. Plaza, “Utilizing hierarchical segmentation to generate water and snow masks to facilitate monitoring of change with remotely sensed image data,” GIScience & Remote Sens., vol. 43, pp. 39–66, 2006.
48. J. Plaza, A. Plaza, D. Valencia, and A. Paz, “Massively parallel processing of hyperspectral images,” in Proc. SPIE, 2009, vol. 7455, pp. 1–11.
49. A. Remon, S. Sanchez, A. Paz, E. S. Quintana-Orti, and A. Plaza, “Real-time endmember extraction on multi-core processors,” IEEE Geosci. Remote Sens. Lett., vol. 8, no. 5, pp. 924–928, 2011.
50. “Systems Engineering Handbook, A Guide For System Life Cycle Processes and Activities,” ver. 3.1, C. Haskins, Ed., INCOSE, 2007, IN-COSE-TP-2003-002-03.1.
51. Apache Hadoop Wiki. 2011 [Online]. Available: http://wiki.apache, org/hadoop/
52. S. R. Arnon, S. A. Renner, A. S. Rosenthal, and J. G. Scarano, “Data interoperability: Standardization or mediation,” presented at the IEEE Metadata Workshop, Silver Spring, MD, 1996.
53. A. Merzky, K. Stamou, and S. Jha, “Application level interoperability between clouds and grids,” in Workshops at the Grid and Pervasive Computing Conf. 2009 (GPC'09), May 2009, pp. 143–150.
54. C. Lee, B. Michel, E. Deelman, and J. Blythe, “From event-driven workflows towards a posteriori computing,” in Future Generation Grids, V. Getov, D. Laforenza, and A. Reinefeld, Eds. New York: Springer-Verlag, 2006, pp. 3–28.
55. The Grid Workflow Forum. 2011 [Online]. Available: http://www.grid-workflow.org
56. G. Wei, A. V. Vasilakos, Y. Zheng, and N. Xiong, “A game-theoretic method of fair resource allocation for cloud computing services,” J. Supercomput. vol. 54, pp. 252–269, Nov. 2010 [Online]. Available: http://dx.doi.org/10.1007/s11227-009-0318-1
57. M. Caramia and S. Giordani, “Resource allocation in grid computing: An economic model,” WSEAS Trans. Computer Research, vol. 3, no. 1, pp. 19–27, 2008.
58. M. Li, M. Chen, and J. Xie, “Cloud computing: A synthesis models for resource service management,” in 2nd Int. Conf. Communication Systems, Networks and Applications (ICCSNA 2010), Jul. 2010, vol. 2, pp. 208–211.
59. D. Lee, J. J. Dongarra, and R. S. Ramakrishna, “visPerf: Monitoring Tool for Grid Computing,” in ICCS 2003, ser. Lecture Notes in Computer Science, vol. 2657. New York: Springer Verlag, 2003, pp. 233–243.
60. Z. Balaton, P. Kacsuk, N. Podhorszki, and F. Vajda, “Comparison of representative grid monitoring tools,” Lab. of Parallel and Distributed Systems, Computer and Automation Research Inst., Hungarian Academy of Sciences, Tech. Rep. LPDS-2/2000, 2000.
61. G. Shaheen, M. Malik, Z. Ihsan, and N. Daudpota, “Grid visualizer: A monitoring tool for grid environment,” in Proc. 16th Int. Workshop on Database and Expert Systems Applications 2005, Aug. 2005, pp. 297–301.
62. D. Chou, “Using events in highly distributed architectures,” MSDN Library: The Architecture Journal, no. 17, Oct. 2008 [Online]. Available: http://msdn.microsoft.com/en-us/library/dd129913.aspx
63. Y. Huang and D. Gannon, “A comparative study of web services-based event notification specifications,” in Proc. 2006 Int. Conf. Parallel Processing (ICPP 2006) Workshops, 2006, pp. 8–14.
64. K. B. Alexander, National Information Assurance (IA) Glossary, Committee on National Security Systems CNSS Secretariat (101C), National Security Agency, Ft. Meade, MD, Tech. Rep. CNSS Instruction 4009, Jun. 2006 [Online]. Available: http://www.cnss.gov/
65. C. Tilmes and A. Fleig, “Provenance tracking in an earth science data processing system,” presented at the 2nd Int. Provenance and Annotation Workshop Salt Lake City, Utah, Jun. 17–18, 2008.
66. I. Sfiligoi, G. Quinn, C. Green, and G. Thain, “Pilot job accounting and auditing in open science grid,” in Proc. 9th IEEE/ACM Int. Conf. Grid Computing 2008, Oct. 2008, pp. 112–117.
67. E. Gallopoulos, E. Houstis, and J. Rice, “Computer as thinker/doer: Problem-solving environments for computational science,” IEEE Comput. Sci. Eng., vol. 1, no. 2, pp. 11–23, Summer, 1994.
68. High Performance Computing in Remote Sensing, ser. Chapman & Hall/CRC Computer & Information Science Series, A. J. Plaza and C.-I. Chang, Eds. Boca Raton, FL: Chapman & Hall/CRC, 2007, vol. 16.
69. N. DeBardeleben, I. Ligon, W. B. J. Stanzione, “The component-based environment for remote sensing,” in 2002 IEEE Aerospace Conf. Proc., 2002, vol. 6, pp. 6-2661–6-2670.
70. G. Aloisio, M. Cafaro, I. Epicoco, and G. Quarta, “A problem solving environment for remote sensing data processing,” in Proc. Int. Conf. Information Technology: Coding and Computing (ITCC 2004), Apr. 2004, vol. 2, pp. 56–61.
71. C. Lee and G. Percivall, “Standards-based computing capabilities for distributed geospatial applications,” IEEE Computer, pp. 50–57, Nov. 2008.
72. D. Mandl, “Matsu: An elastic cloud connected to a sensorweb for disaster response,” in Ground System Architectures Workshop (GSAW), Workshop on Cloud Computing for Spacecraft Operations, Mar. 2, 2011.
73. The Open Cloud Consortium [Online]. Available: http://www.opencloudconsortium.org.
74. The Global Disaster Alert and Coordination System [Online]. Available: http://www.gdacs.org
75. R. Cossu and L. Fusco, “GENESI-DR … and its future,” in GEO Alliances and Harmonization Workshop, Nov. 11–12, 2009.
76. GENESI-DEC [Online]. Available: http://www.genesi-dec.eu
77. The EC INSPIRE Directive [Online]. Available: http://inspire.jrc.ee. europa.eu
78. OpenSearch [Online]. Available: http://www.opensearch.org
79. Grid Processing on Demand [Online]. Available: http://gpod.eo.esa.int
80. Globus [Online]. Available: http://globus.org
81. F. Brito, “Cloud computing in ground segments: Earth observation processing campaigns,” in Ground System Architectures Workshop (GSAW), Workshop on Data Center Migration for Ground Systems: Geospatial Clouds, Mar. 3, 2010.
82. The GSFC Mission Services Evolution Center [Online]. Available: http://gmsec.gsfc.nasa.gov
83. S. Sekiguchi et al., “Design principles and IT overviews of the GEO grid,” IEEE Syst. J., vol. 2, no. 3, pp. 374–389, Sep. 2008.
84. The Open Geospatial Consortium [Online]. Available: http://www. opengeospatial.org
85. H. Yamamoto et al., “Field sensor virtual organization integrated with satellite data on a GEO grid,” Data Science J., vol. 8, pp. 461–476, Feb. 7, 2010.
86. The Global Earth Observation System of Systems [Online]. Available: http://www.earthobservations.org/geoss.shtml
87. The Group on Earth Observations [Online]. Available: http://www. earthobservations.org
88. The Committee on Earth Observation Satellites [Online]. Available: http://www.ceos.org
89. L. Fusco and R. Cossu, “Past and future of ESA earth observation grid,” (in English) Memorie della Societa Astronomica Italiana, vol. 80, pp. 461–476, 2009.
90. The US Group Earth Observations [Online]. Available: http://www. usgeo.gov
91. P. Yue et al., “Sharing geospatial provenance in a service-oriented environment,” Computers, Environment and Urban Systems, 2011, in press.
92. ISO 14863 System Independent Data Format. Originally available as ECMA-208. [Online]. Available: http://www.ecma-international.org/publications/files/ECMA-ST/Ecma-208.pdf
93. Long Term Preservation of Earth Observation Space Data: European LTDP Common Guidelines, V2, Jun. 4, 2009 [Online]. Available: http://earth.esa.int/gscb/ltdp/EuropeanLTDPCommonGuide-lines_DraftV2.pdf
94. The OGF HPC Basic Profile, GFD.114 [Online]. Available: http://www.ogf.org/documents/GFD.114.pdf
95. The OASIS Web Services Business Process Execution Language, V2 [Online]. Available: http://docs.oasis-open.org/wsbpel/2.0/OS/wsbpel-v2.0-OS.html
96. C. A. Lee, “A perspective on scientific cloud computing,” in Science Cloud Workshop, HPDC, Jun. 2010.
97. K. Jackson et al., “Seeking supernovae in the clouds: A performance study,” in Science Cloud Workshop, HPDC, Jun. 2010.
98. OGF WS-Agreement Negotiation [Online]. Available: https://forge. gridforum.org/sf/go/doc16194?nav=1
99. P. Bogden et al., “Architecture of a community infrastructure for predicting and analyzing coastal inundation,” Marine Tech. Soc. J., vol. 41, no. 1, pp. 53–61, Jun. 2007.
100. The International Grid Trust Federation, 2011 [Online]. Available: http://www.igtf.net
101. The Open Grid Forum [Online]. Available: http://www.ogf.org
102. The OGF Open Cloud Computing Interface [Online]. Available: http://www.occi-wg.org/doku.php
103. The DMTF Open Virtualization Format [Online]. Available: www.dmtf.org/standards/published_documents/DSP0243_1.0.0.pdf
104. The SNIA Cloud Data Management Interface [Online]. Available: http://www.snia.org/cloud
105. C. A. Lee and G. Percivall, “Emerging standards for geospatial distributed computing infrastructures,” Data Flow from Space to Earth: Applications and Interoperability, Mar. 21–23, 2011 [Online]. Available: http://www.space.corila.it