Towards building a multi-datacenter infrastructure for massive remote sensing image processing

Concurrency and Computation: Practice and Experience

Volumn 25, Issue 12, 2013, Pages 1798-1812

  Zhang, Wanfeng ^a,c   Wang, Lizhe ^a,b   Liu, Dingsheng ^a   Song, Weijing ^a   Ma, Yan ^a   Liu, Peng ^a   Chen, Dan ^b  

^a CENTER FOR EARTH OBSERVATION AND DIGITAL EARTH   (China)

^b CHINA UNIVERSITY OF GEOSCIENCES   (China)

^c UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

cloud computing; data intensive computing; multi datacenter infrastructure; remote sensing image processing

Indexed keywords

CLOUD COMPUTING; DATA HANDLING; INFORMATION SERVICES; INTELLIGENT COMPUTING; REMOTE SENSING;

DATA-INTENSIVE COMPUTING; DATACENTER; EARTH OBSERVATIONS; PLATFORM INTEGRATIONS; PROCESSING APPLICATIONS; REMOTE SENSING IMAGE PROCESSING; REMOTE SENSING IMAGES; RESEARCH PROBLEMS;

IMAGE PROCESSING;

EID: 84880331316     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.2966     Document Type: Article

References (29)

1. Collins JP,. Sailing on an ocean of 0s and 1s. Science 2010; 327: 1.
2. Wang L, Kunze M,. Organization of CMS benchmarks in VDS workflow on virtual machines in the sixth international conference on grid and cooperative computing (GCC 2007), Los Alamitos, CA, IEEE. 2007.
3. Chu KD, Di L, Thornton P,. Introduction of grid computing application projects at the NASA earth science technology office. Advances in Grid and Pervasive Computing 2006; 1: 289-298.
4. Zomaya AY,. Parallel Computing for Bioinformatics and Computational Biology. Wiley Online Library: New York; 2006.
5. Gray J, Szalay A,. EScience-a transformed scientific method in presentation to the computer science and technology board of the National Research Council. Mountain View, CA. 2007. See: http://research.microsoft.com/ en-us/um/people/gray/talks/NRC-CSTB-eScience.ppt, visited 8th, July 2012.
6. Berman F, Fox G, Hey AJG,. Grid Computing: Making the Global Infrastructure a Reality. Vol. 2. John Wiley & Sons, Inc: New York; 2003; 809-824.
7. Newman HB, Ellisman MH, Orcutt JA,. Data-intensive e-science frontier research. Communications of the ACM. 2003; 46 (11): 68-77.
8. Keahey K, Foster I, Freeman T, Zhang X,. Virtual workspaces: achieving quality of service and quality of life in the grid. Scientific Programming 2005; 13 (4): 265.
9. Guo W, Gong JY, Jiang WS, Liu Y, She B,. OpenRS-cloud: a remote sensing image processing platform based on cloud computing environment. SCIENCE CHINA Technological Sciences 2010; 53: 221-230.
10. Wang L, Jie W,. Towards supporting multiple virtual private computing environments on computational grids. Advances in Engineering Software 2009; 40 (4): 239-245.
11. Wang L, Kunze M, Tao J, Laszewski Gv,. Towards building a cloud for scientific applications. Advances in Engineering Software 2011; 42: 714-722.
12. Wang L, Von Laszewski G, Younge A, He X, Kunze M, Tao J, Fu C,. Cloud computing: a perspective study. New Generation Computing 2010; 28 (2): 137-146.
13. Song W, Yue S, Wang L, Wanfeng Z, Liu D,. Task scheduling of massive spatial data processing across distributed data centers: What's New? in 2011 IEEE 17th International Conference On Parallel and Distributed Systems, IEEE. 2011.
14. Ma Y, Zhao L, Liu D,. An asynchronous parallelized and scalable image resampling algorithm with parallel I/O. Computational Science-ICCS 2009 2009; 1: 357-366.
15. Condor-G Web site. http://research.cs.wisc.edu/condor/condorg/, visited 19th, May 2012.
16. Frey J, Tannenbaum T, Foster I, Livny M, Tuecke S,. Condor-G: a computation management agent for multi-institutional grids. Cluster Computing 2002; 5 (3): 237-246.
17. Condor DAGMan Web site. http://www.cs.wisc.edu/condor/dagman/. visited 19th, May 2012.
18. Garzoglio G,. A Globally Distributed System for High Energy Physics Computation: Job, Data, and Information Handling for High-Energy Physics. VDM Verlag Saarbrücken: Germany; 2009.
19. Rodriguez A, Sulakhe D, Marland E, Nefedova V, Maltsev N, Wilde M, Foster I,. A grid-enabled service for high-throughput genome analysis in workshop on case studies on grid applications, Berlin, Germany. 2004.
20. Chen D, Wang L, Wu X, Chen J, Khan SU, Kołodziej J, Tian M, Huang F, Liu W,. "Hybrid modelling and simulation of huge crowd over a hierarchical Grid architecture," Future Generation Computer Systems, Available online 12 March 2012, ISSN 0167-739X, 10.1016/j.future.2012.03.006.
21. Townshend JRG,. Global data sets for land applications from the advanced very high resolution radiometer: an introduction. International Journal of Remote Sensing 1994; 15 (17): 3319-3332.
22. Goward SN, Williams DL,. Landsat and earth systems science: development of terrestrial monitoring. Photogrammetric Engineering and Remote Sensing 1997; 63 (7): 887-900.
23. Kalluri S, JaJa J, Bader DA, Zhang Z, Townshend J, Fallah-Adl H,. High performance computing algorithms for land cover dynamics using remote sensing data. International Journal of Remote Sensing 2000; 21 (6-7): 1513-1536.
24. Foster I, Vockler J, Wilde M, Zhao Y,. Chimera: a virtual data system for representing, querying, and automating data derivation, IEEE 2002.
25. Chervenak AL, Schuler R, Ripeanu M, Ali Amer M, Bharathi S, Foster I, Iamnitchi A, Kesselman C,. The globus replica location service: design and experience. IEEE Transactions on Parallel and Distributed Systems 2009; 20 (9): 1260-1272.
26. GT replica location service Web site. http://www.globus.org/toolkit/docs/ 5.0/5.0.2/data/rls/. visited 21st, May 2012.
27. Wang L, Chen D, Huang F,. Virtual workflow system for distributed collaborative scientific applications on grids. Computers and Electrical Engineering 2011; 37 (3): 300-310.
28. Wang L,. Virtual environments for grid computing. Universitätsverlag Karlsruhe. 2009; 1: 161.
29. Report on grid Job submission and Condor-G scalability issues. http://indico.cern.ch/getFile.py/access?contribId=15&resId=0&materialId= slides&confId=71428. visited 30, July 2012.