Accelerating tropical cyclone analysis using LambdaRAM, a distributed data cache over wide-area ultra-fast networks

Future Generation Computer Systems

Volumn 25, Issue 2, 2009, Pages 184-191

  Vishwanath, Venkatram ^a   Burns, Robert ^b   Leigh, Jason ^a   Seablom, Michael ^b  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b NASA GODDARD SPACE FLIGHT CENTER   (United States)

Author keywords

Climate modeling and analysis; Data intensive computing; Distributed data caches; Hurricane analysis; LambdaGrids; Multi dimensional remote data striding; Tropical cyclone analysis

Indexed keywords

CHLORINE COMPOUNDS; DATA STORAGE EQUIPMENT; NASA;

ACCESS PATTERNS; CLIMATE MODELING AND ANALYSIS; DATA-INTENSIVE; DATA-INTENSIVE COMPUTING; DATA-SETS; DISTRIBUTED CACHING; DISTRIBUTED DATA; DISTRIBUTED DATA CACHE; DISTRIBUTED DATA CACHES; GEOGRAPHICAL COORDINATES; HURRICANE ANALYSIS; I/O LATENCY; LAMBDAGRIDS; MULTI-DIMENSIONAL; MULTI-DIMENSIONAL REMOTE DATA STRIDING; MULTIPLE CLUSTERS; ON TIME; REMOTE DATA; SCIENTIFIC APPLICATIONS; STORAGE SYSTEMS; TROPICAL CYCLONE; TROPICAL CYCLONE ANALYSIS; ULTRA-FAST; ULTRA-HIGH SPEED; WIDE-AREA; WIND SHEAR;

WIDE AREA NETWORKS;

EID: 52949111879     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.07.005     Document Type: Article

References (31)

1. Newman H.B., Ellisman M.H., and Orcutt J.A. Data-intensive e-science frontier research. Communications of the ACM 46 11 (2003) 68-77
2. Modeling, Analysis and Prediction Project 2006, NASA Goddard Space Flight Center. http://map06.gsfc.nasa.gov
3. Smarr L.L., Chien A.A., DeFanti T., Leigh J., and Papadopoulos P.M. The OptIPuter. Communications of the ACM 46 11 (2003) 58-67
4. C. Zhang, J. Leigh, T.A. DeFanti, M. Mazzucco, R. Grossman, TeraScope: Distributed visual data mining of terascale data sets over photonic networks, Journal of Future Generation Computer Systems (FGCS), 08/01/2003-08/01/2003
5. Modern Era Retrospective Reanalysis for Research and Applications (MERRA), http://gmao.gsfc.nasa.gov/research/merra/intro.php
6. Eric He, Jason Leigh, Oliver Yu, Thomas A. DeFanti, Reliable blast UDP: Predictable high performance bulk data transfer, in: Proceedings of IEEE Cluster Computing, Chicago, IL, September, 2002
7. DeFanti T., Leigh J., Yu O., Krishnaprasad N., Eliason J., Alimohideen J., and He E. Quanta: A toolkit for high performance data delivery. Future Generation Computer Systems 1005 (2003) 01/01/2003-01/01/2003
8. Parallel Virtual File System 2. http://www.pvfs.org/
9. General Parallel File System, IBM Corporation. http://www-03.ibm.com/systems/clusters/software/gpfs/index.html
10. Hierarchical Data Format, HDF Group. http://hdf.ncsa.uiuc.edu/products/hdf4/index.html
11. V. Vishwanath, L. Zuck, J. Leigh, Specification and verification of LambdaRAM-a wide-area distributed cache for high performance computing, in: Proceedings of the 6th IEEE/ACM Conference on Formal Methods and Models for Codesign (MEMOCODE) 2008, Anaheim, CA, USA, June 5-7 2008
12. Starlight-The optical startap. http://www.startap.net/starlight/
13. Nieplocha J., Palmer B., Tipparaju V., Krishnan M., Trease H., and Apra E. Advances, applications and performance of the global arrays shared memory programming toolkit. International Journal of High Performance Computing Applications 20 2 (2006) 203-231
14. Jayant DeSouza, Laxmikant V. Kale, MSA: Multiphase specifically shared arrays, in: Proceedings of the 17th International Workshop on Languages and Compilers for Parallel Computing, West Lafayette, IN, USA, September 22-25 2004
15. C. Xiong, J. Leigh, E. He, V. Vishwanath, T. Murata, L. Renambot, T. DeFanti, LambdaStream-a data transport protocol for streaming network-intensive applications over photonic networks, in: Proceedings of The Third International Workshop on Protocols for Fast Long-Distance Networks, Lyon, France, 02/02/2005-02/03/2005
16. V. Vishwanath, J. Leigh, E. He, M.D. Brown, L. Long, L. Renambot, A. Verlo, X. Wang, T.A. DeFanti, Wide-area experiments with LambdaStream over dedicated high-bandwidth networks, in: Proceedings of IEEE INFOCOM 2006, 04/24/2006-04/26/2006
17. Wei-keng Liao, Kenin Coloma, Alok Choudhary, Lee Ward, Eric Russel, Sonja Tideman, Collective caching: Application-aware client-side file caching, in: Proceedings of the 14th International Symposium on High Performance Distributed Computing, HPDC, July 2005
18. Network File System, RFC 1094
19. Moore R.W. Data Management Systems for Scientific Applications. The Architecture of Scientific Software (2001), Kluwer Academic Publishers 273-284
20. Arie Shoshani, Alex Sim, Junmin Gu, Storage resource managers: Middleware components for grid storage, in: Nineteenth IEEE Symposium on Mass Storage Systems, MSS'02, 2002
21. Bassi A., Beck M., Moore T., Plank J.S., Swany M., Wolski R., and Fagg G. The internet backplane protocol: A study in resource sharing. Future Generation Computing Systems 19 4 (2003) 551-561
22. Yunhong Gu, Robert L. Grossman, Alex Szalay, Ani Thakar, Distributing the sloan digital sky survey using UDT and sector, in: Proceedings of e-Science, 2006
23. Feeley M.J., Morgan W.E., Pighin F.H., Karlin A.R., Levy H.M., and Thekkath C.A. Implementing global memory management in a workstation cluster. 15th ACM Symposium on Operating Systems Principles. SOSP 1995, Copper Mountain, CO, December 3-6. Ser. Operating System Review vol. 29(5) (1995) 201-212
24. Hines M.R., Wang J., and Gopalan K. Distributed Anemone: Transparent low-latency access to remote memory. 13th International Conference on High Performance Computing. HiPC 2006, Dec. 18-21. In: Robert Y., Parashar M., Badrinath R., and Prasanna V.K. (Eds). Ser. Lecture Notes in Computer Science vol. 4297 (2006), Springer, Bangalore, India 509-521
25. V. Roussev, G.G. Richard III, D. Tingstrom, dRamDisk: Efficient RAM sharing on a commodity cluster, in: 25th IEEE International Performance, Computing, and Communications Conference, IPCCC 2006, Phoenix, Arizona, April 10-12, 2006, pp. 193-198
26. S. Koussih, A. Acharya, S. Setia, Dodo: A user-level system for exploiting idle memory in workstation clusters, in: The Eighth IEEE International Symposium on High Performance Distributed Computing, HPDC'99, Redondo Beach, California, August 3-6, 1999, pp. 301-308
27. E.A. Anderson, J.M. Neefe, An exploration of network RAM, EECS Department, University of California, Berkeley, Tech. Rep. UCB/CSD-98-1000, December 9, 1994
28. Scott Pakin, Greg Johnson, Performance analysis of a user-level memory server. in: Proceedings of the 2007 IEEE International Conference on Cluster Computing, Cluster 2007, Austin, Texas, September 2007, pp. 249-258
29. N. Krishnaprasad, V. Vishwanath, S. Venkataraman, A. Rao, L. Renambot, J. Leigh, A. Johnson, JuxtaView-a tool for interactive visualization of large imagery on scalable tiled displays. in: Proceedings of IEEE Cluster Computing 2004, San Diego, CA, 09/20/2004-09/23/2004
30. R. Singh, N. Schwarz, N. Taesombut, D. Lee, B. Jeong, L. Renambot, A. Lin, R. West, H. Otsuka, S. Peltier, M. Martone, K. Nozaki, J. Leigh, M. Ellisman, Real-time multi-scale brain data acquisition, assembly, and analysis using an end to end OptIPuter, Future Generation Computer Systems, 10/01/2006-10/31/2006
31. T.A. Sandstrom, C. Henze, C. Levit, The hyperwall, in: Proc. Conference on Coordinated and Multiple Views in Exploratory Visualization, July 2003, pp. 124-133