DataSpaces: An interaction and coordination framework for coupled simulation workflows

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 25-36

  Docan, Ciprian ^a   Parashar, Manish ^a   Klasky, Scott ^b  

^a RUTGERS UNIVERSITY   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Code coupling; Data redistribution; I O; RDMA; Workflows

Indexed keywords

CODE COUPLING; DATA REDISTRIBUTION; I/O; RDMA; WORK-FLOWS;

COMPUTER SIMULATION; DISTRIBUTED COMPUTER SYSTEMS; FLEXIBLE COUPLINGS; MANAGEMENT; VISUALIZATION;

DATA VISUALIZATION;

EID: 78649984950     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851481     Document Type: Conference Paper

References (28)

1. H. Abbasi, M. Wolf, G. Eisenhauer, S. Klasky, K. Schwan, and F. Zheng. DataStager: Scalable Data Staging Services for Petascale Applications. In Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing (HPDC'09), June 2009.
2. R. Armstrong, D. Gannon, A. Geist, K. Keahey, S. Kohn, L. McInnes, S. Parker, and B. Smolinski. Toward a Common Component Architecture for High-Performance Scientific Computing. In Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing (HPDC'99), August 1999.
3. F. Bertrand and R. Bramley. DCA: A distributed CCA framework based on MPI. In Proceedings of the 9th International Workshop on High-Level Parallel Programming Models and Supportive Environments (HIPS'04), April 2004.
4. M. D. Beynon, R. Ferreira, T. Kurc, A. Sussman, and J. Saltz. DataCutter: Middleware for filtering very large scientific datasets on archival storage systems. In Proceedings of Mass Storage Systems Conference, March 2000.
5. T. Bially. A class of dimension changing mapping and its application to bandwidth compression. PhD thesis, Polytechnic Institute of Brooklyn, June 1976.
6. D. Bonachea, P. Hargrove, M. Welcome, and K. Yelick. Porting GASNet to Portals: Partitioned Global Address Space (PGAS) Language Support for the Cray XT. In Cray User Group (CUG'09), May 2009.
7. N. Carriero and D. Gelernter. Linda in context. Communications of ACM, 32(4):444-458, 1989.
8. C. S. Chang, S. Ku, and H. Weitzner. Numerical Study of Neoclassical Plasma Pedestal in a Tokamak Geometry. Physics Plasmas, 11(5):2649-2667, 2004.
9. B. Chapman, H. Zima, M. Haines, P. Mehrotra, and J. V. Rosendale. Opus: A Coordination Language for Multidisciplinary Applications. Journal of Scientific Programming, 6(4):345-362, 1997.
10. J. Cummings. Plasma Edge Kinetic-MHD Modeling in Tokamaks Using Kepler Workflow for Code Coupling, Data Management and Visualization. Communications in Computational Physics, 4:675-702, 2008.
11. J. M. del Rosario and A. N. Choudhary. High-Performance I/O for Massively Parallel Computers: Problems and Prospects. Computer, 27(3):59-68, 1994.
12. C. Docan, M. Parashar, and S. Klasky. Enabling High Speed Asynchronous Data Extraction and Transfer Using DART. Concurrency and Computation: Practice and Experience, DOI:10.1002/cpe.1567.
13. C. Docan, M. Parashar, and S. Klasky. DART: a Substrate for High Speed Asynchronous Data IO. In Proceedings of the 17th International Symposium on High Performance Distributed Computing (HPDC'08), June 2008.
14. I. Foster and M. Chandy. Fortran M: a language for modular parallel programming. Journal of Parallel and Distributed Computing, 26(1):24-35, 1995.
15. HPF Language Specification, Version 2.0, January 1984. http://www.netlib.org/hpf/hpf-v20-final.ps.gz.
16. R. Jacob, J. Larson, and E. Ong. M×N Communication and Parallel Interpolation in CCSM3 Using the Model Coupling Toolkit. International Journal for High Performance Computing Applications, 19(3):293-307, 2005.
17. R. Jacob, J. Larson, and E. Ong. The Model Coupling Toolkit: A New Fortran90 Toolkit for Building Multiphysics Parallel Coupled Models. International Journal for High Performance Computing Applications, 19(3):277-292, 2005.
18. http://info.nccs.gov/resources/jaguar.
19. D. Kotz. Disk-Directed I/O for MIMD Multiprocessors. ACM Transactions on Computer Systems, 15(1):41-74, 1997.
20. W. Park, E. V. Belova, G. Y. Fu, X. Z. Tang, H. R. Strauss, and L. E. Sugiyama. Plasma Simulation Studies Using Multilevel Physics Models. Physics Plasmas, 6(5):1796-1803, 1999.
21. K. E. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-Directed Collective I/O in Panda. In Supercomputing Conference (SC'95), page 57, December 1995.
22. H. D. Sterck, R. S. Markel, T. Pohl, and U. Rude. A Lightweight Java Taskspaces Framework for Scientific Computing on Computational Grids. In Proceedings of the 18th Annual ACM Symposium on Applied Computing, March 2003.
23. S. Tilak, P. Hubbard, M. Miller, and T. Fountain. The Ring Buffer Network Bus (RBNB) DataTurbine Streaming Data Middleware for Environmental Observing Systems. In International Conference on High Performance Computing(HiPC'07), December 2007.
24. K. Vaidyanathan, S. Narravula, and D. K. Panda. DDSS: A Low-Overhead Distributed Data Sharing Substrate for Cluster-Based Data-Centers over modern interconnects. In Int'l Symposium on High Performance Computing (HiPC'06), December 2006.
25. H. R. Wilson, P. B. Snyder, G. T. A. Huysmans, and R. L. Miller. Numerical Studies of Edge Localized Instabilities in Tokamaks. Physics Plasmas, 9(4):1277-1286, 2002.
26. M. Youssef, A. Yousif, N. El-Sheimy, and A. Noureldin. A Novel Earthquake Warning System Based on Virtual MIMO-Wireless Sensor Networks. In Proceedings of Canadian Conference on Electrical and Computer Engineering (CCECE'07), April 2007.
27. L. Zhang and M. Parashar. A Dynamic Geometry-based Shared Space Interaction Framework for Parallel Scientific Applications. In Proceedings of the 11th Annual International Conference on High Performance Computing (HiPC'04), December 2004.
28. L. Zhang and M. Parashar. Enabling Efficient and Flexible Coupling of Parallel Scientific Applications. In Proceedings of the 20th IEEE International Parallel and Distributed Processing Symposium (IPDPS'06), April 2006.