Enabling in-situ execution of coupled scientific workflow on multi-core platform

Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IPDPS 2012

Volumn , Issue , 2012, Pages 1352-1363

  Zhang, Fan ^a   Docan, Ciprian ^a   Parashar, Manish ^a   Klasky, Scott ^b   Podhorszki, Norbert ^b   Abbasi, Hasan ^b  

^a RUTGERS UNIVERSITY   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

coupled simulations; data centric task mapping; data intensive application work?ows; in situ application execution

Indexed keywords

APPLICATION EXECUTION; APPLICATION PERFORMANCE; ASYNCHRONOUS DATA; COMPONENT APPLICATION; COUPLED SIMULATION; DATA CENTRIC; DATA SHARING; DATA-INTENSIVE APPLICATION; DISTRIBUTED DATA; EXPERIMENTAL EVALUATION; IMPACT PERFORMANCE; IN-SITU; MULTI-CORE PLATFORMS; MULTI-CORE PROCESSOR; OAK RIDGE NATIONAL LABORATORY; OFF-CHIP; ON CHIPS; PARALLEL PROGRAMMING MODEL; PERFORMANCE GAPS; PHYSICAL PHENOMENA; PROCESSOR CORES; PROGRAMMING ABSTRACTIONS; RUNTIMES; SCIENTIFIC APPLICATIONS; SCIENTIFIC WORKFLOWS; SHARED MEMORIES; SHARED SPACES; SYSTEM EFFICIENCY; TASK EXECUTIONS; TASK MAPPING; WORK-FLOWS;

COMPUTER PROGRAMMING; DATA TRANSFER; DISTRIBUTED PARAMETER NETWORKS; ELECTRONIC DATA INTERCHANGE;

PARALLEL PROCESSING SYSTEMS;

EID: 84866880010     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2012.122     Document Type: Conference Paper

References (25)

1. W. D. Collins, C. M. Bitz, M. L. Blackmon, G. B. Bonan, C. S. Bretherton, J. A. Carton, P. Chang, S. C. Doney, J. J. Hack, T. B. Henderson, J. T. Kiehl, W. G. Large, D. S. McKenna, B. D. Santer, and R. D. Smith, "The Community Climate System Model Version 3 (CCSM3)," Journal of Climate, vol. 19, no. 11, pp. 2122-2143, 2006.
2. J. Cummings, J. Lofstead, K. Schwan, A. Sim, A. Shoshani, C. Docan, M. Parashar, S. Klasky, N. Podhorszki, and R. Barreto, "EFFIS: An End-to-end Framework for Fusion Integrated Simulation," in Proc. 18th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP'10), Feburary 2010.
3. J. Lofstead, F. Zheng, S. Klasky, and K. Schwan, "Adaptable, Metadata Rich IO Methods for Portable High Performance IO," in Proc. 23th IEEE International Parallel and Distributed Processing Symposium (IPDPS'09), May 2009.
4. A. Bhatele and, G. Gupta, L. Kale and, and I.-H. Chung, "Automated Mapping of Regular Communication Graphs on Mesh Interconnects," in Proc. International Conference on High Performance Computing (HiPC'10), December 2010.
5. T. Agarwal, A. Sharma, A. Laxmikant, and L. Kale, "Topology-aware Task Mapping for Reducing Communication Contention on Large Parallel Machines," in Proc. 20th IEEE International Parallel and Distributed Processing Symposium (IPDPS'06), April 2006.
6. F. Bertrand, R. Bramley, A. Sussman, D. Bernholdt, J. Kohl, J. Larson, and K. Damevski, "Data Redistribution and Remote Method Invocation in Parallel Component Architectures," in Proc. 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05), April 2005.
7. C. Docan, M. Parashar, and S. Klasky, "DART: A Substrate for High Speed Asynchronous Data IO," in Proc. of 17th International Symposium on High Performance Distributed Computing (HPDC'08), June 2008.
8. G. Karypis and V. Kumar, "METIS - Unstructured Graph Partitioning and Sparse Matrix Ordering System, Version 2.0," Dept. of Computer Science, Univ. of Minnesota, Tech. Rep., 1995.
9. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz, "Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems," Sci. Program., vol. 13, pp. 219-237, July 2005.
10. C. Docan, M. Parashar, and S. Klasky, "DataSpaces: An Interaction and Coordination Framework for Coupled Simulation Workflows," in Proc. of 19th International Symposium on High Performance and Distributed Computing (HPDC'10), June 2010.
11. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E. A. Lee, J. Tao, and Y. Zhao, "Scientific Workflow Management and The Lepler System: Research Articles," Concurrency and Computation : Practical and Experience, vol. 18, pp. 1039-1065, August 2006.
12. G. Bosilca, A. Bouteiller, A. Danalis, M. Faverge, H. Haidar, T. Herault, J. Kurzak, J. Langou, P. Lemarinier, H. Ltaief, P. Luszczek, A. YarKhan, and J. Dongarra, "Distributed-Memory Task Execution and Dependence Tracking within DAGuE and the DPLASMA Project," Innovative Computing Laboratory, University of Tennessee, Tech. Rep., 2010.
13. C. Augonnet, S. Thibault, R. Namyst, and P.-A. Wacrenier, "StarPU: A Unified Platform for Task Scheduling on Heterogeneous Multicore Architectures," Concurrency and Computation: Practice and Experience, Special Issue: Euro-Par 2009, vol. 23, pp. 187-198, 2011.
14. R. Armstrong, D. Gannon, A. Geist, K. Keahey, S. Kohn, L. McInnes, S. Parker, and B. Smolinski, "Toward a Common Component Architecture for High-Performance Scientific Computing," in Proc. of 8th International Symposium on High Performance Distributed Computing (HPDC'99), August 1999.
15. G. Edjlali, A. Sussman, and J. H. Saltz, "Interoperability of Data Parallel Runtime Libraries," in Proc. of the 11th International Symposium on Parallel Processing (IPPS'97), April 1997.
16. J.-Y. Lee and A. Sussman, "High Performance Communication between Parallel Programs," in Proc. of the 19th International Parallel and Distributed Processing Symposium (IPDPS'05), April 2005.
17. J. Larson, R. Jacob, and E. Ong, "The Model Coupling Toolkit: A New Fortran90 Toolkit for Building Multiphysics Parallel Coupled Models," International Journal of High Performance Computing Applications (IJHPCA), vol. 19, pp. 277-292, August 2005.
18. P. Fasel and S. Mniszewski, "PAWS: Collective Interactions and Data Transfers," in Proc. of the 10th International Symposium on High Performance Distributed Computing (HPDC'01), August 2001.
19. H. Yu, C. Wang, R. Grout, J. Chen, and K.-L. Ma, "In Situ Visualization for Large-Scale Combustion Simulations," IEEE Computer Graphics and Applications, vol. 30, no. 3, pp. 45-57, 2010.
20. K.-L. Ma, "In Situ Visualization at Extreme Scale: Challenges and Opportunities," IEEE Computer Graphics and Applications, vol. 29, no. 6, pp. 14-19, 2009.
21. H. Childs, "Architectural Challenges and Solutions for Petascale Postprocessing," Journal of Physics: Conference Series, vol. 78, no. 1, p. 012012, 2007.
22. J.-M. F. Brad Whitlock and J. S. Meredith, "Parallel In Situ Coupling of Simulation with a Fully Featured Visualization System," in Proc. of 11th Eurographics Symposium on Parallel Graphics and Visualization (EGPGV'11), April 2011.
23. F. Zheng, H. Abbasi, C. Docan, J. Lofstead, S. Klasky, Q. Liu, M. Parashar, N. Podhorszki, K. Schwan, and M. Wolf, "PreDatA - preparatory data analytics on peta-scale machines," in Proc. of 24th IEEE International Parallel and Distributed Processing Symposium (IPDPS'10), April 2010.
24. H. Abbasi, G. Eisenhauer, M. Wolf, K. Schwan, and S. Klasky, "Just In Time: Adding Value to The IO Pipelines of High Performance Applications with JITStaging," in Proc. 20th International Symposium on High Performance Distributed Computing (HPDC'11), June 2011.
25. C. Docan, M. Parashar, J. Cummings, and S. Klasky, "Moving the Code to the Data - Dynamic Code Deployment Using ActiveSpaces," in Proc. 25th IEEE International Parallel and Distributed Processing Symposium (IPDPS'11), May 2011.