Moving the code to the data - Dynamic code deployment using activespaces

Proceedings - 25th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2011

Volumn , Issue , 2011, Pages 758-769

  Docan, Ciprian ^a   Parashar, Manish ^a   Cummings, Julian ^b   Klasky, Scott ^c  

^a RUTGERS UNIVERSITY   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

coupled simulations; data intensive application workflows; dynamic code deployment; in situ data processing

Indexed keywords

ACTIVE SPACES; CODE DEPLOYMENT; COMPUTING NODES; CONSUMER NODES; COUPLED SIMULATION; CRITICAL CHALLENGES; DATA-INTENSIVE APPLICATION; ENGINEERING SIMULATION; EXPERIMENTAL PERFORMANCE EVALUATIONS; FUSION APPLICATIONS; I/O OPERATIONS; OAK RIDGE NATIONAL LABORATORY; PROGRAMMING SUPPORT; RESEARCH EFFORTS; RUNTIMES; SWEET SPOT;

DISTRIBUTED PARAMETER NETWORKS;

DATA HANDLING;

EID: 80053222791     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2011.120     Document Type: Conference Paper

References (27)

1. C. S. Chang, S. Ku, and H. Weitzner, "Numerical Study of Neoclassical Plasma Pedestal in a Tokamak Geometry," Phys. Plasmas, vol. 11, no. 5, pp. 2649-2667, 2004.
2. H. R. Wilson, P. B. Snyder, G. T. A. Huysmans, and R. L. Miller, "Numerical Studies of Edge Localized Instabilities in Tokamaks," Physics Plasmas, vol. 9, p. 1277, 2002.
3. W. Park, E. V. Belova, G. Y. Fu, X. Z. Tang, H. R. Strauss, and L. E. Sugiyama, "Plasma simulation studies using multilevel physics models,"Phys. Plasmas, vol. 6, no. 5, pp. 1796-1803, 1999. (Pubitemid 129606692)
4. J. Lofstead, F. Zheng, S. Klasky, and K. Schwan, "Adaptable, Metadata Rich IO Methods for Portable High Performance IO," in Proc. of International Parallel and Distributed Processing Symposium (IPDPS'09), May 2009.
5. K. Coloma, A. Ching, A. Choudhary, W. keng Liao, R. Ross, R. Thakur, and L. Ward, "A New Flexible MPI Collective I/O Implementation,"in Proc. of the IEEE International Conference on Cluster Computing (Cluster'06), September 2006.
6. H. Abbasi, M. Wolf, G. Eisenhauer, F. Zheng, K. Schwan, and S. Klasky, "DataStager: Scalable Data Staging Services for Petascale Applications,"in Proc. of 18th International Symposium on High Performance Distributed Computing (HPDC'09), June 2009.
7. C. Docan, M. Parashar, and S. Klasky, "Enabling High Speed Asynchronous Data Extraction and Transfer Using DART," Concurrency and Computation: Practice and Experience, vol. 22, no. 9, pp. 1181-1204, 2010.
8. S. S. Lumetta and D. E. Culler, "Managing Concurrent Access for Shared Memory Active Messages," in Proc. of 12th International Parallel Processing Symposium and 9th Symposium on Parallel and Distributed Processing (IPPS/SPDP'98), March 1998.
9. C. Docan, M. Parashar, and S. Klasky, "DataSpaces: An Interaction and Coordination Framework for Coupled Simulation Workflows," in Proc. of 19th International Symposium on High Performance Distributed Computing (HPDC'10), June 2010.
10. F. Zheng, H. Abbasi, C. Docan, J. Lofstead, Q. Liu, S. Klasky, M. Parashar, N. Podhorszki, K. Schwan, and M. Wolf, "PreDatA: Preparatory Data Analytics on Peta-Scale Machines," in Proc. of International Parallel and Distributed Processing Symposium (IPDPS'09), April 2010.
11. J. Lofstead, F. Zheng, Q. Liu, S. Klasky, R. Oldfield, T. Kordenbrock, K. Schwan, and M. Wolf, "Managing Variability in the IO Performance of Petascale Storage Systems," in Proc. of the Conference on High Performance Computing Networking, Storage and Analysis (SC'10), November 2010, to appear.
12. P. J. Braam, "Lustre: A Scalable High Performance File System," 2002. [Online]. Available: http://www.lustre.org/docs/whitepaper.pdf
13. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," in Proc. of 6th Symposium on Operating Systems Design and Implementation (OSDI'04), December 2004.
14. Intel® 64 and IA-32 Architectures Software Developers Manual: Volume 2A, http://www.intel.com/Assets/PDF/manual/253666.pdf, Intel Corporation, June 2010.
15. Intel® 64 and IA-32 Architectures Software Developers Manual: Volume 2B, http://www.intel.com/Assets/PDF/manual/253667.pdf, Intel Corporation, June 2010.
16. R. Riley, X. Jiang, and D. Xu, "An Architectural Approach to Preventing Code Injection Attacks," in Proc. of International Conference on Dependable Systems and Networks (DSN'07), June 2007.
17. U. Drepper, "How To Write Shared Libraries," July 2002. [Online]. Available: http://www.akkadia.org/drepper/dsohowto.pdf
18. E. Riedel, C. Faloutsos, G. A. Gibson, and D. Nagle, "Active Disks for Large-Scale Data Processing," IEEE Computer, vol. 34, no. 6, pp. 68-74, 2001. (Pubitemid 32527648)
19. E. Riedel, "Active Disks - Remote Execution for Network-Attached Storage," Ph.D. dissertation, Carnegie Mellon University, November 1999.
20. J. Piernas, J. Nieplocha, and E. J. Felix, "Evaluation of Active Storage Strategies for the Lustre Parallel File System," in Proc. of Super Computing Conference (SC'07), November 2007.
21. J. D. Owens, M. Houston, D. Luebke, S. Green, J. E. Stone, and J. C. Phillips, "GPU Computing," Proceedings of the IEEE, vol. 96, no. 5, pp. 879-899, May 2008.
22. P. Bellens, J. M. Perez, R. M. Badia, and J. Labarta, "CellSs: a Programming Model for the Cell BE Architecture," in Proc. of Super Computing Conference (SC'06), November 2006.
23. M. Beynon, R. Ferreira, T. Kurc, A. Sussman, and J. Saltz, "DataCutter: Middleware for Filtering Very Large Scientific Datasets on Archival Storage Systems," in Proc. of 17th IEEE Symposium on Mass Storage Systems, March 2000.
24. V. Bhat, M. Parashar, and S. Klasky, "Experiments with In-Transit Processing for Data Intensive Grid workflows," in Proc. of the 8th IEEE International Conference on Grid Computing (Grid'07), September 2007.
25. K. Amiri, D. Petrou, G. R. Ganger, and G. A. Gibson, "Dynamic Function Placement for Data-intensive Cluster Computing," in Proc. of USENIX Annual Technical Conference (USENIX'00), June 2000.
26. B. Buck and J. K. Hollingsworth, "An API for Runtime Code Patching,"International Journal of High Performance Computing Applications, vol. 14, no. 4, pp. 317-329, 2000.
27. F. E. Bustamante, "The Active Streams Approach to Adaptive Distributed Applications and Services," Ph.D. dissertation, Georgia Instritute of Technology, November 2001.