Exploring energy and performance behaviors of data-intensive scientific workflows on systems with deep memory hierarchies

20th Annual International Conference on High Performance Computing, HiPC 2013

Volumn , Issue , 2013, Pages 226-235

  Gamell, Marc ^a   Rodero, Ivan ^a   Parashar, Manish ^a   Poole, Stephen ^b  

^a RUTGERS UNIVERSITY   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER ARCHITECTURE; DATA PROCESSING; ELECTRONIC DATA INTERCHANGE; INFORMATION MANAGEMENT;

DATA MANAGEMENT STRATEGIES; INTERMEDIATE STORAGE; LARGE SCALE SCIENTIFIC SIMULATIONS; MEMORY HIERARCHY; NON-VOLATILE MEMORY; PERFORMANCE GAPS; SCIENTIFIC WORKFLOWS; SYSTEM ARCHITECTURES;

DIGITAL STORAGE;

EID: 84900329812     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HiPC.2013.6799122     Document Type: Conference Paper

References (36)

1. C. Docan, M. Parashar, and S. Klasky, "Dataspaces: an interaction and coordination framework for coupled simulation workflows," in Intl. Symp. on High Performance Distributed Computing, 2010, pp. 25-36.
2. H. Abbasi, M. Wolf, G. Eisenhauer, S. Klasky, K. Schwan, and F. Zheng, "Datastager: scalable data staging services for petascale applications," in Proc. of 18th Intl. Symp. on High Performance Distributed Computing (HPDC'09), 2009.
3. F. Zheng, H. Abbasi, C. Docan, J. F. Lofstead, Q. Liu, S. Klasky, M. Parashar, N. Podhorszki, K. Schwan, and M. Wolf, "Predata - preparatory data analytics on peta-scale machines," in Intl. Symp. on Parallel and Distributed Processing, 2010, pp. 1-12.
4. A. M. Caulfield, L. M. Grupp, and S. Swanson, "Gordon: using flash memory to build fast, power-efficient clusters for data-intensive applications," in Intl. Conf. on Architectural support for programming languages and operating systems, 2009, pp. 217-228.
5. S. Kannan, A. Gavrilovska, K. Schwan, D. Milojicic, and V. Talwar, "Using active nvram for i/o staging," in Intl. workshop on Petascal data analytics: challenges and opportunities, 2011, pp. 15-22.
6. A. M. Caulfield, A. De, J. Coburn, T. I. Mollow, R. K. Gupta, and S. Swanson, "Moneta: A high-performance storage array architecture for next-generation, non-volatile memories," in IEEE/ACM Intl. Symp. on Microarch., 2010, pp. 385-395.
7. D. H. Yoon, T. Gonzalez, P. Ranganathan, and R. S. Schreiber, "Exploring latency-power tradeoffs in deep nonvolatile memory hierarchies," in Conf. on Comp. Frontiers, 2012, pp. 95-102.
8. M. K. Qureshi, V. Srinivasan, and J. A. Rivers, "Scalable high performance main memory system using phase-change memory technology," in Annual Intl. Symp. on Computer Arch., 2009, pp. 24-33.
9. D. B. Strukov, G. S. Snider, D. R. Stewart, and R. S. Williams, "The missing memristor found," Nature, vol. 453, pp. 80-83, May 2008.
10. A. N. Cockcroft, "Millicomputing: The coolest computers and the flashiest storage," in Intl. Computer Measurement Group Conference, 2007, pp. 407-414.
11. Y. Joo, J. Ryu, S. Park, and K. G. Shin, "Fast: quick application launch on solid-state drives," in USENIX Conf. on File and stroage technologies, 2011, pp. 19-19.
12. K. El Maghraoui, G. Kandiraju, J. Jann, and P. Pattnaik, "Modeling and simulating flash based solid-state disks for operating systems," in WOSP/SIPEW Intl. Conf. on Performance engineering, 2010, pp. 15-26.
13. S. Chen, "Flashlogging: exploiting flash devices for synchronous logging performance," in ACM SIGMOD Intl. Conf. on Management of data, 2009, pp. 73-86.
14. D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan, "Fawn: a fast array of wimpy nodes," in SIGOPS Symp. on Operating systems principles, 2009, pp. 1-14.
15. S. Kang, S. Park, H. Jung, H. Shim, and J. Cha, "Performance trade-offs in using nvram write buffer for flash memory-based storage devices," IEEE Trans. Comput., vol. 58, no. 6, pp. 744-758, Jun. 2009.
16. A. Akel, A. M. Caulfield, T. I. Mollov, R. K. Gupta, and S. Swanson, "Onyx: a protoype phase change memory storage array," in USENIX Conf. on Hot topics in storage and file systems, 2011, pp. 2-2.
17. X. Dong, N. Muralimanohar, N. Jouppi, R. Kaufmann, and Y. Xie, "Leveraging 3d pcram technologies to reduce checkpoint overhead for future exascale systems," in Conf. on High Performance Computing Networking, Storage and Analysis (SC), 2009, pp. 57:1-57:12.
18. S. Kannan, D. Milojicic, V. Talwar, A. Gavrilovska, K. Schwan, and H. Abbasi, "Using active nvram for cloud i/o," in Sixth Open Cirrus Summit, 2011, pp. 32-36.
19. J. Cohen, D. Dossa, M. Gokhale, D. Hysom, J. May, P. Pearce, and A. Yoo, "Storage-intensive supercomputing benchmark study," Lawrence Livermore National Laboratory, Tech. Rep. UCRL-TR- 236179, November 2007.
20. A. M. Caulfield, J. Coburn, T. Mollov, A. De, et al., "Understanding the impact of emerging non-volatile memories on high-performance, iointensive computing," in Intl. Conf. for High Performance Computing, Networking, Storage and Analysis (SC), 2010, pp. 1-11.
21. J. He, A. Jagatheesan, S. Gupta, J. Bennett, and A. Snavely, "Dash: a recipe for a flash-based data intensive supercomputer," in Intl. Conf. for High Performance Computing, Networking, Storage and Analysis (SC), 2010, pp. 1-11.
22. M. Polte, J. Simsa, and G. Gibson, "Comparing performance of solid state devices and mechanical disks," in Petascale Data Storage Workshop, 2008, pp. 1-7.
23. K. Lim, P. Ranganathan, J. Chang, C. Patel, T. Mudge, and S. Reinhardt, "Understanding and designing new server architectures for emerging warehouse-computing environments," in Annual Intl. Symp. on Computer Arch., 2008, pp. 315-326.
24. S. Rivoire, M. A. Shah, P. Ranganathan, and C. Kozyrakis, "Joulesort: a balanced energy-efficiency benchmark," in SIGMOD Intl. Conf. on Management of data, 2007, pp. 365-376.
25. X. Dong, X. Wu, Y. Xie, Y. Chen, and H. Li, "Stacking mram atop microprocessors: An architecture-level evaluation," IET Computers & Digital Techniques, vol. 5, no. 3, pp. 213-220, Jun. 2011.
26. V. Vasudevan, D. Andersen, M. Kaminsky, L. Tan, J. Franklin, and I. Moraru, "Energy-efficient cluster computing with fawn: workloads and implications," in Intl. Conf. on Energy-Efficient Computing and Networking, 2010, pp. 195-204.
27. J. D. Davis and S. Rivoire, "Building energy-efficient systems for sequential workloads," Microsoft Research, Tech. Rep. MSR-TR-2010- 30, March 2010.
28. D. Li, J. S. Vetter, G. Marin, C. McCurdy, C. Cira, Z. Liu, and W. Yu, "Identifying opportunities for byte-addressable non-volatile memory in extreme-scale scientific applications," in Intl. Parallel and Distr. Processing Symp., 2012, pp. 945-956.
29. B. Whitlock, J.-M. Favre, and J. S. Meredith, "Parallel In Situ Coupling of Simulation with a Fully Featured Visualization System," in Proc. of 11th Eurographics Symp. on Parallel Graphics and Visualization (EGPGV'11), April 2011.
30. S. Lakshminarasimhan and et. al., "Isabela-qa: Query-driven analytics with isabela-compressed extreme-scale scientific data," in Intl. Conf. for High Performance Computing, Networking, Storage and Analysis (SC), November 2011, pp. 1 -11.
31. M. Li, S. S. Vazhkudai, A. R. Butt, F. Meng et al., "Functional partitioning to optimize end-to-end performance on many-core architectures," in Intl. Conf. for High Performance Computing, Networking, Storage and Analysis (SC), November 2010, pp. 1-12.
32. F. Zhang, C. Docan, M. Parashar, S. Klasky, N. Podhorszki, and H. Abbasi, "Enabling in-situ execution of coupled scientific workflow on multi-core platform," in IEEE Intl. Parallel and Distributed Processing Symp. (IPDPS), 2012.
33. M. Gamell, I. Rodero, M. Parashar, J. Bennett et al., "Exploring Power Behaviors and Tradeoffs of In-situ Data Analytics," in Intl. Conf. on High Performance Computing Networking, Storage and Analysis (SC), Denver, CO, Nov. 2013, pp. 1-12.
34. H. Abbasi, G. Eisenhauer, M. Wolf, K. Schwan, and S. Klasky, "Just In Time: Adding Value to The IO Pipelines of High Performance Applications with JITStaging," in Proc. of 20th Intl. Symp. on High Performance Distributed Computing (HPDC'11), June 2011.
35. C. Docan, M. Parashar, J. Cummings, and S. Klasky, "Moving the Code to the Data - Dynamic Code Deployment Using ActiveSpaces," in IEEE Intl. Parallel and Distributed Processing Symp. (IPDPS'11), May 2011.
36. J. C. Bennett, H. Abbasi, P.-T. Bremer, R. Grout et al., "Combining in-situ and in-transit processing to enable extreme-scale scientific analysis," in Intl. Conf. on High Performance Computing, Networking, Storage and Analysis (SC), 2012, pp. 49:1-49:9.