Enabling active storage on parallel I/O software stacks

2010 IEEE 26th Symposium on Mass Storage Systems and Technologies, MSST2010

Volumn , Issue , 2010, Pages

  Son, Seung Woo ^a   Lang, Samuel ^a   Carns, Philip ^a   Ross, Robert ^a   Thakur, Rajeev ^a   Ozisikyilmaz, Berkin ^b   Kumar, Prabhat ^b   Liao, Wei Keng ^b   Choudhary, Alok ^b  

^a ARGONNE NATIONAL LABORATORY   (United States)

^b Northwestern University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; DATA HANDLING; EMBEDDED SYSTEMS; FILE ORGANIZATION; INFORMATION ANALYSIS; SEMANTICS;

COLLECTIVE COMMUNICATIONS; COMPUTATIONAL LOADS; COMPUTATIONAL UNITS; INTER-SERVER COMMUNICATIONS; K - MEANS CLUSTERING; PARALLEL FILE SYSTEM; RUN-TIME INTERFACE; SOFTWARE STACKS;

DIGITAL STORAGE;

EID: 77957834705     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MSST.2010.5496981     Document Type: Conference Paper

References (51)

1. A. Acharya, M. Uysal, and J. H. Saltz. Active Disks: Programming Model, Algorithms and Evaluation. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems, pages 81-91, 1998.
2. Amazon. Amazon Simple Storage Service (Amazon S3). http://aws.amazon.com/ s3/.
3. K. Amiri, D. Petrou, G. R. Ganger, and G. A. Gibson. Dynamic Function Placement for Data-Intensive Cluster Computing. In Proceedings of the USENIX Technical Conference, pages 25-25, 2000.
4. D. Borthakur. HDFS Architecture. http://hadoop.apache.org/common/docs/ current/hdfs design.html.
5. J. B. Buck, N.Watkins, C. Maltzahn, and S. A. Brandt. Abstract Storage: Moving File Format-Specific Abstractions Intopetabyte-Scale Storage Systems. In Proceedings of the Second International Workshop on Data-Aware Distributed Computing, pages 31-40, 2009.
6. P. H. Carns. Achieving Scalability in Parallel File Systems. PhD dissertation, Clemson University, Department of Electrical and Computer Engineering, May 2005.
7. P. H. Carns, W. B. L. III, R. B. Ross, and R. Thakur. PVFS: A Parallel File System for Linux Clusters. In Proceedings of the Annual Linux Showcase and Conference, pages 317-327, 2000.
8. P. H. Carns, B. W. Settlemyer, and I. Water B. Ligon. Using Server to Server Communication in Parallel File Systems to Simplify Consistency and Improve Performance. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis, November 2008.
9. D. Chambliss, P. Pandey, T. Thakur, A. Fleshler, T. Clark, J. A. Ruddy, K. D. Gougherty, M. Kalos, L. Merithew, J. G. Thompson, and H. M. Yudenfriend. An Architecture for Storage-Hosted Application Extensions. IBM J. Res. Dev., 52(4):427-437, 2008.
10. J. Chen. Terascale Direct Numerical Simulations of Turbulent Combustion. In Proceedings of the ACM/IEEE Conference on Supercomputing, page 55, 2006.
11. A. Chervenak, J. M. Schopf, L. Pearlman, M.-H. Su, S. Bharathi, L. Cinquini, M. D'Arcy, N. Miller, and D. Bernholdt. Monitoring the Earth System Grid with MDS4. In Proceedings of the IEEE International Conference on e-Science and Grid Computing, 2006.
12. S. Chiu, W. keng Liao, and A. N. Choudhary. Design and Evaluation of Distributed Smart Disk Architecture for I/O-Intensive Workloads. In Proceedings of the International Conference on Computational Science, pages 230-241, 2003.
13. M. L. Curry, A. Skjellum, H. L. Ward, and R. Brightwell. Arbitrary Dimension Reed-Solomon Coding and Decoding for Extended RAID on GPUs. In Proceedings of the Petascale Data Storage Workshop, 2008.
14. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the USENIX Symposium on Operating System Design and Implementation, pages 137-150, 2004.
15. D. J. DeWitt and P. B. Hawthorn. A Performance Evaluation of Data Base Machine Architectures. In Proceedings of the International Conference on Very Large Data Bases, pages 199-214, 1981.
16. EMC Corporation. EMC Symmetrix V-Max Storage System Specification Sheet, 2009.
17. E. J. Felix, K. Fox, K. Regimbal, and J. Nieplocha. Active Storage Processing in a Parallel File System. In Proceedings of the 6th LCI International Conference on Linux Clusters: The HPC Revolution, 2005.
18. B. G. Fitch, A. Rayshubskiy, M. C. Pitman, T. C. Ward, and R. S. Germain. Using the Active Storage Fabrics Model to Address Petascale Storage Challenges. In Proceedings of the 4th Petascale Data Storage Workshop, 2009.
19. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google File System. In Proceedings of the ACM Symposium on Operating Systems Principles, pages 29-43, 2003.
20. A. Grama, G. Karypis, V. Kumar, and A. Gupta. Introduction to Parallel Computing (2nd edition). Addison Wesley, 2003.
21. W. Gropp, E. Lusk, and R. Thakur. Using MPI-2: Advanced Features of the Message-Passing Interface. The MIT Press, Cambridge, MA, 1999.
22. Hadoop. http://hadoop.apache.org/.
23. W. Hsu, A. J. Smith, and H. C. Young. Projecting the Performance of Decision Support Workloads on Systems with Smart Storage (Smart-STOR). In Proceedings of the International Conference on Parallel and Distributed Processing, pages 417-425, 2000.
24. L. Huston, R. Sukthankar, R. Wickremesinghe, M. Satyanarayanan, G. R. Ganger, E. Riedel, and A. Ailamaki. Diamond: A Storage Architecture for Early Discard in Interactive Search. In Proceedings of the USENIX Conference on File and Storage Technologies, pages 73-86, 2004.
25. K. Keeton, D. A. Patterson, and J. M. Hellerstein. A Case for Intelligent Disks (IDISKs). SIGMOD Record, 27(3):42-52, 1998.
26. S. Klasky. Personal Correspondence, June 2008.
27. P. M. Kogge, S. C. Bass, J. B. Brockman, D. Z. Chen, and H. S. E. Pursuing a Petaflop: Point Designs for 100TF Computers Using PIM Technologies. In Proceedings of the Symposium on Frontiers of Massively Parallel Computation, pages 25-31, October 1996.
28. D. T. Larose. Data Mining Methods and Models. John Wiley & Sons, 2006.
29. J. Li, W.-k. Liao, A. Choudhary, R. Ross, R. Thakur, W. Gropp, R. Latham, A. Siegel, B. Gallagher, and M. Zingale. Parallel netCDF: A High-Performance Scientific I/O Interface. In Proceedings of the ACM/IEEE Conference on Supercomputing, page 39, 2003.
30. G. Memik, M. T. Kandemir, and A. N. Choudhary. Design and Evaluation of Smart Disk Architecture for DSS Commercial Workloads. In Proceedings of the International Conference on Parallel Processing, pages 335-, 2000.
31. Netezza Corporation. The Netezza Data Appliance Architecture: A Platform for High Performance Data Warehousing and Analytics, 2009.
32. NVIDIA. CUDA Programming Guide 2.3. http://www.nvidia.com/.
33. R. Oldfield and D. Kotz. Improving Data Access for Computational Grid Applications. Cluster Computing, 9(1):79-99, 2006.
34. S. Patil, G. A. Gibson, G. R. Ganger, J. Lopez, M. Polte, W. Tantisiroj, and L. Xiao. In Search of an API for Scalable File Systems: Under the Table or Above It? In USENIX HotCloud Workshop, June 2009.
35. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden, and M. StoneBraker. A Comparison of Approches to Large-Scale Data Analysis. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 2009.
36. T. Peterka, H. Yu, R. Ross, K.-L. Ma, and R. Latham. End-to-End Study of Parallel Volume Rendering on the IBM Blue Gene/P. In Proceedings of the International Conference on Parallel Processing, 2009.
37. J. Piernas and J. Nieplocha. Efficient Management of Complex Striped Files in Active Storage. In Proceedings of the Euro-Par Conference, pages 676-685, 2008.
38. J. Piernas, J. Nieplocha, and E. J. Felix. Evaluation of Active Storage Strategies for the Lustre Parallel File System. In Proceedings of the International Conference on High Performance Computing, Networking, Storage, and Analysis, page 28, 2007.
39. L. Qiao, V. Raman, I. Narang, P. Pandey, D. Chambliss, G. Fuh, J. Ruddy, Y.-L. Chen, K.-H. Yang, and F.-L. Lin. Integration of Server, Storage and Database Stack: Moving Processing Towards Data. In Proceedings of the IEEE 24th International Conference on Data Engineering, pages 1200-1208, 2008.
40. E. Riedel, G. A. Gibson, and C. Faloutsos. Active Storage for Large-Scale Data Mining and Multimedia. In Proceedings of the International Conference on Very Large Data Bases, pages 62-73, 1998.
41. K. Riley. Personal Correspondence, July 2008.
42. F. Schmuck and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In Proceedings of the USENIX Conference on File and Storage Technologies, pages 231-244, 2002.
43. M. Sivathanu, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Evolving RPC for Active Storage. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems, pages 264-276, 2002.
44. M. Sivathanu, L. N. Bairavasundaram, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Database-Aware Semantically-Smart Storage. In Proceedings of the USENIX Conference on File and Storage Technologies, pages 239-252, 2005.
45. M. Sivathanu, V. Prabhakaran, F. I. Popovici, T. E. Denehy, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Semantically-Smart Disk Systems. In Proceedings of the USENIX Conference on File and Storage Technologies, pages 73-88, 2003.
46. SUN Microsystems. Lustre File System. http://www.sun.com/software/ products/lustre/.
47. Unidata. NetCDF home page, 2001.
48. U.S. Department of Energy. DOE Genomics:GTL Roadmap - Systems Biology for Energy and Environment. DOE/SC-0090, August 2005.
49. M. Uysal, A. Acharya, and J. H. Saltz. Evaluation of Active Disks for Decision Support Databases. In Proceedings of the International Symposium on High-Performance Computer Architecture, pages 337-348, 2000.
50. R. Wickremesinghe, J. S. Chase, and J. S. Vitter. Distributed Computing with Load-Managed Active Storage. In Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, pages 13-23, 2002.
51. M. Zaharia, A. Konwinski, A. D. Joseph, R. H. Katz, and I. Stoica. Improving MapReduce Performance in Heterogeneous Environments. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation, pages 29-42, 2008.