Evaluation of active storage strategies for the Lustre parallel file system

Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC'07

Volumn , Issue , 2007, Pages

  Piernas, Juan ^a   Nieplocha, Jarek ^a   Felix, Evan J ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE STORAGES; APPLICATION LEVELS; COMPUTING CAPACITIES; DATA MOVEMENTS; MEMORY RESOURCES; MICROBENCHMARK; NETWORK TRAFFICS; OPERATING SYSTEMS; PARALLEL FILE SYSTEMS; PROCESSING OPERATIONS; STORAGE NODES;

COMPUTERS; DATA PROCESSING; INTERNET;

DATA STORAGE EQUIPMENT;

EID: 56749169461     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1362622.1362660     Document Type: Conference Paper

References (28)

1. A. Acharya, M. Uysal, and J. Saltz. Active disks: Programming model, algorithms and evaluation. In Proc. of the ACM ASPLOS Conference, pages 81-91, October 1998.
2. P. J. Braam, R. Brightwell, and P. Schwan. Portals and networking for the lustre file system. In Proc. of IEEE Intern. Conf. on Cluster Computing, 2002.
3. P. J. Braam and R. Zahir. Lustre technical project summar. Attachment A to RFP B514193 Response, July 2001.
4. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur. PVFS: a parallel file system for linux clusters. In Proc. of 4th Annual Linux Showcase and Conference, October 2000.
5. Cluster File Systems Inc. Lustre: A scalable, high-performance file system. Available at www.lustre.org, 2002.
6. D. J. DeWitt and P. Hawthorn. A performance evaluation of database machine architectures. In Proc. of the Int. Conf. Very Large Data Bases (VLDB), pages 199-214, September 1981.
7. D. H. Du. Intelligent storage for information retrieval. In Proc. of the International Conference on Next Generation Web Services Practices (NWeSP'05), pages 214-220, 2005.
8. EMC. Centera. http://www.emc.com/products/systems/centera.jsp , 2007.
9. E. J. Felix, K. Fox, K. Regimbai, and J. Nieplocha. Active storage processing in a parallel file system. In Proc. of the 6th LCI International Conference on Linux Clusters: The HPC Revolution, April 2006.
10. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. In Proc. of the 19th ACM Symposium on Operating Systems Principles (SOSP'03), pages 29-43, October 2003.
11. G. A. Gibson, D. F. Nagle, K. Amiri, F. W. Chang, E. M. Feinberg, H. Gobioff, C. Lee, B. Ozceri, E. Riedel, D. Rochberg, and J. Zelenka. File server scaling with network-attached secure disks. In Proc. of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, pages 272-284, June 1997.
12. IBM. Storage Tank. http: //www.almaden.ibm.com/StorageSystems/ projects/storagetank , 2007.
13. IBM Corp. General parallel file system. http ://www.almaden.ibm.com/ StorageSystems/projects/gpfs , 2007.
14. INCITS Technical Committee T10. Scsi object-based storage device commands (OSD). working draft, revision 10. Available at http://www.t10.org/ftp/t10/ drafts/osd/osd-r10. pdf, July 2004.
15. K. Keeton, D. A. Patterson, and J. M. Hellerstein. A case for intelligent disks (IDISKs). In SIGMOD Record, 24(7):42-52, September 1998.
16. P. M. Kogge, J. B. Brockman, T. Sterling, and G. Gao. Processing in memory: Chips to petaflops. In Workshop on Mixing Logic and DRAM: Chips that Compute and Remember (at ISCA '97), June 1997.
17. H. Lim, V. Kapoor, C. Wighe, and D. H. Du. Active disk file system: A distributed, scalable file system. In Proc. of the 18th IEEE Symposium on Mass Storage Systems and Technologies, San Diego, pages 101-115, April 2001.
18. M. Mesnier, G. Ganger, and E. Riedel. Object-based storage. IEEE Communications Magazine, 41(8):84-90, August 2005.
19. S. Mitra, R. R. Sinha, and M. Winslett. An efficient, nonintrusive, log-based I/O mechanism for scientific simulations on clusters. In Proc. of IEEE International Conference on Cluster Computing, 2005.
20. R. A. Oldfield, A. B. Maccabe, S. Arunagiri, T. Kordenbrock, R. Riesen, L. Ward, and P. Widener. Lightweight I/O for scientific applications. Sandia National Laboratories. Technical Report SAND2006-3057, May 2006.
21. Panasas. The panasas activescale file system (PanFS). http ://www.panasas.com/panfs.html, 2007.
22. Red Hat Inc. Global file system. http ://www.redhat.com/software/rha/ gfs , 2007.
23. E. Riedel. Object based storage (OSD) architecture and systems. Available at http ://www.snia.org/education/tutorials/ 2006/fall/storage/ Object-based-Storage.pdf, October 2006.
24. E. Riedel, G. Gibson, and C. Faloutsos. Active storage for large-scale data mining and multimedia. In Proc. of the 24th Int. Conf. Very Large Data Bases (VLDB), pages 62-73, 1998.
25. S. W. Schlosser and S. Iren. Database storage management with object-based storage devices. In Proc. of the First International Workshop on Data Management on New Hardware (DaMoN), June 2005.
26. Seagate. The advantages of object-based storage - secure, scalable, dynamic storage devices. Available at www.Seagate.com/docs/pdf/whitepaper/ tp-536.pdf, April 2005.
27. SGI. Infinitestorage shared filesystem cxfs. http://www.sgi.com/ products/storage/tech/file-systems.html, 2007.
28. S. A. Weil, S. A. Brandt, E. L. Miller, D. D. Long, and C. Maltzahn. Ceph: A scalable, high-performance distributed file system. In Proc. of the 7th Conference on Operating Systems Design and Implementation (OSDI'06), pages 307-320, November 2006.