Integrating parallel file systems with object-based storage devices

Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC'07

Volumn , Issue , 2007, Pages

  Devulapalli, Ananth ^a   Dalessandro, Dennis ^a   Wyckoff, Pete ^a   Ali, Nawab ^b   Sadayappan, P ^b  

^a OHIO SUPERCOMPUTER CENTER   (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA LAYOUTS; DATA OBJECTS; INFRA STRUCTURES; METADATA SERVERS; OBJECTBASED STORAGES; OVERALL PERFORMANCES; PARALLEL FILE SYSTEMS; PERFORMANCE IMPROVEMENTS; STORAGE DEVICES; STORAGE SYSTEMS;

ARSENIC; COMPUTERS; DISKS (STRUCTURAL COMPONENTS); METADATA;

DATA STORAGE EQUIPMENT;

EID: 56749165165     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1362622.1362659     Document Type: Conference Paper

References (36)

1. P. H. Carns, W. B. Ligon III, R. Ross, and P. Wyckoff. BMI: a network abstraction layer for parallel I/O. In Proceedings of IPDPS'05, CAC workshop, Denver, CO, Apr. 2005.
2. P. H. Cams, W. B. Ligon III, R. B. Ross, and R. Thakur. PVFS: A parallel file system for Linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317-327, 2000.
3. Cluster File Systems, Inc. Lustre frequently asked questions. http://www.clusterfs.com/faq.html.
4. Cluster File Systems, Inc. Lustre: a scalable high-performance file system. Technical report, Cluster File Systems, Nov. 2002. http://www.lustre. org/docs/whitepaper.pdf.
5. A. Devulapalli and P. Wyckoff. File creation strategies in a distributed metadata file system. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS'07), Mar. 2007.
6. D. Du, D. He, C. Hong, J. Jeong, et al. Experiences in building an object-based storage system based on the OSD T-10 standard. In Proceedings of MSST'06, College Park, MD, May 2006.
7. M. Factor, K. Meth, D. Naor, O. Rodeh, and J. Satran. Object storage: The future building block for storage systems. In Global Data Interoperability - Challenges and Technologies, Sardinia, Italy, June 2005.
8. M. Factor, D. Nagle, D. Naor, E. Riedel, and J. Satran. The OSD security protocol. In Security in Storage Workshop (SISW'05), San Francisco, CA, Dec. 2005.
9. T. Fujita and M. Christie. tgt: framework for storage target drivers. In Proceedings of the Ottawa Linux Symposium, Ottawa, Canada, July 2006.
10. G. A. Gibson and R. V. Meter. Network attached storage architecture. Communications of the A CM, 43(11):37-45, Nov. 2000.
11. G. A. Gibson, D. F. Nagle, K. Amiri, J. Butler, et al. A cost-effective, high-bandwidth storage architecture. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-VIII), pages 92-103, 1998.
12. G. Goodson, B. Welch, B. Halevy, D. Black, and A. Adamson. NFSv4 pNFS extensions. Technical Report draft-ietf-nfsv4-pnfs-00.txt, IETF, Oct. 2005.
13. B. Halevy, B. Welch, J. Zelenka, and T. Pisek. Object-based pNFS Operations. Technical Report draft-ietf-nfsv4-pnfs-obj-00.txt, IETF, Jan. 2006.
14. D. R. Hipp et al. SQLite. http://www.sqlite.org/, 2007.
15. IBM Research. ObjectStone. http://www.haifa.il.ibm.com/projects/storage/ objectstore/objectstone.html.
16. InfiniBand Trade Association. InfiniBand Architecture Specification, Oct. 2004.
17. Intel Inc. et al. Intel open storage toolkit. http://sourceforge.net/ projects/intel-iscsi/, 2007.
18. M. Mathis, J. Semke, J. Mahdavi, and T. Ott. The macroscopic behavior of the TCP congestion avoidance algorithm. Computer Communications Review, 27(3), July 1997.
19. J. H. Morris, M. Satyanarayanan, M. H. Conner, J. H. Howard, D. S. Rosenthal, and F. D. Smith. Andrew: a distributed personal computing environment. Communications of the ACM, 29(3):184-201, 1986.
20. D. Nagle, D. Serenyi, and A. Matthews. The Panasas ActiveScale storage cluster - delivering scalable high bandwidth storage. In Proceedings of the ACM/IEEE SC2004 Conference (SC'04), Pittsburgh, PA, Nov. 2004.
21. B. Pawlowski, C. Juszczak, P. Staubach, C. Smith, D. Lebel, and D. Hitz. NFS version 3: Design and implementation. In USENIX Summer Technical Conference, pages 137-152, 1994.
22. O. Rodeh. Building a distributed database with device-served leases. Technical report, IBM Haifa labs, 2005.
23. D. Roselli, J. Lorch, and T. Anderson. A comparison of file system workloads. In Proceedings of the 2000 USENIX Annual Technical Conference, pages 41-54, June 2000.
24. R. Rosner, A. Calder, J. Dursi, B. Fryxell, et al. Flash code: Studying astrophysical thermonuclear flashes. In Computing in Science and Engineering, volume 2, pages 33-41, Mar. 2000.
25. R. Ross, D. Nurmi, A. Cheng, and M. Zingale. A case study in application I/O on linux clusters. In Proceedings of SC '01, Denver, CO, 2001.
26. J. Satran, K. Meth, C. Sapuntzakis, M. Chadalapaka, and E. Zeidner. Internet small computer systems interface (iSCSI). Technical report, IETF RFC 3720, Apr. 2004.
27. S. Shepler, B. Callaghan, D. Robinson, R. Thurlow, C. Beame, M. Eisler, and D. Noveck. Network file system (NFS) version 4 protocol. Technical report, IETF RFC 3530, Apr. 2003.
28. Sun Inc. et al. Solaris object storage device (OSD). http://www. opensolaris.org/os/project/osd/, 2007.
29. F. Tomonori and O. Masanori. Analysis of iSCSI target software. In SNAPI '04: Proceedings of the international workshop on storage network architecture and parallel I/Os, pages 25-32, 2004.
30. S. Tweedie. Ext3, journaling filesystem. In Proceedings of the Ottawa Linux Symposium, Ottawa, Canada, July 2000.
31. F. Wang, S. A. Brandt, E. L. Miller, and D. D. E. Long. OBFS: A file system for object-based storage devices. In 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST'04), pages 283-300, College Park, MD, Apr. 2004.
32. F. Wang, Q. Xin, B. Hong, S. A. Brandt, E. L. Miller, D. D. E. Long, and T. T. McLarty. File system workload analysis for large scale scientific computing applications. In Proceedings of the Twentieth IEEE/Eleventh NASA Goddard Conference on Mass Storage Systems and Technologies, College Park, MD, Apr. 2004.
33. R. O. Weber. Information technology - SCSI Primary commands - 3 (SPC-2), revision 23. Technical report, INCITS Technical Committee T10/1416-D, May 2005.
34. R. O. Weber. Information technology - SCSI object-based storage device commands -2 (OSD-2), revision 1. Technical report, INCITS Technical Committee T10/1729-D, Jan. 2007.
35. S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn. Ceph: A scalable, high-performance distributed file system. In Proceedings of OSDI'06, pages 307-320, Seattle, WA, Nov. 2006.
36. P. Wong and R. der Wijngaart. NAS parallel benchmarks I/O version 2.4. Technical Report NAS-03-002, NASA Ames Research Center, Moffet Field, CA, Jan. 2003.