An OSD-based approach to managing directory operations in parallel file systems

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn Proceedings of the 2008 IEEE International Conference on Cluster Computing, ICCC 2008, Issue , 2008, Pages 175-184

  Ali, Nawab ^a   Devulapalli, Ananth ^b   Dalessandro, Dennis ^b   Wyckoff, Pete ^b   Sadayappan, P ^a  

^a Ohio State University   (United States)

^b OHIO SUPERCOMPUTER CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; DATA STORAGE EQUIPMENT; INDUSTRIAL MANAGEMENT;

DATA THROUGHPUTS; DIRECTORY STRUCTURES; DISTRIBUTED FILE SYSTEMS; METADATA MANAGEMENTS; MULTIPLE SERVERS; PARALLEL FILE SYSTEMS; PERFORMANCE RESULTS;

METADATA;

EID: 57949087505     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2008.4663769     Document Type: Conference Paper

References (29)

1. CERN, "The large hadron collider," http://lhc.web.cern.ch/lhc/.
2. ESG, "The earth system grid," http://www.earthsystemgrid.org/.
3. SDSS, "Sloan digital sky survey," http://www.sdss.org/.
4. S. A. Weil, K. T. Pollack, S. A. Brandt, and E. L. Miller, "Dynamic metadata management for petabyte-scale file systems," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2004, p. 4.
5. InfiniBand Architecture Specification, http://www.infinibandta. org/specs/, InfiniBand Trade Association, Oct. 2004.
6. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur, "PVFS: A parallel file system for Linux clusters," in Proceedings of the 4th Annual Linux Showcase and Conference, 2000, pp. 317-327.
7. Cluster File Systems, Inc., "Lustre: a scalable high-performance file system," Cluster File Systems, Tech. Rep., Nov. 2002, http://www.lustre.org/docs/whitepaper.pdf.
8. S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn, "Ceph: A scalable, high-performance distributed file system," in Proceedings of OSDI'06, Seattle, WA, Nov. 2006, pp. 307-320.
9. D. Nagle, D. Serenyi, and A. Matthews, "The Panasas ActiveScale storage cluster - delivering scalable high bandwidth storage," in Proceedings of the ACM/IEEE SC2004 Conference (SC'04), Pittsburgh, PA, Nov. 2004.
10. D. Roselli, J. Lorch, and T. Anderson, "A comparison of file system workloads," in Proceedings of the 2000 USENIX Annual Technical Conference, Jun. 2000, pp. 41-54.
11. F. Wang, S. A. Brandt, E. L. Miller, and D. D. E. Long, "OBFS: A file system for object-based storage devices," in 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST'04), College Park, MD, Apr. 2004, pp. 283-300.
12. F. Wang, Q. Xin, B. Hong, S. A. Brandt, E. L. Miller, D. D. E. Long, and T. T. McLarty, "File system workload analysis for large scale scientific computing applications," in Proceedings of the Twentieth IEEE/Eleventh NASA Goddard Conference on Mass Storage Systems and Technologies, College Park, MD, Apr. 2004.
13. R. O. Weber, "Information technology - SCSI object-based storage device commands -2 (OSD-2), revision 1," INCITS Technical Committee T10/1729-D, Tech. Rep., Jan. 2007.
14. A. Devulapalli, D. Dalessandro, P. Wyckoff, N. Ali, and P. Sadayappan, "Integrating parallel file systems with object-based storage devices," in Proceedings of SC'07, Reno, NV, Nov. 2007.
15. N. Ali, A. Devulapalli, D. Dalessandro, P. Wyckoff, and P. Sadayappan, "Revisiting the metadata architecture of parallel file systems," http://www.cse.ohio-state.edu/~alin/papers/osd-md-techreport.pdf, The Ohio State University, Tech. Rep. OSU-CISRC-7/08-TR42, 2008.
16. D. Dalessandro, A. Devulapalli, and P. Wyckoff, "iSER storage target for object-based storage devices," in SNAPI '07, San Diego, CA, Sep. 2007.
17. th IEEE Conference on Mass Storage Systems and Technologies (MSST 2007), San Diego, CA, Sep. 2007.
18. T. Fujita and M. Christie, "tgt: framework for storage target drivers," in Proceedings of the Ottawa Linux Symposium, Ottawa, Canada, Jul. 2006.
19. R. Latham et al., "Parallel Virtual File System, Version 2," http://www.pvfs.org/doc/pvfs2-guide/.
20. R. O. Weber, "Information technology - SCSI Primary commands - 3 (SPC-2), revision 23," INCITS Technical Committee T10/1416-D, Tech. Rep., May 2005.
21. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms. MIT Press and McGraw-Hill, 2001.
22. HPCS, "Scalable Synthetic Compact Application," http://www.highproductivity.org/SSCABmks.htm.
23. B. Pawlowski, C. Juszczak, P. Staubach, C. Smith, D. Lebel, and D. Hitz, "NFS version 3: Design and implementation," in USENIX Summer Technical Conference, 1994, pp. 137-152.
24. J. H. Morris, M. Satyanarayanan, M. H. Conner, J. H. Howard, D. S. Rosenthal, and F. D. Smith, "Andrew: a distributed personal computing environment," Communications of the ACM, vol. 29, no. 3, pp. 184-201, 1986.
25. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The Google file system," in SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles. New York, NY, USA: ACM Press, 2003, pp. 29-43.
26. E. Levy and A. Silberschatz, "Distributed file systems: concepts and examples," ACM Computing Surveys, vol. 22, no. 4, pp. 321-374, 1990.
27. S. Brandt, E. Miller, D. Long, and L. Xue, "Efficient metadata management in large distributed file systems," in 20th IEEE/Eleventh NASA Goddard Conference on Mass Storage Systems and Technologies, Apr. 2003.
28. Y. Zhu, H. Jiang, and J. Wang, "Hierarchical Bloom Filter Arrays (HBA): A novel, scalable metadata management system for large cluster-based storage," in Proceedings of IEEE International Conference on Cluster Computing, San Diego, California, Sep. 2004.
29. A. Devulapalli and P. Wyckoff, "File creation strategies in a distributed metadata file system," in Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS'07), Mar. 2007.