Scalable and adaptive metadata management in ultra large-scale file systems

Proceedings - The 28th International Conference on Distributed Computing Systems, ICDCS 2008

Volumn , Issue , 2008, Pages 403-410

  Hua, Yu ^a   Zhu, Yifeng ^b   Jiang, Hong ^c   Feng, Dan ^a   Tian, Lei ^a,c  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b University of Maine   (United States)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SYSTEMS; DATA STORAGE EQUIPMENT; METADATA;

BLOOM FILTERING; DISTRIBUTED COMPUTING SYSTEMS; FILE SYSTEMS; INTERNATIONAL CONFERENCES; MEMORY SPEEDS; METADATA MANAGEMENT; METADATA SERVERS; MULTI-LAYERED; PETABYTES; PROTOTYPE IMPLEMENTATIONS; QUERY EFFICIENCY; STORAGE SYSTEMS; TRACE-DRIVEN SIMULATIONS;

ADAPTIVE SYSTEMS;

EID: 51849100247     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2008.32     Document Type: Conference Paper

References (17)

1. J. Piernas, "The Design of New Journaling File Systems: The DualFS Case," IEEE Transactions on Computers, vol. 56, no. 2, pp. 267-281, 2007.
2. S. A. Brandt, E. L. Miller, D. D. E. Long, and L. Xue, "Efficient Metadata Management in Large Distributed Storage Systems," Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 290-298, 2003.
3. D. Roselli, J. Lorch, and T. Anderson, "A comparison of file system workloads," USENIX Annual Technical Conference, pp. 41-54, 2000.
4. L. Guy, P. Kunszt, E. Laure, H. Stockinger, and K. Stockinger, "Replica Management in Data Grids," Global Grid Forum, vol. 5, 2002.
5. S. Moon and T. Roscoe, "Metadata Management of Terabyte Datasets from an IP Backbone Network: Experience and Challenges," Workshop on Network-Related Data Management (NRDM), 2001.
6. B. Bloom, "Space/time trade-offs in hash coding with allowable errors," Communications of the ACM, vol. 13, no. 7, pp. 422-426, 1970.
7. A. Broder and M. Mitzenmacher, "Network applications of Bloom filters: a survey," Internet Mathematics, vol. 1, pp. 485-509, 2005.
8. Y. Zhu, H. Jiang, and J. Wang, "Hierarchical Bloom filter arrays (HBA): A novel, scalable metadata management system for large cluster-based storage," IEEE International Conference on Cluster Computing, pp. 165-174, 2004.
9. E. Riedel, M. Kallahalla, and R. Swaminathan, "A framework for evaluating storage system security," Conference on File and Storage Technologies (FAST), pp. 15-30, 2002.
10. Y. Zhu and H. Jiang, "False rate analysis of Bloom filter replicas in distributed systems," International Conference on Parallel Processing (ICPP), pp. 255-262, 2006.
11. B. Pawlowski, C. Juszczak, P. Staubach, C. Smith, D. Lebel, and D. Hitz, "NFS version3: Design and implementation," USENIX Summer Conference, pp. 137-151, 1994.
12. M. Satyanarayanan, J. J. Kistler, P. Kumar, M. E. Okasaki, E. H. Siegel, and D. C. Steere., "Coda: A highly available file system for a distributed workstation environment.," IEEE Transactions on Computers, vol. 39, no. 4, pp. 447-459, 1990.
13. E. Miller and R. Katz, "RAMA: An easy-to-use, highperformance parallel file system," Parallel Computing, vol. 23, no. 4-5, pp. 419-446, 1997.
14. Y. Hua, Y. Zhu, H. Jiang, D. Feng, and L. Tian, "Scalable and Adaptive Metadata Management in Ultra Large-scale File Systems," Technical Report, University of Nebraska-Lincoln, 2007.
15. L. Fan, P. Cao, J. Almeida, and A. Broder, "Summary cache: a scalable wide-area web cache sharing protocol," IEEE/ACM Transactions on Networking (TON), vol. 8, no. 3, pp. 281-293, 2000.
16. D. Guo, J. Wu, H. Chen, and X. Luo, "Theory and network application of dynamic Bloom filters," IEEE International Conference on Computer Communications (INFOCOM), 2006.
17. Y. Hua and B. Xiao, "A multi-attribute data structure with parallel Bloom filters for network services," IEEE High Performance Computing (HiPC), pp. 277-288, 2006.