Nexus: A novel weighted-graph-based prefetching algorithm for metadata servers in petabyte-scale storage systems

Sixth IEEE International Symposium on Cluster Computing and the Grid, 2006. CCGRID 06

Volumn , Issue , 2006, Pages 409-416

  Gu, Peng ^a   Zhu, Yifeng ^b   Jiang, Hong ^a   Wang, Jun ^b  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b University of Maine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERED METADATA SERVERS; DISTRIBUTED STORAGE SYSTEMS; PETABYTE-SCALE STORAGE SYSTEMS; WEIGHTED-GRAPH-BASED PREFETCHING ALGORITHMS;

ALGORITHMS; CLIENT SERVER COMPUTER SYSTEMS; COMPUTER SIMULATION; DATA STORAGE EQUIPMENT; DISTRIBUTED DATABASE SYSTEMS; GRAPH THEORY; SERVERS;

METADATA;

EID: 33751072108     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2006.73     Document Type: Conference Paper

References (25)

1. "Lustre: A scalable, high-performance file system," Cluster File Systems Inc. white paper, version 1.0, Nov. 2002.
2. Y. Zhu, H. Jiang, and J. Wang, "Hierarchical bloom filter arrays (hba):a novel, scalable metadata management system for large cluster-based storage," in Cluster Computing, 2004 IEEE International Conference on, 2004, pp. 165-174.
3. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur, "PVFS: A parallel file system for linux clusters," in Proceedings of the 4th Annual Linux Showcase and Conference. Atlanta, GA: USENIX Association, 2000, pp. 317-327.
4. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The google file system," in SOSP, 2003, pp. 29-43.
5. J. H. Hartman and J. K. Ousterhout, "The Zebra striped network file system," in High Performance Mass Storage and Parallel I/O: Technologies and Applications, H. Jin, T. Cortes, and R. Buyya, Eds. New York, NY: IEEE Computer Society Press and Wiley, 2001, pp. 309-329.
6. E. J. Otoo, D. Rotem, and A. Romosan, "Optimal file-bundle caching algorithms for data-grids," in SC'2004 Conference CD. Pittsburgh, PA: IEEE/ACM SIGARCH, Nov. 2004, IBNL.
7. M. Gupta and M. Ammar, "A novel multicast scheduling scheme for multimedia servers with variable access patterns," Dec. 26 2002.
8. A. Muthitacharoen, B. Chen, and D. Mazières, "A low-bandwidth network file system," in SOSP, 2001, pp. 174-187.
9. S. A. Weil, K. T. Pollack, S. A. Brandt, and E. L. Miller, "Dynamic metadata management for petabyte-scale file systems," in SC'2004 Conference CD. Pittsburgh, PA: IEEE/ACM SIGARCH, Nov. 2004, uCSC.
10. D. Roselli, J. R. Lorch, and T. E. Anderson, "A comparison of file system workloads," in Proceedings of the 2000 USENIX Annual Technical Conference (USENIX-00). Berkeley, CA: USENIX Ass., June 18-23 2000, pp. 41-54.
11. P. G. Sikalinda, P. S. Kritzinger, and L. O. Walters, "Analyzing storage system workloads," Jan. 01 2005. [Online], Available: http://pubs.cs.uct.ac.za/archive/00000218/
12. H. Lei and D. Duchamp, "An analytical approach to file prefetching," in 1997 USENIX Annual Technical Conference, Anaheim, California, USA, Jan. 1997, http://www.cs.Columbia.edu/~lei/resume.html# publications.
13. R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka, "Informed prefetching and caching," in High Performance Mass Storage and Parallel I/O: Technologies and Applications. New York, NY: IEEE Computer Society Press and Wiley, 2001, ch. 16, pp. 224-244.
14. J. Skeppstedt and M. Dubois, "Compiler controlled prefetching for multiprocessors using low-overhead traps and prefetch engines," J. Parallel Distrib. Comput, vol. 60, no. 5, pp. 585-615, 2000.
15. A. Amer and D. D. E. Long, "Noah: Low-cost file access prediction through pairs," in Proceedings of the 20th IEEE International Performance, Computing and Communications Conference (IPCCC '01). IEEE, April 2001, pp. 27-33.
16. J. Wang, R. Min, Y. Zhu, and Y. Hu, "UCFS - a user-space, high performance, customized file system for web proxy servers," IEEE Transactions on Computers, vol. 51, no. 9, pp. 1056-1073, Sep 2002.
17. A. Amer, D. D. E. Long, and R. C. Burns, "Group-based management of distributed file caches," in ICDCS, 2002, p. 525.
18. [Online]. Available: http://www.base.com/gordoni/ufs93.html
19. J. Griffioen and R. Appleton, "Reducing file system latency using a predictive approach," in USENIX Summer, 1994, pp. 197-207.
20. T. T. Mclarty, "File system traces for scientific applications on large linux cluster at lawrence livermore national laboratory," Sep 2003, uCRL-MI-200102.
21. E. Riedel, M. Kallahalla, and R. Swaminathan, "A framework for evaluating storage system security," in FAST, 2002, pp. 15-30.
22. M. D. Dahlin, R. Y. Wang, T. E. Anderson, and D. A. Patterson, "Cooperative caching: Using remote client memory to improve file system performance," University of California, Berkeley, Tech. Rep. UCB:CSD-94-844, Dec. 1994.
23. J. Archibald and J. L. Baer, "Cache coherence protocols: Evaluation using a multiprocessor simulation model," ACM Transactions on Computer Systems, vol. 4, no. 4, Nov. 1986.
24. J. S. Bucy and G. R. Ganger, "The disksim simulation environment version 3.0 reference manual," Carnegie Mellon University, School of Computer Science, Tech. Rep. CMU-CS-03-102, Jan. 2003.
25. D. E. Knuth, "An analysis of optimal caching," Journal of Algorithms, vol. 6, pp. 181-199, 1985.