SmartStore: A new metadata organization paradigm with semantic-awareness for next-generation file systems

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC '09

Volumn , Issue , 2009, Pages

  Hua, Yu ^a   Jiang, Hong ^b   Zhu, Yifeng ^c   Feng, Dan ^a   Tian, Lei ^a,b  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^c UNIVERSITY OF MAINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX QUERIES; DATA SETS; DECENTRALIZED DESIGN; DIRECTORY TREES; ENTIRE SYSTEM; FILE SYSTEMS; QUERY LATENCY; REAL-WORLD; STORAGE SYSTEMS; SYSTEM SCALABILITY; TOP-K QUERY;

INFORMATION RETRIEVAL; INFORMATION SERVICES; METADATA; SCALABILITY; SEMANTICS;

HIERARCHICAL SYSTEMS;

EID: 74049141987     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1654059.1654070     Document Type: Conference Paper

References (45)

1. J. Nunez, "High End Computing File System and I/O R&D Gaps Roadmap ," High Performance Computer Science Week, ASCR Computer Science Research, August, 2008.
2. J. R. Douceur and J. Howell, "Distributed Directory Service in the Farsite File System," Proc. OSDI, pp. 321-334, 2006.
3. S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn, "Ceph: A scalable, high-performance distributed file system.," Proc. OSDI, 2006.
4. D. Roselli, J. Lorch, and T. Anderson, "A comparison of file system workloads," Proc. USENIX Conference, pp. 41-54, 2000.
5. A. Traeger, E. Zadok, N. Joukov, and C. Wright, "A nine year study of file system and storage benchmarking," ACM Transactions on Storage, no. 2, pp. 1-56, 2008.
6. A. Szalay, "New Challenges in Petascale Scientific Databases," Keynote Talk in Scientific and Statistical Database Management Conference (SSDBM), 2008.
7. M. Seltzer and N. Murphy, "Hierarchical File Systems are Dead," Proc. HotOS, 2009.
8. A. W. Leung, M. Shao, T. Bisson, S. Pasupathy, and E. L. Miller, "Spyglass: Fast, Scalable Metadata Search for Large-Scale Storage Systems," Proc. FAST, 2009.
9. F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber, "Bigtable: A distributed storage system for structured data," Proc. OSDI, 2006.
10. D. K. Gifford, P. Jouvelot, M. A. Sheldon, and J. W. Oa̧ŕ Toole, "Semantic file systems," Proc. SOSP, 1991.
11. P. Gu, Y. Zhu, H. Jiang, and J. Wang, "Nexus: A Novel Weighted-Graph-Based Prefetching Algorithm for Metadata Servers in Petabyte-Scale Storage Systems," Proc. CCGrid, 2006.
12. S. Deerwester, S. Dumas, G. Furnas, T. Landauer, and R. Harsman, "Indexing by latent semantic analysis," J. American Society for Information Science, pp. 391-407, 1990.
13. C. Papadimitriou, P. Raghavan, H. Tamaki, and S. Vempala, "Latent Semantic Indexing: A Probabilistic Analysis," Journal of Computer and System Sciences, vol. 61, no. 2, pp. 217-235, 2000.
14. S. Doraimani and A. Iamnitchi, "File Grouping for Scientific Data Management: Lessons from Experimenting with Real Traces," Proc. HPDC, 2008.
15. A. Leung, S. Pasupathy, G. Goodson, and E. Miller, "Measurement and analysis of large-scale network file system workloads," Proc. USENIX Conference, 2008.
16. P. Xia, D. Feng, H. Jiang, L. Tian, and F. Wang, "FARMER: A Novel Approach to File Access coRrelation Mining and Evaluation Reference model for Optimizing Peta-Scale File Systems Performance," Proc. HPDC, 2008.
17. E. Riedel, M. Kallahalla, and R. Swaminathan, "A framework for evaluating storage system security," Proc. FAST, 2002.
18. S. Kavalanekar, B. Worthington, Q. Zhang, and V. Sharda, "Characterization of storage workload traces from production Windows servers," Proc. IEEE International Symposium on Workload Characterization (IISWC), 2008.
19. D. Ellard, J. Ledlie, P. Malkani, and M. Seltzer, "Passive NFS Tracing of Email and Research Workloads," Proc. FAST, 2003.
20. Y. Hua, H. Jiang, Y. Zhu, D. Feng, and L. Tian, "SmartStore: A New Metadata Organization Paradigm with Metadata Semantic-Awareness for Next-Generation File Systems," Technical Report, University of Nebraska- Lincoln, TR-UNL-CSE-2008-0012, November, 2008.
21. Y. Hua, H. Jiang, Y. Zhu, D. Feng, and L. Tian, "SmartStore: A New Metadata Organization Paradigm with Semantic-Awareness ," FAST Work-in-Progress Report and Poster Session, February, 2009.
22. B. Zhu, K. Li, and H. Patterson, "Avoiding the disk bottleneck in the data domain deduplication file system," Proc. FAST, 2008.
23. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezise, and P. Camble, "Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality," Proc. FAST, 2009.
24. X. Liu, A. Aboulnaga, K. Salem, and X. Li, "CLIC: CLient-Informed Caching for Storage Servers," Proc. FAST, 2009.
25. M. Li, E. Varki, S. Bhatia, and A. Merchant, "TaP: Table-based prefetching for storage caches," Proc. FAST, 2008.
26. A. Guttman, "R-trees: A dynamic index structure for spatial searching," Proc. SIGMOD, 1984.
27. B. Bloom, "Space/time trade-offs in hash coding with allowable errors," Communications of the ACM, vol. 13, no. 7, pp. 422-426, 1970.
28. Y. Hua, Y. Zhu, H. Jiang, D. Feng, and L. Tian, "Scalable and Adaptive Metadata Management in Ultra Large-scale File Systems," Proc. ICDCS, 2008.
29. G. Golub and C. Van Loan, Matrix Computations. Johns Hopkins University Press, 1996.
30. J. Hartigan and M. Wong, "Algorithm AS 136: A K-means clustering algorithm," Applied Statistics, pp. 100-108, 1979.
31. C. A. N. Soules, G. R. Goodson, J. D. Strunk, and G. R. Ganger, "Metadata efficiency in versioning file systems," Proc. FAST, 2003.
32. Y. Zhu, H. Jiang, J. Wang, and F. Xian, "HBA: Distributed Metadata Management for Large Cluster-based Storage Systems," IEEE Transactions on Parallel and Distributed Systems, vol. 19, no. 4, pp. 1-14, 2008.
33. D. Comer, "The ubiquitous B-tree," ACM Comput. Surv., vol. 11, no. 2, pp. 121-137, 1979.
34. A. J. Menezes, P. C. van Oorschot, and S. A. Vanstone, "Handbook of applied cryptography," CRC Press, 1997.
35. B. Piwowarski and G. Dupret, "Evaluation in (XML) information retrieval: Expected precision-recall with user modelling (EPRUM)," Proc. SIGIR, pp. 260-267, 2006.
36. D. K. Gifford, P. Jouvelot, M. A. Sheldon, and J. W. O. Jr, "Semantic file systems," Proc. SOSP, 1991.
37. "Google Desktop," http://desktop.google.com/.
38. C. Soules and G. Ganger, "Connections: using context to enhance file search," Proc. SOSP, 2005.
39. J. KLEINBERG, "Authoritative Sources in a Hyperlinked Environment," Journal of the ACM, vol. 46, no. 5, pp. 604-632, 1999.
40. "Google," http://www.google.com/.
41. S. Patil and G. Gibson, "GIGA+ : Scalable Directories for Shared File Systems," Carnegie Mellon University Parallel Data Lab Technical Report CMU-PDL-08-110, 2008.
42. "ORACLE.COM," www.oracle.com/technology/products/-database/ clustering/index.html. Product page.
43. C. Baru, G. Fecteau, A. Goyal, H. Hsiao, A. Jhingran, S. Padmanabhan, G. Copeland, and W. Wilson, "DB2 parallel edition," IBM Systems journal, vol. 34, no. 2, pp. 292-322, 1995.
44. M. Stonebraker and U. Cetintemel, "One size fits all: an idea whose time has come and gone," Proc. ICDE, 2005.
45. M. Franklin, A. Halevy, and D. Maier, "From databases to dataspaces: a new abstraction for information management," ACM SIGMOD Record, vol. 34, no. 4, pp. 27-33, 2005.