Storage characterization for unstructured data in online services applications

Proceedings of the 2009 IEEE International Symposium on Workload Characterization, IISWC 2009

Volumn , Issue , 2009, Pages 148-157

  Sankar, Sriram ^a   Vaid, Kushagra ^a  

^a MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACROSS TIME; APPLICATION LOGIC; BACK-END SERVERS; DATA CENTERS; DATA STORAGE; DATA VOLUME; DISK TRAFFIC; EMAIL MESSAGES; MAPPING APPLICATIONS; ON-LINE SERVICE; PROBABILISTIC MODELS; PROCESSING LAYER; PRODUCTION ENVIRONMENTS; SERVER APPLICATIONS; SERVICE SCALABILITY; SINGLE SERVER; SOCIAL NETWORKING; STATE TRANSITIONS; STORAGE RESOURCES; STORAGE SUBSYSTEMS; SUBSYSTEM DESIGN; SYNTHETIC BENCHMARK; TRAFFIC LOADS; UNSTRUCTURED DATA; USER EXPERIENCE; USER-GENERATED CONTENT; WEB 2.0; WEB SERVERS;

BEHAVIORAL RESEARCH; CONTENT BASED RETRIEVAL; DATA PROCESSING; DISKS (STRUCTURAL COMPONENTS); INTERNET; SCALABILITY; SERVERS; WEB SERVICES;

BENCHMARKING;

EID: 70649087263     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IISWC.2009.5306786     Document Type: Conference Paper

References (27)

1. IDC's Enterprise Disk Storage Consumption Model: Analytics and Content Depots Provide a New Perspective on the Future of Storage Solutions, IDC report: #214066, Aug 2008, Richard L. Villars.
2. http://itknowledgeexchange.techtarget.com/storage-soup/ idcunstructured-data-will-become-the-primary-task-for-storage/.
3. C. Ruemmler and J. Wilkes, "UNIX Disk Access Patterns, " Proceedings of 1990 SIGMETRICS, Jan. 1990, pp. 405-420.
4. K. Keeton, A. Veitch, D. Obal, and J. Wilkes, "I/O Characterization of Commercial Workloads, " Proceedings of the 3rd Workshop on Computer Architecture Evaluation using Commercial Workloads (CAECW), Jan. 2000.
5. T. Wong and J. Wilkes, "My Cache or Yours? Making Storage More Exclusive, " Proceedings of the USENIX Annual Technical Conference (USENIX), June 2002, pp. 161-175.
6. D. Roselli, J. Lorch, and T. Anderson, "A Comparison of File System Workloads, " Proceedings of the 2000 USENIX Annual Technical Conference, June 2000, pp. 41-54.
7. IOTTA Repository, Storage Networking Industry Association, http://iotta.snia.org/.
8. "TPC Benchmark C, Standard Specification, " June 2007. Available: http://tpc.org/tpcc/spec/tpcc-current.pdf.
9. "TPC Benchmark D (Decision Support), Standard Specification, " Feb. 1998. Available: http://tpc.org/tpcd/spec/tpcd-current.pdf.
10. TPC Benchmark H (Decision Support), Standard Specification, " Feb. 2008. Available: http://tpc.org/tpch/spec/tpch-262.pdf.
11. R. McDougal, "FileBench: A Prototype Model Based Workload for File Systems, Work in Progress." Available: http://www.solarisinternals.com/si/ tools/filebench/filebench-nasconf.pdf.
12. Database Test Suite, Database Test 2 (DBT-2). Available: http://osdldbt.sourceforge.net/#dbt2.
13. A. Aranya, C. Wright, and E. Zadok, "Tracefs: A File System to Trace Them All, " Proceedings of the 3rd USENIX Conference on File and Storage Technologies (FAST ), May 2004, pp. 129-143.
14. J. S. Pendry, N. Williams, and E. Zadok. Am-utils User Manual, 6.1b3 edition, July 2003. Available: http://www.am-utils.org.
15. M. Wang, A. Ailamaki, and C. Faloutsos, "Capturing the Spatio- Temporal Behavior of Real Traffic Data, " IFIP Intl. Symp. on Computer Performance Modeling, Measurement, and Evaluation (Performance), Sep. 2002, pp 147-163.
16. M. E. Gomez, and V. Santonja, "Analysis of Self-Similarity in I/O Workload Using Structural Modeling, " Proceedings of the 7th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), Oct. 1999.
17. M. E. Gomez, and V. Santonja, "A New Approach in the Analysis and Modeling of Disk Access Patterns, " Proceedings of the 2000 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), Apr. 2000, pp. 172-177.
18. M. E. Gomez, and V. Santonja, "A New Approach in the Modeling and Generation of Synthetic Disk Workload, " Proceedings of the 8th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), Aug. 2000.
19. Luk, C., Cohn, R., Muth, R., Patil, H., Klauser, A., Lowney, G., Wallace, S., Reddi, V. J., and Hazelwood, K. 2005. Pin: building customized program analysis tools with dynamic instrumentation. In Proceedings of the 2005 ACM SIGPLAN Conference on Programming Language Design and Implementation (Chicago, IL, USA, June 12 - 15, 2005).
20. G. R. Ganger. "Generating representative synthetic workloads: An unsolved problem", Proceedings of the Computer Management Group (CMG) Conference, pages 1263-1269, 1995.
21. Mark W. Garrett and Walter Willinger. "Analysis, modeling and generation of self-similar VBR video traffic". SIGCOMM, pages 269- 280, 1994.
22. Will E. Leland, Murad S. Taqq, Walter Willinger, and Daniel V. Wilson. "On the self-similar nature of Ethernet traffic". ACM SIGCOMM, pages 183-193, San Francisco, California, 1993.
23. R. H. Riedi, M. S. Crouse, V. J. Ribeiro, and R. G. Baraniuk. "A multifractal wavelet model with application to network traffic". IEEE Transactions on Information Theory, 45(4):992-1018, 1999.
24. R. Riedi and J. Vehel. "Multifractal Properties of TCP Traffic: a Numerical Study". IEEE Transactions on Networking, October 1997.
25. S. Kavalanekar, B. Worthington, Q. Zha, V. Sharda "Characterization of storage workload traces from production Windows servers". In Proc. IEEE International Symposium on Workload Characterization (IISWC), Seattle, WA, Sept. 2008.
26. Edward D. Lazowska, John Zahorjan, G. Scott Graham, Kenneth C. Sevcik, Quantitative system performance: computer system analysis using queueing network models, Prentice-Hall, Inc., Upper Saddle River, NJ, 1984.
27. I. Park, R. Buch, "Improve Debugging and Performance Tuning with ETW", Microsoft Corporation, April 2007 http://msdn.microsoft.com/enus/ magazine/cc163437.aspx.