Stardust: Tracking activity in a distributed storage system

Performance Evaluation Review

Volumn 34, Issue 1, 2006, Pages 3-14

  Thereska, Eno ^a   Salmon, Brandon ^a   Strunk, John ^a   Wachs, Matthew ^a   Abd Ei Malek, Michael ^a   Lopez, Julio ^a   Ganger, Gregory R ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

End to end tracing; Request causal chain; Ursa minor

Indexed keywords

ADMINISTRATIVE PERFORMANCE; DIVERSE SYSTEM WORKLOADS; MONITORING INFRASTRUCTURE; STARDUST;

DECISION MAKING; GRAPH THEORY; INFORMATION RETRIEVAL; ONLINE SYSTEMS; PROBLEM SOLVING;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33750352439     PISSN: 01635999     EISSN: 01635999     Source Type: Conference Proceeding    
DOI: 10.1145/1140103.1140280     Document Type: Conference Paper

References (45)

1. M. Abd-El-Malek, W. V. Courtright II, C. Cranor, G. R. Ganger, J. Hendricks, A. J. Klosterman, M. Mesnier, M. Prasad, B. Salmon, R. R. Sambasivan, S. Sinnamohideen, J. D. Strunk, E. Thereska, M. Wachs, and J. J. Wylie. Ursa Minor: versatile cluster-based storage. Conference on File and Storage Technologies, pages 59-72. USENIX Association, 2005.
2. [21 M. K. Aguilera, J. C. Mogul, J. L. Wiener, P. Reynolds, and A. Muthitacharoen. Performance debugging for distributed systems of black boxes. ACM Symposium on Operating System Principles, pages 74-89. ACM Press, 2003.
3. V. Akcelik, J. Bielak, G. Biros, I. Epanomeritakis, A. Fernandez, O. Ghattas, E. J. Kim, J. Lopez, D. O'Hallaron, T. Tu, and J. Urbanic. High Resolution Forward and Inverse Earthquake Modeling on Terasacale Computers. ACM International Conference on Supercomputing, 2003.
4. N. Allen. Don't waste your storage dollars: what you need to know, March, 2001. Research note, GArtner Group.
5. E. Anderson and D. Patterson. Extensible, scalable monitoring for clusters of computers. Systems Administration Conference, pages 9-16. USENIX Association, 1997.
6. Apple. Optimize with Shark: Big payoff, small effort, February 2006. http://developer.apple.com/tools/.
7. P. Barham, A. Donnelly, R. Isaacs, and R. Mortier. Using Magpie for request extraction and workload modelling. Symposium on Operating Systems Design and Implementation, 2004.
8. J. P. Bouhana. UNIX Workload Characterization Using Process Accounting. 22nd International Computer Measurement Group Conference, pages 379-390, 1996.
9. B. M. Cantrill, M. W. Shapiro, and A. H. Leventhal. Dynamic instrumentation of production systems. USENIX Annual Technical Conference, pages 15-28. USENIX Association, 2004.
10. M. Y. Chen, E. Kiciman, and E. Brewer. Pinpoint: Problem Determination in Large, Dynamic Internet Services. International Conference on Dependable Systems and Networks (DSN'02), pages 595-604, 2002.
11. I. Cohen, J. S. Chase, M. Goldszmidt, T Kelly, and J. Symons. Correlating instrumentation data to system states: a building block for automated diagnosis and control. Symposium on Operating Systems Design and Implementation, pages 231-244. USENIX Association, 2004.
12. D. Ellard, J. Ledlie, P. Malkani, and M. Seltzer. Passive NFS tracing of email and research workloads. Conference on File and Storage Technologies, pages 203-216. USENIX Association, 2003.
13. G. R. Ganger, J. D. Strunk, and A. J. Klosterman. Self-* Storage: brick-based storage with automated administration. Technical Report CMU-CS-03-178. Carnegie Mellon University, August 2003.
14. Gartner Group. Total Cost of Storage Ownership - A User-oriented Approach, February, 2000. Research note, Gartner Group.
15. G. R. Goodson, J. J. Wylie, G. R. Ganger, and M. K. Reiter. Efficient Byzantine-tolerant erasure-coded storage. International Conference on Dependable Systems and Networks, 2004.
16. Gprof-The GNU Profiler, November 1998. http://www.gnu.org/software/ binutils/manual/gprof-2.9.1/html.mono/gprof.html.
17. Graph Viz. Graphviz - Graph Visualization Software, February 2006. http : //www.graphviz.org/.
18. J. L. Hellerstein, M. M. Maccabee, W. N. Millsii, and J. J. Turek. ETE: a customizable approach to measuring end-to-end response times and their components in distributed systems. International Conference on Distributed Computing Systems, pages 152-162. IEEE, 1999.
19. HP Labs (Storage systems). Cello disk-level traces, 2005. http://www.hpl.hp.com/research/ssp/software.
20. C. Hrischuk, J. Rolia, and C. M. Woodside. Automatic generation of a software performance model using an object-oriented prototype. International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, pages 399-409, 1995.
21. IBM. DB2 Performance Expert, 2004. http://www-306.ibm.com/software.
22. R. Isaacs, P. Barham, J. Bulpin, R. Mortier, and D. Narayanan. Request extraction in Magpie: events, schemas and temporal joins. 11th ACM SIGOPS European Workshop, pages 92-97, 2004.
23. J. Katcher. PostMark: a new file system benchmark. Technical report TR3022. Network Appliance, October 1997.
24. E. Lazpwska, J. Zahorjan, S. Graham, and K. Sevcik. Quantitative system performance: computer system analysis using queuing network models. Prentice Hall, 1984.
25. M. L. Massie, B. N. Chun, and D. E. Culler. The Ganglia Distributed Monitoring System: Design, Implementation, and Experience. Parallel Computing, 30(7), July 2004.
26. D. Menasce and V. Almeida. Capacity planning for web performance: metrics, models and methods. Prentice Hall, 1998.
27. Microsoft. Event tracing, 2005. http://msdn.microsoft.com/.
28. Microsoft. Microsoft .NET, 2005. http://WWW.microsoft.com/net/default. mspx.
29. Microsoft. Windows Server 2003 Performance Counters Reference, 2005. http://www.microsoft.com/technet/.
30. S. Microsystems. Java 2 Platform, Enterprise Edition (J2EE), 2005. http://java.sun.com/j2ee.
31. B. D. Noble, M. Satyanarayanan, G. T. Nguyen, and R. H. Katz. Trace-based mobile network emulation. ACM SIGCOMM Conference, pages 51-61, 1997.
32. W. Norcott and D. Capps. IOzone filesystem benchmark program, 2002. http : //www.iozone.org.
33. Oracle. Oracle Database Manageability, 2004. http://www.oracle.com/ technology/.
34. J. K. Ousterhout, H. Da Costa, D. Harrison, J. A. Kunze, M. Kupfer, and J. G. Thompson. A trace-driven analysis of the UNIX 4.2 BSD file system. ACM Symposium on Operating System Principles. Published as Operating Systems Review, 19(5): 15-24, December 1985.
35. Quest Software. Application Assurance, October, 2005. http://www.quest.com.
36. B. Salmon, E. Thereska, C. A. N. Soules, and G. R. Ganger. A two-tiered software architecture for automated tuning of disk layouts. Algorithms and Architectures for Self-Managing Systems, pages 13-18. ACM, 2003.
37. A. D. Samples. Mache: no-loss trace compaction. ACM SIGMETR1CS Conference on Measurement and Modeling of Computer Systems. Published as Performance Evaluation Review, 17(1):89-97, May 1989.
38. K. W. Shirriff and J. K. Ousterhout. A trace-driven analysis of name and attribute caching in a distributed system. Winter USENIX Technical Conference, pages 315-331, January 1992.
39. SourceForge.net. State Threads Library for Internet Applications, February 2006. http://state-threads.sourceforge.net/.
40. SQLite. SQLite, 2005. http://ww.sqlite.org.
41. Sun Microsystems. NFS: network file system protocol specification, RFC-1094, March 1989.
42. E. Thereska, M. Abd-El-Malek, J. J. Wylie, D. Narayanan, and G. R. Ganger. Informed data distribution selection in a self-predicting storage system. International conference on autonomie computing, 2006.
43. J. J. Wylie. A read/write protocol family for versatile storage infrastructures. PhD thesis, published as Technical Report CMU-PDL-05-108. Carnegie Mellon University, October 2005.
44. Xaffire Inc. Web session recording and analysis, October, 2005. http://www.xaffire.com.
45. Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes. Hibernator: helping disk arrays sleep through the winter. ACM Symposium on Operating System Principles, pages 177-190, 2005.