Black-box problem diagnosis in parallel file systems

Proceedings of FAST 2010: 8th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2010, Pages 43-56

  Kasick, Michael P ^a   Tan, Jiaqi ^b   Gandhi, Rajeev ^a   Narasimhan, Priya ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b DSO NATIONAL LABORATORIES   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

COMPARISON DIAGNOSIS; FAULTY RESOURCES; FILE SYSTEMS; NETWORK PROBLEMS; PARALLEL FILE SYSTEM; PERFORMANCE METRICS; PERFORMANCE PROBLEMS; ROOT CAUSE ANALYSIS;

FILE ORGANIZATION;

EID: 85077085078     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. M. K. Aguilera, J. C. Mogul, J. L. Wiener, P. Reynolds, and A. Muthitacharoen. Performance debugging for distributed systems of black boxes. In Proceedings of the 19th ACM Symposium on Operating Systems Principles, pages 74-89, Bolton Landing, NY, Oct. 2003.
2. A. Babu. GlusterFS, Mar. 2009. http://www.gluster.org/.
3. P. Barham, A. Donnelly, R. Isaacs, and R. Mortier. Using Magpie for request extraction and workload modelling. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation, pages 259-272, San Francisco, CA, Dec. 2004.
4. D. Capps. IOzone filesystem benchmark, Oct. 2006. http://www.iozone.org/.
5. P. H. Carns, S. J. Lang, K. N. Harms, and R. Ross. Private communication, Dec. 2008.
6. P. H. Carns, W. B. Ligon, and R. B. R. andRajeev Thakur. PVFS: A parallel file system for Linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, Oct. 2000.
7. M. Y. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer. Pinpoint: Problem determination in large, dynamic internet services. In Proceedings of the 2002 International Conference on Dependable Systems and Networks, Bethesda, MD, June 2002.
8. I. Cohen, S. Zhang, M. Goldszmidt, J. Symons, T. Kelly, and A. Fox. Capturing, indexing, clustering, and retrieving system history. In Proceedings of the 20th ACM Symposium on Operating Systems Principles, Brighton, UK, Oct. 2005.
9. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley-Interscience, New York, NY, Aug. 1991.
10. J. Dean. Underneath the covers at Google: Current systems and future directions, May 2008.
11. D. Gilbert. The Linux sg3_utils package, June 2008. http://sg.danny.cz/sg/sg3_utils.html.
12. S. Godard. SYSSTAT utilities home page, Nov. 2008. http://pagesperso-orange.fr/sebastien.godard/.
13. D. Habas and J. Sieber. Background Patrol Read for Dell PowerEdge RAID Controllers. Dell Power Solutions, Feb. 2006.
14. M. P. Kasick, K. A. Bare, E. E. Marinelli III, J. Tan, R. Gandhi, and P. Narasimhan. System-call based problem diagnosis for PVFS. In Proceedings of the 5th Workshop on Hot Topics in System Dependability, Lisbon, Portugal, June 2009.
15. J. Katcher. PostMark: A new file system benchmark. Technical Report TR3022, Network Appliance, Inc., Oct. 1997.
16. E. Kiciman and A. Fox. Detecting application-level failures in component-based Internet services. IEEE Transactions on Neural Networks, 16(5):1027-1041, Sept. 2005.
17. A. V. Mirgorodskiy, N. Maruyama, and B. P. Miller. Problem diagnosis in large-scale computing environments. In Proceedings of the ACM/IEEE conference on Supercomputing, Tampa, FL, Nov. 2006.
18. X. Pan, J. Tan, S. Kavulya, R. Gandhi, and P. Narasimhan. Ganesha: Black-box diagnosis of mapreduce systems. In Proceedings of the 2nd Workshop on Hot Topics in Measurement & Modeling of Computer Systems, Seattle, WA, June 2009.
19. P. Reynolds, C. Killian, J. L. Wiener, J. C. Mogul, M. A. Shah,, and A. Vahdat. Pip: Detecting the unexpected in distributed systems. In Proceedings of the 3rd Conference on Networked Systems Design and Implementation, San Jose, CA, May 2006.
20. Y. Rubner, C. Tomasi, and L. J. Guibas. A metric for distributions with applications to image databases. In Proceedings of the 6th International Conference on Computer Vision, pages 59-66, Bombay, India, Jan. 1998.
21. S. Shepler, M. Eisler, and D. Noveck. NFS version 4 minor version 1. Internet-Draft, Dec. 2008.
22. W. R. Stevens. TCP slow start, congestion avoidance, fast retransmit, and fast recovery algorithms. RFC 2001 (Proposed Standard), Jan. 1997.
23. Sun Microsystems, Inc. Lustre file system: High-performance storage architecture and scalable cluster file system. White paper, Oct. 2008.
24. The IEEE and The Open Group. dd, 2004. http://www.opengroup.org/onlinepubs/ 009695399/utilities/dd.html.
25. J. Vasileff. latest PERC firmware == slow, July 2005. http://lists.us.dell.com/pipermail/linux-poweredge/ 2005-July/021908.html.
26. S. A. Weil, S. A. Brandt, E. L. Miller, and D. D. E. Long. Ceph: A scalable, high-performance distributed file system. In Proceedings of the 7th Symposium on Operating Systems Design and Implementation, pages 307-320, Seattle, WA, Nov. 2006.