Using queue structures to improve job reliability

Proceedings of the 16th International Symposium on High Performance Distributed Computing 2007, HPDC'07

Volumn , Issue , 2007, Pages 43-54

  Hacker, Thomas J ^a   Meglicki, Zdzislaw ^b  

^a PURDUE UNIVERSITY   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Cluster design and architecture; Reliability

Indexed keywords

COMPUTER ARCHITECTURE; PROGRAM PROCESSORS; RELIABILITY ANALYSIS; SERVERS;

CLUSTER DESIGN; HIGH PERFORMANCE COMPUTING SYSTEMS; SMALL SCALE HPC SYSTEMS; STAND ALONE SERVER SYSTEMS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 34548092060     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1272366.1272373     Document Type: Conference Paper

References (27)

1. J. T. Daly, "A strategy for running large scale applications based on a model that optimizes the checkpoint interval for restart dumps," International Workshop on Software Engineering for High Performance Computing System Applications, 2004.
2. S. Sankaran, J. M. Squyres, B. Barrett, V. Sahay, and A. Lumsdaine, "The lam/mpi checkpoint/restart framework: System-initiated checkpointing," International Journal of High Performance Computing Applications, vol. 19, no. 4, pp. 479-493, 2005.
3. S. D. Kleban and S. H. Clearwater, "Computation-at-risk: Assessing job portfolio management risk on clusters," in IPDPS. IEEE Computer Society, 2004.
4. K. J. Ryan and C. S. Reese, "Estimating reliability trends for the world's fastest computer," Los Alamos National Laboratory, Tech. Rep. LA-UR-00-4201, 2000.
5. T. Heath, R. P. Martin, and T. D. Nguyen, "Improving cluster availability using workstation validation," in SIGMETRICS. ACM, 2002, pp. 217-227.
6. D. Nurmi, J. Brevik, and R. Wolski, "Quantifying machine availability in networked and desktop grid systems," University of California, Santa Barbara, Computer Science, Tech. Rep. ucsb.cs:TR-2003-37, Nov. 2003.
7. J. Brevik, D. Nurmi, and R. Wolski, "Automatic methods for predicting machine availability in desktop grid and peer-to-peer systems," in CCGRID. IEEE Computer Society, 2004, pp. 190-199.
8. D. Nurmi, J. Brevik, and R. Wolski, "Modeling machine availability in enterprise and wide-area distributed computing environments," in Euro-Par 2005, Parallel Processing, 11th International Euro-Par Conference, Lisbon, Portugal, August 30 - September 2, 2005, Proceedings, ser. Lecture Notes in Computer Science, vol. 3648. Springer, 2005, pp. 432-441.
9. Y. Zhang, M. S. Squillante, A. Sivasubramaniam, and R. K. Sahoo, "Performance implications of failures in large-scale cluster scheduling," in JSSPP, ser. Lecture Notes in Computer Science, vol. 3277. Springer, 2004, pp. 233-252.
10. B. Schroeder and G. A. Gibson, "A large-scale study of failures in high-performance computing systems," in Proceedings of International Symposium on Dependable Systems and Networks (DSN). IEEE Computer Society, 2006, pp. 249-258.
11. C. Ebeling, An Introduction to Reliability and Maintainability Engineering. Boston, MA: McGraw-Hill, 1997.
12. D. L. Grosh, Primer of Reliability Theory. New York, NY: John Wiley, 1989.
13. Los Alamos National Laboratory. (2006) Raw operational data on system failures. [Online]. Available: http://www.lanl.gov/projects/computerscience/ data/
14. EasyFit Statistical Package, "http://www.mathwave.com/products/ easyfit.html."
15. N. Raju, Gottumukkala, Y. Liu, C. B. Leangsuksun, R. Nassar, and S. Scott2, "Reliability analysis in hpc clusters," Proceedings of the High Availability and Performance Computing Workshop, 2006.
16. M. Kalyanakrishnam, Z. Kalbarczyk, and R. Iyer, "Failure data analysis of a LAN of windows NT based computers," in Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems (SRDS '99). Washington - Brussels - Tokyo: IEEE, Oct. 1999, pp. 178-189.
17. B. Schroeder and G. Gibson, "Disk failures in the real world: What does an mttf of 1,000,000 hours mean to you?" in Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST 2007). USENIX, Feb. 13-16 2007.
18. E. Pinheiro, W.-D. Weber, and L. A. Barroso, "Failure trends in a large disk drive population," in Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST 2007). USENIX, Feb. 13-16 2007.
19. D. N. P. Murthy, M. Xie, and R. Jiang, Weibull Models. Wiley Series in Probability and Statistics, Wiley-Interscience, 2003.
20. M. Rausand and A. Høyland, System Reliability Theory: Models, Statistical Methods and Applications Second Edition. Wiley-Interscience, 2003.
21. F. Petøini, "Scaling to Thousands of Processors with Buffer Coscheduling," in Scaling to New Heights Workshop, Pittsburgh, PA, Aug 2002.
22. Lublin and Feitelson, "The workload on parallel supercomputers: Modeling the characteristics of rigid jobs," JPDC: Journal of Parallel and Distributed Computing, vol. 63, 2003.
23. N. H. Vaidya, "Impact of checkpoint latency on overhead ratio of a checkpointing scheme," IEEE Trans. Computers, vol. 46, no. 8, pp. 942-947, 1997.
24. D. Nurmi, R. Wolski, and J. Brevik, "Model-based checkpoint scheduling for volatile resource environments," University of California, Santa Barbara, Computer Science, Tech. Rep. TR-2004-25, Nov. 6 2004.
25. N. Stone, J. Kochmar, R. Reddy, J. R. Scott, J. Sommerfield, and C. Vizinok, "A checkpoint and recovery system for the Pittsburgh supercomputing center terascale computing system," Pittsburgh Supercomputer Center, Tech. Rep. CMU-PSC-TR-2001-0002, 2001.
26. L. P. Cox, C. D. Murray, and B. Noble, "Pastiche: Making backup cheap and easy," in Proceedings of the 5th ACM Symposium on Operating System Design and Implementation (OSDI-02), ser. Operating Systems Review. New York: ACM Press, Dec. 9-11 2007, pp. 285-298.
27. R. A. Oldfield, "Investigating lightweight storage and overlay network for fault tolerance," Proceedings of the High Availability and Performance Computing Workshop, 2006.