Data-driven fault tolerance for work stealing computations

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2012, Pages 79-89

  Ma, Wenjing ^a   Krishnamoorthy, Sriram ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

Fault tolerance; Load balancing; Work stealing

Indexed keywords

ADDRESS SPACE; DATA OPERATIONS; DATA STORE; DISTRIBUTED MEMORY; ENERGY CONSTRAINT; EXECUTION ENVIRONMENTS; FAULT TOLERANCE MECHANISMS; RE-EXECUTION; RECOVERY SCHEME; SPACE AND TIME; SYSTEM NOISE; TASK PARALLEL; WORK STEALING;

BENCHMARKING; FAULT TOLERANCE; INTELLIGENT CONTROL; RECOVERY; RESOURCE ALLOCATION;

PARALLEL ARCHITECTURES;

EID: 84864069036     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2304576.2304589     Document Type: Conference Paper

References (30)

1. E. Ayguade, N. Copty, A. Duran, J. Hoeflinger, Y. Lin, F. Massaioli, X. Teruel, P. Unnikrishnan, and G. Zhang. The design of OpenMP tasks. Parallel and Distributed Systems, IEEE Transactions on, 20(3):404-418, march 2009.
2. R. D. Blumofe and P. A. Lisiecki. Adaptive and Reliable Parallel Computing on Networks of Workstations, page 10. USENIX Association, 1997.
3. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Fedak, C. Germain, T. Herault, P. Lemarinier, O. Lodygensky, F. Magniette, V. Neri, and A. Selikhov. MPICH-V: Toward a Scalable Fault Tolerant MPI for Volatile Nodes. In Proceedings of the 2002 ACM/IEEE conference on Supercomputing, Supercomputing '02, pages 1-18, Los Alamitos, CA, USA, 2002. IEEE Computer Society Press.
4. G. Bronevetsky, D. Marques, K. Pingali, and P. Stodghill. Automated application-level checkpointing of MPI programs. In Proceedings of the ninth ACM SIGPLAN symposium on Principles and practice of parallel programming, PPoPP '03, pages 84-94, New York, NY, USA, 2003. ACM.
5. S. Chakravorty, C. Mendes, and L. Kalé. Proactive Fault Tolerance in MPI Applications via Task Migration. In High Performance Computing - HiPC 2006, volume 4297, pages 485-496. 2006.
6. B. Chamberlain, D. Callahan, and H. Zima. Parallel programmability and the Chapel language. International Journal of High Performance Computing Applications, 21(3):291-312, 2007. (Pubitemid 47082808)
7. P. Charles, C. Grothoff, V. Saraswat, C. Donawa, A. Kielstra, K. Ebcioglu, C. Von Praun, and V. Sarkar. X10: An object-oriented approach to non-uniform cluster computing. In ACM SIGPLAN Notices, volume 40, pages 519-538. ACM, 2005.
8. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, Jan. 2008.
9. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, SOSP '07, pages 205-220, New York, NY, USA, 2007. ACM. (Pubitemid 351429377)
10. J. Dinan, D. B. Larkins, P. Sadayappan, S. Krishnamoorthy, and J. Nieplocha. Scalable work stealing. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC '09, pages 53:1-53:11, New York, NY, USA, 2009. ACM.
11. E. Elnozahy and J. Plank. Checkpointing for peta-scale systems: a look into the future of practical rollback-recovery. Dependable and Secure Computing, IEEE Transactions on, 1(2):97 - 108, April-June 2004.
12. E. N. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv., 34(3):375-408, 2002.
13. G. Fagg and J. Dongarra. FT-MPI: Fault Tolerant MPI, Supporting Dynamic Applications in a Dynamic World. In Recent Advances in Parallel Virtual Machine and Message Passing Interface, volume 1908. 2000.
14. K. Ferreira, J. Stearley, J. H. Laros, III, R. Oldfield, K. Pedretti, R. Brightwell, R. Riesen, P. G. Bridges, and D. Arnold. Evaluating the viability of process replication reliability for exascale systems. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC '11, pages 44:1-44:12, New York, NY, USA, 2011. ACM.
15. M. Frigo. Portable High-Performance Programs. PhD thesis, MIT, Cambridge, MA, USA, 1999.
16. M. Frigo, C. E. Leiserson, and K. H. Randall. The implementation of the Cilk-5 multithreaded language. SIGPLAN Not., 33:212-223, May 1998. (Pubitemid 128454798)
17. R. Gioiosa, J. C. Sancho, S. Jiang, F. Petrini, and K. Davis. Transparent, incremental checkpointing at kernel level: a foundation for fault tolerance for parallel computers. In Proceedings of the 2005 ACM/IEEE conference on Supercomputing, SC '05, pages 9-, Washington, DC, USA, 2005. IEEE Computer Society.
18. P. H. Hargrove and J. C. Duell. Berkeley Lab Checkpoint/Restart (BLCR) for Linux clusters. In Journal of Physics: Conf. Series (SciDAC), volume 46, pages 494-499, June 2006. (Pubitemid 44461038)
19. K.-H. Huang and J. Abraham. Algorithm-based fault tolerance for matrix operations. Computers, IEEE Transactions on, C-33(6):518-528, June 1984. (Pubitemid 14584528)
20. O. Laadan and J. Nieh. Transparent checkpoint-restart of multiple processes on commodity operating systems. In USENIX Annual Technical Conference, 2007.
21. A. Lakshman and P. Malik. Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev., 44:35-40, April 2010.
22. A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for hpc with xen virtualization. In Proceedings of the 21st annual international conference on Supercomputing, ICS '07, pages 23-32, New York, NY, USA, 2007. ACM. (Pubitemid 47281603)
23. A. J. Oliner, L. Rudolph, and R. K. Sahoo. Cooperative checkpointing: a robust approach to large-scale systems reliability. In Proceedings of the 20th annual international conference on Supercomputing, ICS '06, pages 14-23, New York, NY, USA, 2006. ACM. (Pubitemid 47168488)
24. D. Patterson, G. Gibson, and R. Katz. A case for redundant arrays of inexpensive disks (RAID), volume 17. ACM, 1988.
25. J. Reinders. Intel Threading Building Blocks: outfitting C++ for multi-core processor parallelism. O'Reilly Media, Inc., 2007.
26. M. Rosenblum and J. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems (TOCS), 10(1):26-52, 1992. (Pubitemid 23598979)
27. V. A. Saraswat, P. Kambadur, S. Kodali, D. Grove, and S. Krishnamoorthy. Lifeline-based global load balancing. In Proceedings of the 16th ACM symposium on Principles and practice of parallel programming, PPoPP '11, pages 201-212, New York, NY, USA, 2011. ACM.
28. T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser. Active messages: a mechanism for integrated communication and computation. In Proceedings of the 19th annual international symposium on Computer architecture, ISCA '92, pages 256-266, New York, NY, USA, 1992. ACM.
29. C. Wang, F. Mueller, C. Engelmann, and S. L. Scott. A Job Pause Service under LAM/MPI+BLCR for Transparent Fault Tolerance. In IPDPS, pages 1-10, 2007.
30. S.-J. Wang and N. Jha. Algorithm-based fault tolerance for FFT networks. Computers, IEEE Transactions on, 43(7):849-854, Jul 1994.