An adaptive and hierarchical task scheduling scheme for multi-core clusters

Parallel Computing

Volumn 40, Issue 10, 2014, Pages 611-627

  Wang, Yizhuo ^a   Zhang, Yang ^b   Su, Yan ^a   Wang, Xiaojun ^a   Chen, Xu ^a   Ji, Weixing ^a   Shi, Feng ^a  

^a BEIJING INSTITUTE OF TECHNOLOGY   (China)

^b HEBEI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Multi core cluster; Task scheduling; Work sharing; Work stealing

Indexed keywords

MULTI-CORE CLUSTER; TASK-SCHEDULING; WORK-SHARING; WORK-STEALING;

EID: 84908326144     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2014.09.012     Document Type: Article

References (42)

1. Intel(R) Threading Building Blocks, Intel Corporation.
2. P. Charles, C. Grothoff, V. Saraswat, et al., X10: an object-oriented approach to non-uniform cluster computing, in: OOPSLA, pp. 519-538, 2005.
3. D. Leijen, W. Schulte, S. Burckhardt, The design of a task parallel library, in: OOPSLA, pp. 227-242, 2009.
4. OpenMP Architecture Review Board, OpenMP Application Program Interface, v3.0, May 2008.
5. M. Frigo, C.E. Leiserson, and K.H. Randall The implementation of the Cilk-5 multithreaded language SIGPLAN Not. 33 5 1998 212 223
6. R.D. Blumofe, and C.E. Leiserson Scheduling multithreaded computations by work stealing J. ACM 46 5 1999 720 748
7. Y. Guo, A Scalable Locality-aware Adaptive Work-stealing Scheduler for Multi-core Task Parallelism (Ph.D. thesis), Rice University, Houston, Texas, USA, 2010.
8. R. Barik, V. Cave, C. Donawa, A. Kielstra, et al., Experiences with an SMP implementation for X10 based on the Java concurrency utilities, in: Workshop on Programming Models for Ubiquitous Parallelism (PMUP), 2006.
9. V. Cavé, J. Zhao, J. Shirako, V. Sarkar, Habanero-Java: the new adventures of old X10, in: PPPJ, New York, USA, 2011, pp. 51-61.
10. Y. Guo, J. Zhao, V. Cave, V. Sarkar, SLAW: a scalable locality-aware adaptive work-stealing scheduler for multi-core systems, in: PPoPP, New York, USA, 2010, pp. 341-342.
11. J. Dinan, D. B. Larkins, P. Sadayappan, et al., Scalable work stealing, in: SC, New York, NY, USA, 2009, pp. 1-11.
12. Maged M. Michael, Martin T. Vechev, Vijay A. Saraswat, Idempotent Work Stealing, in: PPoPP, 2009, pp. 45-54.
13. S. Kumar, C.J. Hughes, A. Nguyen, Carbon: architectural support for fine-grained parallelism on chip multiprocessors, in: ISCA, 2007, pp. 162-173.
14. J.-N. Quintin, F. Wagner, Hierarchical work-stealing, in: EuroPar, Berlin, Heidelberg, 2010, pp. 217-229.
15. R.V. van Nieuwpoort, T. Kielmann, H.E. Bal, Efficient load balancing for wide-area divide-and-conquer applications, in: PPoPP, New York, USA, 2001, pp. 34-43.
16. S. Olivier, J. Prins, Scalable dynamic load balancing using UPC, in: ICPP, Washington, USA, 2008, pp. 123-131.
17. D. Bozdag, F. Ozguner, E. Ekici, U. Catalyurek, A task duplication based scheduling algorithm using partial schedules, in: ICPP, Washington, USA, 2005, pp. 630-637.
18. C.D. Polychronopoulos, and D.J. Kuck Guided self-scheduling: a practical scheduling scheme for parallel supercomputers IEEE Trans. Comput. 36 12 1987 1425 1439
19. B. J. Smith, Architecture and Application of the HEP Multiprocessor Computer System, Real Time Signal Processing IV, vol. 298, 1981.
20. K. Ravichandran, S. Lee, S. Pande, Work stealing for multi-core HPC clusters, in: Euro-Par, Berlin, Heidelberg, 2011, pp. 205-217.
21. Barney Blaise, Lawrence Livermore National Laboratory: < https://computing.llnl.gov/tutorials/openMP/#WorkSharing >.
22. Y. Wang, W. Ji, F. Shi, et al., Knowledge-based adaptive self-scheduling, in: NPC, Gwangju, Korea, 2012, pp. 22-32.
23. A. Tzannes, G. C. Caragea, et al., Lazy binary-splitting: a run-time adaptive work-stealing scheduler, in: PPoPP, 2010, pp. 179-190.
24. MOAIS software: < http://kaapi.gforge.inria.fr >.
25. P. Berenbrink, T. Friedetzky, L.A. Goldberg, The natural work-stealing algorithm is stable, in: FOCS, 2001, pp. 178-187.
26. Umut A. Acar, Guy E. Blelloch, The data locality of work stealing, Theory of Computing Systems, 2000, pp. 1-12.
27. Q. Chen, M. Guo, and Z. Huang Adaptive cache aware bitier work-stealing in multisocket multicore architectures IEEE Trans. Parallel Distrib. Sys. 24 12 2013 2334 2343
28. U.A. Acar, A. Charguéraud, M. Rainey, Scheduling parallel programs by work stealing with private deques, in: PPoPP, 2013, pp. 219-228.
29. M.S. Squillante, R.D. Nelson, Analysis of task migration in shared-memory multiprocessor scheduling, in: SIGMETRICS, New York, USA, 1991, pp. 143-155.
30. N.S. Arora, R.D. Blumofe, C.G. Plaxton, Thread scheduling for multiprogrammed multiprocessors, in: SPAA, Puerto Vallarta, 1998, pp. 119-129.
31. M. Tchiboukdjian, N. Gast, D. Trystram, et al., A tighter analysis of work stealing, in: ISAAC, 2010, pp. 291-302.
32. M. Mitzenmacher. Analyses of load stealing models based on differential equations, in: SPAA, 1998, pp. 212-221.
33. N. Gast, B. Gaujal, A mean field model of work stealing in large-scale systems, in: SIGMETRICS, 2010, pp. 13-24.
34. R.P. Dick, D.L. Rhodes, W. Wolf, TGFF: task graphs for free, in: Proceedings of the 6th International Workshop on Hardware/Software Codesign, March 1998, pp. 97-101.
35. P. D'Alberto, A. Nicolau, Adaptive Strassen's matrix multiplication, in: ICS, New York, NY, USA, 2007, pp. 284-292.
36. C.E. Leiserson, The Cilk++ concurrency platform, in: Design Automation Conference, 2009, DAC '09. 46th ACM/IEEE, July 2009.
37. J. E. Baldeschwieler, R. D. Blumofe, E. A. Brewer, Atlas: an infrastructure for global computing, in: Proceedings of the 7th workshop on ACMSIGOPS European workshop, New York, USA, 1996, pp. 165-172.
38. Karl-Filip Faxen, Efficient work stealing for fine grained parallelism, in: ICPP, San Diego, 2010, pp. 313-322.
39. R.V. van Nieuwpoort, G. Wrzesińska, C.J.H. Jacobs, and H.E. Bal Satin: A high-level and efficient grid programming model ACM Trans. Program. Lang. Syst. 32 3 2010 39
40. J. Dinan, S. Olivier, et al., Dynamic load balancing of unbalanced computations using message passing, in: PMEO-PDS, 2007, pp. 1-8.
41. Y. Wang, W. Ji, Q. Zuo, F. Shi, A hierarchical work-stealing framework for multi-core clusters, in: PDCAT, 2012, pp. 350-355.
42. M. Tchiboukdjian, N. Gast, and D. Trystram Decentralized list scheduling Ann. Oper. Res. 207 1 2013 237 259