Mixed data-parallel scheduling for distributed continuous integration

Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2012

Volumn , Issue , 2012, Pages 91-98

  Beaumont, Olivier ^a,b,c   Bonichon, Nicolas ^a,b,c   Courtès, Ludovic ^a   Dolstra, Eelco ^d   Hanin, Xavier ^e  

^a INRIA   (France)

^b UNIVERSITÉ DE BORDEAUX   (France)

^c UNIVERSITÉ BORDEAUX 1   (France)

^d 4SH ^*  (France)

^e DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Continuous Integration; DAG Scheduling; mixed parallelism

Indexed keywords

DAG SCHEDULING; DATA PARALLEL; DATA SETS; ENGINEERING TECHNIQUES; MIXED PARALLELISM; SCHEDULING HEURISTICS; SOFTWARE COMPONENT;

DISTRIBUTED PARAMETER NETWORKS; INTEGRATION; SCHEDULING; SOFTWARE ENGINEERING;

SCHEDULING ALGORITHMS;

EID: 84867405748     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2012.7     Document Type: Conference Paper

References (32)

1. M. Fowler and M. Foemmel, "Continuous integration," Thought-Works) http://www.thoughtworks.com/Continuous Integration.pdf, 2006.
2. P. Duvall, S. Matyas, and A. Glover, Continuous integration: improving software quality and reducing risk. Addison- Wesley Professional, 2007.
3. "Jenkins," 2011, http://jenkins-ci.org.
4. "Hudson," 2011, http://hudson-ci.org.
5. "CruiseControl," 2011, http://cruisecontrol.sourceforge.net.
6. P. Dutot, G. Mounié, D. Trystram et al., "Scheduling parallel tasks: Approximation algorithms," Handbook of Scheduling: Algorithms, Models, and Performance Analysis, JY-T. Leung (Eds.), 2004.
7. F. Suter, F. Desprez, and H. Casanova, "From heterogeneous task scheduling to heterogeneous mixed parallel scheduling," in Euro-Par 2004 Parallel Processing, ser. Lecture Notes in Computer Science, M. Danelutto, M. Vanneschi, and D. Laforenza, Eds. Springer Berlin / Heidelberg, 2004, vol. 3149, pp. 230-237.
8. T. N'Takpé, F. Suter, and H. Casanova, "A comparison of scheduling approaches for mixed-parallel applications on heterogeneous platforms," in Parallel and Distributed Computing, 2007. ISPDC '07. Sixth International Symposium on, july 2007, p. 35.
9. K. Aida and H. Casanova, "Scheduling mixed-parallel applications with advance reservations," Cluster Computing, vol. 12, no. 2, pp. 205-220, 2009.
10. "Hubble, a simulator for the Nix/Hydra build tools," 2011, http://hubble.gforge.inria.fr.
11. H. Casanova, A. Legrand, and M. Quinson, "SimGrid: a Generic Framework for Large-Scale Distributed Experiments," in 10th International Conference on Computer Modeling and Simulation (UKSIM 2008). Washington, DC, USA: IEEE Computer Society, april 2008, pp. 126-131. [Online]. Available: http://hal.inria.fr/inria-00260697/en/
12. A. Giersch, Y. Robert, and F. Vivien, "Scheduling tasks sharing files on heterogeneous master-slave platforms," Journal of Systems Architecture, vol. 52, no. 2, pp. 88-104, 2006.
13. B. Ucar, C. Aykanat, K. Kaya, and M. Ikinci, "Task assignment in heterogeneous computing systems," Journal of parallel and Distributed Computing, vol. 66, no. 1, pp. 32-46, 2006.
14. B. Hong and V. Prasanna, "Distributed adaptive task allocation in heterogeneous computing environments to maximize throughput," IEEE IPDPS, 2004.
15. A. B. Downey, "TCP self-clocking and bandwidth sharing," Computer Networks, vol. 51, no. 13, pp. 3844-3863, 2007.
16. D. Abendroth, H. van den Berg, and M. Mandjes, "A versatile model for TCP bandwidth sharing in networks with heterogeneous users," AEU - International Journal of Electronics and Communications, vol. 60, no. 4, pp. 267-278, 2006.
17. Y. Zhu, A. Velayutham, O. Oladeji, and R. Sivakumar, "Enhancing TCP for networks with guaranteed bandwidth services," Computer Networks, vol. 51, no. 10, pp. 2788-2804, 2007.
18. S. Chakrabarti, J. Demmel, and K. Yelick, "Modeling the benefits of mixed data and task parallelism," in Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures. ACM, 1995, pp. 74-83.
19. D. G. Feitelson, "Scheduling parallel jobs on clusters," High Performance Cluster Computing, vol. 1, pp. 519-533, 1999.
20. M. Drozdowski, "Scheduling Parallel Tasks - Algorithms and Complexity," in Handbook of Scheduling. Boca Raton, FL, USA: CRC Press, 2004, ch. 25.
21. P. Dutot, G. Mounié, and D. Trystram, "Scheduling Parallel Tasks-Approximation Algorithms," in Handbook of Scheduling. Boca Raton, FL, USA: CRC Press, 2004, ch. 26.
22. J. Blazewicz, M. Kovalyov, M. Machowiak, D. Trystram, and J. Weglarz, "Preemptable malleable task scheduling problem," IEEE Transactions on Computers, pp. 486-490, 2006.
23. J. Turek, J. Wolf, and P. Yu, "Approximate algorithms scheduling parallelizable tasks," in Proceedings of the Fourth Annual ACM Symposium on Parallel Algorithms and Architectures. ACM, 1992, pp. 323-332.
24. R. Lepère, D. Trystram, and G. Woeginger, "Approximation algorithms for scheduling malleable tasks under precedence constraints," International Journal of Foundations of Computer Science, vol. 13, no. 4, p. 613, 2002.
25. P.-F. Dutot, T. N'Takpé, F. Suter, and H. Casanova, "Scheduling Parallel Task Graphs on (Almost) Homogeneous Multicluster Platforms," IEEE Transactions on Parallel and Distributed Systems, vol. 20, no. 7, pp. 940-952, 2008.
26. G. N. Srinivasa Prasanna and B. R. Musicus, "Generalised multiprocessor scheduling using optimal control," in Proceedings of the third annual ACM symposium on Parallel algorithms and architectures, ser. SPAA '91. New York, NY, USA: ACM, 1991, pp. 216-228. [Online]. Available: http://doi.acm.org/10.1145/113379.113399
27. O. Sinnen and L. Sousa, "Communication contention in task scheduling," Parallel and Distributed Systems, IEEE Transactions on, vol. 16, no. 6, pp. 503-515, june 2005.
28. E. Dolstra, A. Löh, and N. Pierron, "NixOS: A purely functional Linux distribution," Journal of Functional Programming, no. 5-6, pp. 577-615, november 2010. [Online]. Available: http://nixos.org/nixos/docs.html
29. E. Dolstra, M. de Jonge, and E. Visser, "Nix: A safe and policy-free system for software deployment," in Proceedings of the 18th Large Installation System Administration Conference (LISA '04). Atlanta, Georgia, USA: USENIX, november 2004, pp. 79-92. [Online]. Available: http://nixos.org/nix/ docs.html
30. "Hydra," 2011, http://nixos.org/hydra.
31. P. Miller, "Recursive make considered harmful," Australian UNIX and Open Systems User Group Newsletter, vol. 19, no. 1, pp. 14-25, 1997.
32. H. Topcuoglu, S. Hariri, and M.-Y. Wu, "Task scheduling algorithms for heterogeneous processors," in Heterogeneous Computing Workshop, 1999. (HCW '99) Proceedings. Eighth, 1999, pp. 3-14.