Adaptive structured parallelism for distributed heterogeneous architectures: A methodological approach with pipelines and farms

Concurrency and Computation: Practice and Experience

Volumn 22, Issue 15, 2010, Pages 2073-2094

  González Vélez, Horacio ^a   Cole, Murray ^b  

^a ROBERT GORDON UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Algorithmic skeletons; Cluster computing; Concurrent programming structures; Parallel patterns; Parallel programming; Structured parallelism

Indexed keywords

CLUSTER COMPUTING; DISTRIBUTED DATABASE SYSTEMS; MUSCULOSKELETAL SYSTEM; PARALLEL PROGRAMMING;

ALGORITHMIC SKELETON; CONCURRENT PROGRAMMING STRUCTURES; HETEROGENEOUS ARCHITECTURES; HETEROGENEOUS DISTRIBUTED SYSTEMS; METHODOLOGICAL APPROACH; PARALLEL PATTERNS; SKELETAL PARALLEL PROGRAMMING; STRUCTURED PARALLELISM;

PIPELINES;

EID: 77957590617     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1549     Document Type: Article

References (45)

1. Cole M. Algorithmic Skeletons: Structured Management of Parallel Computation. Research Monographs in Parallel and Distributed Computing. Pitman/MIT Press: London, 1989.
2. Asanovic K, Bodik R, Catanzaro BC, Gebis JJ, Husbands P, Keutzer K, Patterson DA, Plishker WL, Shalf J, Williams SW, Yelick KA. The landscape of parallel computing research: A view from Berkeley. Technical Report UCB/EECS-2006-183, EECS Department, University of California, Berkeley, December 2006. Available online at: http://view.eecs.berkeley.edu/[Version: 17/Nov/08].
3. Buyya R. Process scheduling, load sharing, and balancing. High Performance Cluster Computing, Volume 1: Architectures and Systems, ch. 20-25. Prentice-Hall: Upper Saddle River, 1999;499-624.
4. Norman MG, Thanisch P. Models of machines and computation for mapping in multicomputers. ACM Computing Surveys 1993;25(3):263-302. DOI: 10.1145/158439.158908.
5. Laforenza D. Grid programming: Some indications where we are headed. Parallel Computing 2002;28(12):1733-1752. DOI: 10.1016/S0167-8191 (02) 00186-2.
6. Skillicorn DB, Talia D. Models sand languages for parallel computation. ACM Computing Surveys 1998;30(2):123-169. DOI: 10.1145/280277.280278.
7. González-Vélez H, Cole M. Adaptive structured parallelism for computational grids. PPoPP'07. ACM: San Jose, 2007;140-141. DOI: 10.1145/1229428.1229456. (Pubitemid 47479093)
8. González-Vélez H. An adaptive skeletal task farm for grids. Euro-Par 2005 (Lecture Notes in Computer Science, vol. 3648). Springer: Lisbon, 2005;401-410. DOI: 10.1007/11549468 47.
9. González-Vélez H. Self-adaptive skeletal task farm for computational grids. Parallel Computing 2006;32(7-8): 479-490. DOI: 10.1016/j.parco.2006.07.002. (Pubitemid 44634781)
10. González-Vélez H, Cole M. Towards fully adaptive pipeline parallelism for heterogeneous distributed environments. ISPA'06 (Lecture Notes in Computer Science, vol. 4330). Springer: Sorrento, 2006;916-926. DOI: 10.1007/11946441 82.
11. González-Vélez H, Cole M. An adaptive parallel pipeline pattern for grids. IPDPS'08. IEEE: Miami, 2008;1-11. DOI: 10.1109/IPDPS.2008. 4536264.
12. Kennedy K, Mazina M, Mellor-Crummey J, Cooper K, Torczon L, Berman F, Chien A, Dail H, Sievert O, Angulo D, Foster I, Gannon D, Johnsson L, Kesselman C, Aydt R, Reed D, Dongarra J, Vadhiyar S, Wolski R. Toward a framework for preparing and executing adaptive grid programs. IPDPS'02. IEEE: Fort Lauderdale, 2002;171-175. DOI: 10.1109/IPDPS.2002.1016570.
13. Schopf JM. Ten action when grid scheduling. Grid Resource Management: State of the Art and Future Trends (Operations Research and Management Science), ch. 2, Nabrzyski J, Schopf JM, Weglarz J (eds.). Kluwer Academic: Boston, 2003;15-23.
14. Vadhiyar SS, Dongarra J. Self adaptivity in grid computing. Concurrency and Computation: Practice and Experience 2005;17(2-4): 235-257. DOI: 10.1002/cpe.927. (Pubitemid 40285777)
15. Dongarra J, Gannon D, Fox G, Kennedy K. The impact of multicore on computational science software. CTWatch Quarterly 2007;3(1):3-10.
16. Brinch Hansen P. Model programs for computational science: A programming methodology for multicomputers. Concurrency and Computation: Practice and Experience 1993;5(5):407-423. DOI: 10.1002/cpe.4330050503.
17. Bharadwaj V, Ghose D, Mani V, Robertazzi TG. Scheduling Divisible Loads in Parallel and Distributed Systems. IEEE: los Alamitos, 1996.
18. González-Vélez H, Cole M. Adaptive statistical scheduling of divisible workloads in heterogeneous systems. Journal of Scheduling 2009; DOI: 10.1007/s10951-009-0138-4.
19. Wilkinson B, Allen M. Embarrassingly parallel computations and 5-pipelined computations. Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers, ch. 3. Prentice-Hall: Upper Saddle River, 1999;82-106 and 139-161.
20. Li M, Baker M. Grid scheduling and resource management. The Grid Core Technologies, ch. 6. Wiley: Chichester, 2005;243-300.
21. Benoit A, Robert Y. Mapping pipeline skeletons onto heterogeneous platforms. Journal of Parallel and Distributed Computing 2008;68(6):790-808. DOI: 10.1016/j.jpdc.2007.11.004.
22. 2+ currents in spherical cells. CBMS 2005. IEEE: Dublin, 2005;171-176. DOI: 10.1109/CBMS.2005.10.
23. González-Vélez V, González-Vélez H. Parallel stochastic simulation of macroscopic calcium currents. Journal of Bioinformatics and Computational Biology 2007;5(3):755-772. DOI: 10.1142/S0219720007002679. (Pubitemid 47261125)
24. Hagerup T. Allocating independent tasks to parallel processors: An experimental study. Journal of Parallel and Distributed Computing 1997;47(2):185-197. DOI: 10.1006/jpdc.1997.1411. (Pubitemid 127174400)
25. Curnow HJ, Wichmann BA. A synthetic benchmark. Computer Journal 1976;19(1):43-49. DOI: 10.1093/comjnl/19.1.43.
26. Danelutto M. Irregularity handling via structured parallel programming. International Journal of Computational Science and Engineering 2005;1(2-4): 73-85. DOI: 10.1504/IJCSE.2005.009693.
27. Casavant T, Kuhl J. A taxonomy of scheduling in general-purpose distributed computing systems. IEEE Transactions on Software Engineering 1988;14(2):141-154. DOI: 10.1109/32.4634. (Pubitemid 18596735)
28. Drozdowski M, Lawenda M. Multi-installment divisible load processing in heterogeneous distributed systems. Concurrency and Computation: Practice and Experience 2007;19(17):2237-2253. DOI: 10.1002/cpe.1180. (Pubitemid 350074088)
29. El-Rewini H, Lewis TG, Ali HH. Task Scheduling in Parallel and Distributed Systems (Innovative Technology Series). Prentice-Hall: NJ, 1994.
30. Majumdar S, Eager DL, Bunt RB. Scheduling in multiprogrammed parallel systems. SIGMETRICS Performance Evaluation Review 1988;16(1):104-113. DOI: 10.1145/1007771.55608.
31. Berman F, Wolski R, Casanova H, Cirne W, Dail H, Faerman M, Figueira S, Hayes J, Obertelli G, Schopf J, Shao G, Smallen S, Spring N, Su A, Zagorodnov D. Adaptive computing on the grid using AppLeS. IEEE Transactions on Parallel and Distributed Systems 2003;14(4):369-382. DOI: 10.1109/TPDS.2003.1195409.
32. Casanova H, Obertelli G, Berman F, Wolski R. The AppLeS parameter sweep template: user-level middleware for the grid. SC'00. IEEE: Dallas, 2000;60. DOI: 10.1109/SC.2000.10061.
33. Abramson D, Buyya R, Giddy J. A computational economy for grid computing and its implementation in the Nimrod-G resource broker. Future Generation Computer Systems 2002;18(8):1061-1074. DOI: 10.1016/S0167-739X (02) 00085-7.
34. Buyya R, Murshed M, Abramson D, Venugopal S. Scheduling parameter sweep applications on global grids: A deadline and budget constrained cost-time optimization algorithm. Software: Practice and Experience 2005;35(5):491-512. DOI: 10.1002/spe.646. (Pubitemid 40479560)
35. Thain D, Tannenbaum T, Livny M. Distributed computing in practice: The Condor experience. Concurrency and Computation: Practice and Experience 2005;17(2-4): 323-356. DOI: 10.1002/cpe.v17:2/4.
36. Heymann E, Senar MA, Luque E, Livny M. Adaptive scheduling for master-worker applications on the computational grid. Grid 2000 (Lecture Notes in Computer Science, vol. 1971). Springer: Bangalore, 2000;214-227. DOI: 10.1007/3-540-44444-0 20.
37. Yu J, Buyya R. A taxonomy of scientific workflow systems for grid computing. SIGMOD Record 2005;34(3):44-49. DOI: 10.1145/1084805.1084814. (Pubitemid 43152531)
38. Van der Aalst WMP, Ter Hofstede AHM, Kiepuszewski B, Barros AP. Workflow patterns. Distributed and Parallel Databases 2003;14(1):5-51. DOI: 10.1023/A:1022883727209.
39. Cunha JC, Rana OF, Medeiros PD. Future trends in distributed applications and problem-solving environments. Future Generation Computer Systems 2005;21(6):843-855. DOI: 10.1016/j.future.2003.12.015. (Pubitemid 40684206)
40. Aldinucci M, Petrocelli A, Pistoletti E, Torquati M, Vanneschi M, Veraldi L, Zoccolo C. Dynamic reconfiguration of grid-aware applications in ASSIST. Euro-Par 2005 (Lecture Notes in Computer Science, vol. 3648). Springer: Lisbon, 2005;771-781. DOI: 10.1007/11549468 84.
41. Aldinucci M, Bertolli C, Campa S, Coppola M, Vanneschi M, Veraldi L, Zoccolo C. Self-configuring and self-optimizing grid components in the GCM model and their ASSIST implementation. HPC-GECO. IEEE: Paris, 2006;45-52.
42. Aldinucci M, Campa S, Danelutto M, Vanneschi M, Kilpatrick P, Dazzi P, Laforenza D, Tonellotto N. Behavioural skeletons in GCM: Autonomic management of grid components. PDP'2008. IEEE: Toulouse, 2008;54-63. DOI: 10.1109/PDP.2008.46.
43. Yaikhom G, Cole M, Gilmore S. Combining measurement and stochastic modelling to enhance scheduling decisions for a parallel mean value analysis algorithm. ICCS'06 (Lecture Notes in Computer Science, vol. 3992). Springer: Reading, 2006;929-936. DOI: 10.1007/11758525 123.
44. Aldinucci M, Danelutto M, Dünnweber J, Gorlatch S. Optimization techniques for skeletons on grids. Grid Computing and New Frontiers of High Performance Computing (Advances in Parallel Computing, vol. 14), Grandinetti L (ed.). Elsevier: Amsterdam, 2005;255-273.
45. Alba E, Almeida F, Blesa M, Cotta C, Díaz M, Dorta I, Gabarró J, León C, Luque G, Petit J, Rodriguez C, Rojas A, Xhafa F. Efficient parallel LAN/WAN algorithms for optimization. The MALLBA project. Parallel Computing 2006;32(5-6): 415-440. DOI: 10.1016/j.parco.2006.06.007. (Pubitemid 44339520)