A survey of algorithmic skeleton frameworks: High-level structured parallel programming enablers

Software - Practice and Experience

Volumn 40, Issue 12, 2010, Pages 1135-1160

  González Vélez, Horacio ^a   Leyton, Mario ^b  

^a ROBERT GORDON UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF CHILE   (Chile)

Author keywords

algorithmic skeletons; concurrent programming structures; parallel computing; parallel constructs; software patterns; structured parallelism

Indexed keywords

ALGORITHMIC SKELETON; CONCURRENT PROGRAMMING STRUCTURES; PARALLEL COMPUTING; PARALLEL CONSTRUCTS; SOFTWARE PATTERNS; STRUCTURED PARALLELISM;

ABSTRACTING; ALGORITHMS; COMPUTER SOFTWARE PORTABILITY; CONCURRENCY CONTROL; PARALLEL ARCHITECTURES; SOFTWARE DESIGN; STRUCTURED PROGRAMMING;

PARALLEL PROGRAMMING;

EID: 78249233600     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.1026     Document Type: Article

References (193)

1. Cole M,. Algorithmic skeletons: A structured approach to the management of parallel computation. PhD Thesis, Computer Science Department, University of Edinburgh, Edinburgh, 1988.
2. Cole M,. Algorithmic skeletons: Structured management of parallel computation. Research Monographs in Parallel and Distributed Computing. Pitman/MIT Press: London, 1989.
3. Dagum L, Menon R,. OpenMP: An industry standard API for shared-memory programming. IEEE Computational Science and Engineering 1998; 5 (1): 46-55. DOI: 10.1109/99.660313.
4. IEEE and the Open Group, Standard for information technology-Portable operating system interface (POSIX). Issue 6 IEEE Std 1003.1 and ISO/ISO/IEC 9945, The Open Group Technical Standard Base Specifications, New York/Berkshire, April 2004.
5. Oaks S, Wong H,. Java Threads (3rd edn). O'Reilly: Sebastopol, 2004.
6. Birrell A,. An introduction to programming with C# threads. Technical Report MSR-TR-2005-68, Microsoft Research, Redmond, May 2005.
7. Geist A, Beguelin A, Dongarra J, Jiang W, Manchek R, Sunderam VS,. PVM: Parallel Virtual Machine. MIT Press: Cambridge, 1994.
8. MPI-Forum. The official message passing interface standard. Available at: http://www.mpi-forum.org [Accessed on 10 February 2010].
9. Snir M, Gropp W,. MPI: The Complete Reference (2nd edn), vol. 1-2. MIT Press: Cambridge, 1998.
10. Cappello F, Etiemble D,. MPI versus MPI+OpenMP on the IBM SP for the NAS benchmarks. SC'00. IEEE: Dallas, 2000; 12.
11. Krawezik G,. Performance comparison of MPI and three OpenMP programming styles on shared memory multiprocessors. SPAA'03. ACM: San Diego, 2003; 118-127. DOI: 10.1145/777412.777433.
12. Luecke GR, Lin WH,. Scalability and performance of OpenMP and MPI on a 128-processor SGI Origin 2000. Concurrency and Computation: Practice and Experience 2001; 13 (10): 905-928. DOI: 10.1002/cpe.588.
13. Gorlatch S,. Send-receive considered harmful: Myths and realities of message passing. ACM Transactions on Programming Languages and Systems 2004; 26 (1): 47-56. DOI: 10.1145/963778.963780.
14. Barnett M, Shuler L, Gupta S, Payne DG, van de Geijn R, Watts J,. Building a high-performance collective communication library. SC'94. IEEE: Washington, 1994; 107-116. DOI: 10.1145/602770.602794.
15. Dongarra JJ, Otto SW, Snir M, Walker D,. A message passing standard for MPP and workstations. Communications of the ACM 1996; 39 (7): 84-90. DOI: 10.1145/233977.234000.
16. Chan E, Heimlich M, Purkayastha A, van de Geijn R,. Collective communication: Theory, practice, and experience. Concurrency and Computation: Practice and Experience 2007; 19 (13): 1749-1783. DOI: 10.1002/cpe.1206.
17. Pjesivac-Grbovic J, Angskun T, Bosilca G, Fagg GE, Gabriel E, Dongarra J,. Performance analysis of MPI collective operations. Cluster Computing 2007; 10 (2): 127-143. DOI: 10.1007/s10586-007-0012-0.
18. Gelernter D,. Generative communication in Linda. ACM Transactions on Programming Languages and Systems 1985; 7 (1): 80-112. DOI: 10.1145/2363.2433.
19. Mehrotra P, Haines M,. An overview of the Opus language and runtime system. LCPC'94 (Lecture Notes in Computer Science, vol. 892). Springer: Ithaca, 1995; 346-360. DOI: 10.1007/BFb0025866.
20. Bal HE, Kaashoek MF, Tanenbaum AS,. Orca: A language for parallel programming of distributed systems. IEEE Transactions on Software Engineering 1992; 18 (3): 190-205. DOI: 10.1109/32.126768.
21. Cole M,. Algorithmic skeletons. Research Directions in Parallel Functional Programming, Chapter 13, Hammond K, Michaelson G, (eds). Springer: London, 1999; 289-304.
22. Kung H,. Computational models for parallel computers. Philosophical Transactions of the Royal Society of London. Series a Mathematical, Physical and Engineering Sciences 1988; 326 (1591): 357-371. DOI: 10.1098/rsta.1988.0092.
23. Lusk EL, Overbeek RA,. A minimalist approach to portable, parallel programming. The Characteristics of Parallel Algorithms, Jamieson LH, Gannon DB, Douglass RJ, (eds), Scientific Computation Series, Chapter 14. MIT Press: Cambridge, 1987; 351-362.
24. Hey AJG,. Experiments in MIMD parallelism. Future Generation Computer Systems 1990; 6 (3): 185-196. DOI: 10.1016/0167-739X(90)90018-9.
25. Blelloch GE,. Vector Models for Data-parallel Computing. MIT Press: Cambridge, 1990.
26. Bird RS,. Lectures on constructive functional programming. Technical Monograph PRG-89. ISBN: 0-902928-51-1. Oxford University Computing Laboratory, Programming Research Group: 1988.
27. Skillicorn DB,. Architecture-independent parallel computation. Computer 1990; 23 (12): 38-50. DOI: 10.1109/2.62092.
28. Kelly PHJ,. Functional programming for loosely-coupled multiprocessors. Research Monographs in Parallel and Distributed Computing. Pitman/MIT Press: London, 1989.
29. Finkel R, Manber U,. DIB-A distributed implementation of backtracking. ACM Transactions on Programming Languages and Systems 1987; 9 (2): 235-256. DOI: 10.1145/22719.24067.
30. Smith DR,. KIDS: A semiautomatic program development system. IEEE Transactions on Software Engineering 1990; 16 (9): 1024-1043. DOI: 10.1109/32.58788.
31. Pelagatti S,. Structured Development of Parallel Programs. Taylor & Francis: London, 1998.
32. Cole M, Zavanella A,. Coordinating heterogeneous parallel systems with skeletons and activity graphs. Journal of System Integration 2001; 10 (2): 127-143. DOI: 10.1023/A:1011280825682.
33. Darlington J, Guo Y, To HW, Yang J,. Functional skeletons for parallel coordination. Euro-Par 1995 (Lecture Notes in Computer Science, vol. 966). Springer: Stockholm, 1995; 55-66. DOI: 10.1007/BFb0020455.
34. Dongarra,. et al. (eds.). The Sourcebook of Parallel Computing, Chapter 17, Morgan Kauffman: San Francisco, 2002; 383-407.
35. Aldinucci M, Danelutto M,. Stream parallel skeleton optimization. PDCS'99. IASTED, ACTA Press: Cambridge, 1999; 955-962.
36. Leyton M, Piquer JM,. Skandium: Multi-core programming with algorithmic skeletons. PDP 2010. IEEE: Pisa, 2010; 289-296. DOI: 10.1109/PDP.2010.26.
37. Brinch Hansen P,. Model programs for computational science: A programming methodology for multicomputers. Concurrency and Computation: Practice and Experience 1993; 5 (5): 407-423. DOI: 10.1002/cpe.4330050503.
38. Hasselbring W,. Programming languages and systems for prototyping concurrent applications. ACM Computing Surveys 2000; 32 (1): 43-79. DOI: 10.1145/349194.349199.
39. Leopold C,. High-level programming models. Parallel and Distributed Computing: A Survey of Models, Paradigms and Approaches. Chapter 11. Wiley: New York, 2001.
40. Skillicorn DB, Talia D,. Models and languages for parallel computation. ACM Computing Surveys 1998; 30 (2): 123-169. DOI: 10.1145/280277.280278.
41. Cole M,. Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming. Parallel Computing 2004; 30 (3): 389-406. DOI: 10.1016/j.parco.2003.12.002.
42. Rabhi FA, Gorlatch S, (eds.). Patterns and Skeletons for Parallel and Distributed Computing. Springer: London, 2003.
43. Darlington J, To HW,. Building Parallel Applications Without Programming. Abstract Machine Models for Highly Parallel Computers, Chapter 8, Davy JR, Dew PM, (eds). Oxford University Press: Oxford, 1995; 140-154.
44. Botorog GH, Kuchen H,. Skil: An imperative language with algorithmic skeletons for efficient distributed programming. HPDC'96. IEEE: Syracuse, 1996; 243-252. DOI: 10.1109/HPDC.1996.546194.
45. Bacci B, Danelutto M, Pelagatti S, Vanneschi M, Orlando S,. Summarising an experiment in parallel programming language design. HPCN Europe (Lecture Notes in Computer Science, vol. 919). Springer: Milan, 1995; 7-13. DOI: 10.1007/BFb0046600.
46. Dorta AJ, González JA, Rodriguez C, de Sande F,. LLC: A parallel skeletal language. Parallel Processing Letters 2003; 13 (3): 437-448. DOI: 10.1142/S0129626403001409.
47. Grelck C,. Shared memory multiprocessor support for functional array processing in SAC. Journal of Functional Programming 2005; 15 (3): 431-475. DOI: 10.1017/S0956796805005538.
48. Herrmann CA, Lengauer C,. HDC: A higher-order language for divide-and-conquer. Parallel Processing Letters 2000; 10 (2-3): 239-250. DOI: 10.1142/S0129626400000238.
49. Loogen R, Ortega-Mallén Y, Peña Marí R,. Parallel functional programming in Eden. Journal of Functional Programming 2005; 15 (3): 431-475. DOI: 10.1017/S0956796805005526.
50. Horvath Z, Zsok V, Serrarens P, Plasmeijer R,. Parallel elementwise processable functions in Concurrent Clean. Mathematical and Computer Modelling 2003; 38 (7-9): 865-875. DOI: 10.1016/S0895-7177(03)90071-9.
51. Michaelson G, Scaife N, Bristow P, King P,. Nested algorithmic skeletons from higher order functions. Parallel Algorithms and Applications 2001; 16: 18-206. DOI: 10.1080/01495730108935271.
52. Clément F, Martin V, Vodicka A, Cosmo RD, Weis P,. Domain decomposition and skeleton programming with OCamlP3l. Parallel Computing 2006; 32 (7-8): 539-550. DOI: 10.1016/j.parco.2006.04.003.
53. Sérot J, Ginhac D,. Skeletons for parallel image processing: an overview of the SKiPPER project. Parallel Computing 2002; 28 (12): 1785-1808. DOI: 10.1016/S0167-8191(02)00189-8.
54. Darlington J, Field AJ, Harrison PG, Kelly PHJ, Sharp DWN, Wu Q,. Parallel programming using skeleton functions. PARLE'93 (Lecture Notes in Computer Science, vol. 694). Springer: Munich, 1993; 146-160. DOI: 10.1007/3-540-56891-3-12.
55. Sérot J, Falcou J,. Functional meta-programming for parallel skeletons. ICCS 2008 (Lecture Notes in Computer Science, vol. 5101). Springer: Berlin, 2008; 154-163. DOI: 10.1007/978-3-540-69384-0-21.
56. Loidl HW, Rubio F, Scaife N, Hammond K, Horiguchi S, Klusik U, Loogen R, Michaelson G, Pena R, Priebe S, Rebón Portillo ÁJ, Trinder PW,. Comparing parallel functional languages: Programming and performance. Higher-order and Symbolic Computation 2003; 16 (3): 203-251. DOI: 10.1023/A:1025641323400.
57. Matsuzaki K, Iwasaki H, Emoto K, Hu Z,. A library of constructive skeletons for sequential style of parallel programming. InfoScale'06, vol. 152. ACM: Hong Kong, 2006; 13. DOI: 10.1145/1146847.1146860.
58. Ciechanowicz P, Poldner M, Kuchen H,. The Münster skeleton library Muesli-A comprehensive overview. ERCIS Working Paper No. 7 ISSN 1614-7448, European Research Center for Information Systems, Münster, 2009.
59. Alba E, Almeida F, Blesa M, Cabeza J, Cotta C, Diaz M, Dorta I, Gabarro J, Leon C, Luna J,. MALLBA: A library of skeletons for combinatorial optimisation. Euro-Par 2002 (Lecture Notes in Computer Science, vol. 2400). Springer: Paderborn, 2002; 927-932. DOI: 10.1007/3-540-45706-2-132.
60. Caromel D, Leyton M,. Fine tuning algorithmic skeletons. Euro-Par 2007 (Lecture Notes in Computer Science, vol. 4641). Springer: Rennes, 2007; 72-81. DOI: 10.1007/978-3-540-74466-5-9.
61. Ferreira JF, Sobral JL, Proenca AJ,. JaSkel: A Java skeleton-based framework for structured cluster and grid computing. CCGRID '06. IEEE: Singapore, 2006; 301-304. DOI: 10.1109/CCGRID.2006.65.
62. Aldinucci M, Danelutto M, Teti P,. An advanced environment supporting structured parallel programming in Java. Future Generation Computer Systems 2003; 19 (5): 611-626. DOI: 10.1016/S0167-739X(02)00172-3.
63. Aldinucci M, Danelutto M, Dazzi P,. Muskel: An expandable skeleton environment. Scalable Computing: Practice and Experience 2007; 8 (4): 325-341.
64. Falcou J, Serot J, Chateau T, Lapreste J,. Quaff: efficient C + + design for parallel skeletons. Parallel Computing 2006; 32 (7-8): 604-615. DOI: 10.1016/j.parco.2006.06.001.
65. Bacci B, Danelutto M, Pelagatti S, Vanneschi M,. SkIE: A heterogeneous environment for HPC applications. Parallel Computing 1999; 25 (13): 1827-1852. DOI: 10.1016/S0167-8191(99)00072-1.
66. Vanneschi M,. The programming model of ASSIST, an environment for parallel and distributed portable applications. Parallel Computing 2002; 28 (12): 1709-1732. DOI: 10.1016/S0167-8191(02)00188-6.
67. Danelutto M, Stigliani M,. SKElib: Parallel programming with skeletons in C. Euro-Par '00. Springer: Munich, 2000; 1175-1184. DOI: 10.1007/3-540-44520-X.
68. Benoit A, Cole M, Gilmore S, Hillston J,. Flexible skeletal programming with eSkel. Euro-Par 2005 (Lecture Notes in Computer Science, vol. 3648). Springer: Lisbon, 2005; 761-770. DOI: 10.1007/11549468-83.
69. Aldinucci M, Coppola M, Danelutto M, Tonellotto N, Vanneschi M, Zoccolo C,. High level grid programming with ASSIST. Computational Methods in Science and Technology 2006; 12 (1): 21-32.
70. Aldinucci M, Antoniu G, Danelutto M, Jan M,. Fault-tolerant data sharing for high-level grid programming: A hierarchical storage architecture. Integrated Research in Grid Computing Wksp. CoreGRID Series. Springer: Krakow, 2006; 177-188. DOI: 10.1007/978-0-387-72812-4-6.
71. Aldinucci M, Torquati M,. Accelerating Apache farms through ad-hoc distributed scalable object repository. Euro-Par 2004 (Lecture Notes in Computer Science, vol. 3149). Springer: Pisa, 2004; 596-605. DOI: 10.1007/b99409.
72. Aldinucci M, Petrocelli A, Pistoletti E, Torquati M, Vanneschi M, Veraldi L, Zoccolo C,. Dynamic reconfiguration of Grid-aware applications in ASSIST. Euro-Par 2005 (Lecture Notes in Computer Science, vol. 3648). Springer: Lisbon, 2005; 771-781. DOI: 10.1007/11549468-84.
73. Caromel D, Henrio L, Leyton M,. Type safe algorithmic skeletons. PDP 2008. IEEE: Toulouse, 2008; 45-53. DOI: 10.1109/PDP.2008.29.
74. Caromel D, Leyton M,. A transparent non-invasive file data model for algorithmic skeletons. IPDPS 2008. IEEE: Miami, 2008; 1-10. DOI: 10.1109/IPDPS.2008.4536276.
75. Breitinger S, Loogen R, Ortega-Mallén Y, Pena R,. The Eden coordination model for distributed memory systems. HIPS '97. IEEE: Geneva, 1997; 120-124. DOI: 10.1109/HIPS.1997.582964.
76. Klusik U, Loogen R, Priebe S, Rubio F,. Implementation skeletons in Eden: Low-effort parallel programming. IFL '00 (Lecture Notes in Computer Science, vol. 2011). Springer: Aachen, 2000; 71-88. DOI: 10.1007/3-540-45361-X.
77. Priebe S,. Dynamic task generation and transformation within a nestable workpool skeleton. Euro-Par 2006 (Lecture Notes in Computer Science, vol. 4128). Springer: Dresden, 2006; 615-624. DOI: 10.1007/11823285-64.
78. Berthold J, Dieterle M, Loogen R, Priebe S,. Hierarchical master-worker skeletons. PADL 2008 (Lecture Notes in Computer Science, vol. 4902). Springer: San Francisco, 2008; 248-264. DOI: 10.1007/978-3-540-77442-6-17.
79. Dieterle M, Berthold J, Loogen R,. A skeleton for distributed work pools in Eden. FLOPS 2010 (Lecure Notes in Computer Science, vol. 6009). Springer: Sendai, 2010; 337-353. DOI: 10.1007/978-3-642-12251-4-24.
80. Benoit A, Cole M,. Two fundamental concepts in skeletal parallel programming. ICCS 2005 (Lecture Notes in Computer Science, vol. 3515). Springer: Berlin, 2005; 764-771. DOI: 10.1007/11428848-98.
81. González-Vélez H,. On the abstraction of message-passing communications using algorithmic skeletons: A case study ISSADS 2005 (Lecture Notes in Computer Science, vol. 3563). Springer: Guadalajara, 2005; 43-50. DOI: 10.1007/11533962-5.
82. Benoit A, Cole M, Gilmore S, Hillston J,. Scheduling skeleton-based grid applications using PEPA and NWS. Computer Journal 2005; 48 (3): 369-378. DOI: 10.1093/comjnl/bxh089.
83. Benoit A, Cole M, Gilmore S, Hillston J,. Evaluating the performance of pipeline-structured parallel programs with skeletons and process algebra. Scalable Computing: Practice and Experience 2005; 6 (4): 1-16.
84. Benoit A, Robert Y,. Mapping pipeline skeletons onto heterogeneous platforms. Journal of Parallel and Distributed Computing 2008; 68 (6): 790-808. DOI: 10.1016/j.jpdc.2007.11.004.
85. Yaikhom G, Cole M, Gilmore S, Hillston J,. A structural approach for modelling performance of systems using skeletons. Electronic Notes in Theoretical Computer Science 2007; 190 (3): 167-183. DOI: 10.1016/j.entcs.2007. 07.010.
86. González-Véléz H, Cole M,. Adaptive structured parallelism for computational grids. PPoPP '07. ACM: San Jose, 2007; 140-141. DOI: 10.1145/1229428.1229456.
87. González-Vélez H, Cole M,. Towards fully adaptive pipeline parallelism for heterogeneous distributed environments. ISPA 2006 (Lecture Notes in Computer Science, vol. 4330). Springer: Sorrento, 2006; 916-926. DOI: 10.1007/11946441-82.
88. González-Vélez H, Cole M,. An adaptive parallel pipeline pattern for grids. IPDPS 2008. IEEE: Miami, 2008; 1-8. DOI: 10.1109/IPDPS.2008. 4536264.
89. González-Vélez H,. Self-adaptive skeletal task farm for computational grids. Parallel Computing 2006; 32 (7-8): 479-490. DOI: 10.1016/j.parco.2006.07.002.
90. González-Vélez H, Cole M,. Adaptive structured parallelism for distributed heterogeneous architectures: A methodological approach with pipelines and farms. Concurrency and Computation: Practice and Experience 2010; 22 (5): 2073-2094. DOI: 10.1002/cpe.1549.
91. González-Vélez H, Cole M,. Adaptive statistical scheduling of divisible workloads in heterogeneous systems. Journal of Scheduling 2010; 13 (4): 427-441. DOI: 10.1007/s10951-009-0138-4.
92. González-Vélez V, González-Vélez H,. Parallel stochastic simulation of macroscopic calcium currents. Journal of Bioinformatics and Computational Biology 2007; 5 (3): 755-772. DOI: 10.1142/S0219720007002679.
93. Herrmann CA, Lengauer C,. Using metaprogramming to parallelize functional specifications. Parallel Processing Letters 2002; 12 (2): 193-210. DOI: 10.1142/S0129626402000926.
94. Alt M, Gorlatch S,. Using skeletons in a Java-based grid system. Euro-Par 2003 (Lecture Notes in Computer Science, vol. 2790). Springer: Berlin, 2003; 682-693. DOI: 10.1007/b12024.
95. Alt M, Gorlatch S,. A prototype grid system using Java and RMI. PaCT 2003 (Lecture Notes in Computer Science, vol. 2763). Springer: Nizhni Novgorod, 2003; 401-414. DOI: 10.1007/b11928.
96. Alt M, Gorlatch S,. Algorithmic skeletons for metacomputing. APPT (Lecture Notes in Computer Science, vol. 2834). Springer: Berlin, 2003; 363-372. DOI: 10.1007/b13582.
97. Alt M, Gorlatch S,. Adapting Java RMI for grid computing. Future Generation Computer Systems 2005; 21 (4): 699-707. DOI: 10.1016/j.future.2004. 05.010.
98. Dünnweber J, Gorlatch S,. HOC-SA: A grid service architecture for higher-order components. SCC'04. IEEE: Shanghai, 2004. DOI: 10.1109/SCC.2004. 1358017.
99. Gorlatch S, Dünnweber J,. From grid middleware to grid applications: Bridging the gap with HOCs. Future Generation Grids. Springer: Dagstuhl, 2006; 241-261. DOI: 10.1007/978-0-387-29445-2-13.
100. Kiczales G, Hilsdale E, Hugunin J, Kersten M, Palm J, Griswold WG,. An overview of AspectJ. ECOOP '01 (Lecture Notes in Computer Science, vol. 2072). Springer: Budapest, 2001; 327-353.
101. Sobral J, Proenca A,. Enabling JaSkel skeletons for clusters and computational grids. Cluster 2007. IEEE: Austin, 2007; 365-371. DOI: 10.1109/CLUSTR.2007.4629251.
102. Alonso JM, Hernández V, Moltó G,. Gmarte: Grid middleware to abstract remote task execution. Concurrency and Computation: Practice and Experience 2006; 18 (15): 2021-2036. DOI: 10.1002/cpe.1052.
103. Danelutto M, Dazzi P,. Joint structured/unstructured parallelism exploitation in Muskel. ICCS 2006 (Lecture Notes in Computer Science, vol. 3992). Springer: Reading, 2006; 937-944. DOI: 10.1007/11758525-124.
104. Aldinucci M, Danelutto M,. An operational semantics for skeletons. PARCO 2003, vol. 13. Elsevier: Dresden, 2004; 63-70. DOI: 10.1016/S0927-5452(04)80011- X.
105. Aldinucci M, Danelutto M,. Skeleton based parallel programming: functional and parallel semantic in a single shot. Computer Languages, Systems and Structures 2007; 33 (3-4): 179-192. DOI: 10.1016/j.cl.2006.07.004.
106. Danelutto M, Teti P,. Lithium A structured parallel programming enviroment in Java. ICCS 2002 (Lecture Notes in Computer Science, vol. 2330). Springer: Berlin, 2002; 844-853. DOI: 10.1007/3-540-46080-2-89.
107. Danelutto M,. Efficient support for skeletons on workstation clusters. Parallel Processing Letters 2001; 11 (1): 41-56. DOI: 10.1142/S0129626401000415.
108. Aldinucci M, Danelutto M, Dünnweber J, Gorlatch S,. Optimization techniques for skeletons on grids. Grid Computing and New Frontiers of High Performance Computing, Advances in Parallel Computing, Grandinetti L, (ed.). vol. 14. Elsevier: 2005; 255-273. DOI: 10.1016/S0927-5452(05)80014-0.
109. Danelutto M,. QoS in parallel programming through application managers. PDP '05. IEEE: Lugano, 2005; 282-289. DOI: 10.1109/EMPDP.2005.35.
110. Aldinucci M, Danelutto M,. The cost of security in skeletal systems. PDP'07. IEEE: Napoli, 2007; 213-220. DOI: 10.1109/PDP.2007.79.
111. Aldinucci M, Danelutto M,. Securing skeletal systems with limited performance penalty: the Muskel experience. Journal of Systems Architecture 2008; 54 (9): 868-876. DOI: 10.1016/j.sysarc.2008.02.008.
112. Danelutto M, Dazzi P,. A Java/Jini framework supporting stream parallel computations. ParCo 2005. Central Institute for Applied Mathematics, Jülich: Málaga, 2005; 681-688.
113. Aldinucci M, Danelutto M, Kilpatrick P,. Autonomic management of non-functional concerns in distributed & parallel application programming. IPDPS 2009. IEEE: Rome, 2009; 1-12. DOI: 10.1109/IPDPS.2009.5161034.
114. Aldinucci M, Campa S, Danelutto M, Vanneschi M, Kilpatrick P, Dazzi P, Laforenza D, Tonellotto N,. Behavioural skeletons in GCM: Autonomic management of grid components. PDP 2008. IEEE: Toulose, 2008; 54-63. DOI: 10.1109/PDP.2008.46.
115. Aldinucci M, Danelutto M, Kilpatrick P,. Autonomic management of multiple non-functional concerns in behavioural skeletons. Grids, P2P and Services Computing, Desprez F, Getov V, Priol T, Yahyapour R, (eds). Springer: Berlin, 2010; 89-103. DOI: 10.1007/978-1-4419-6794-7-8.
116. Dorta A, López P, de Sande F,. Basic skeletons in llc. Parallel Computing 2006; 32 (7-8): 491-506. DOI: 10.1016/j.parco.2006.07.001.
117. Reyes R, Dorta AJ, Almeida F, de Sande F,. Automatic hybrid MPI+OpenMP code generation with llc. PVM/MPI 2009 (Lecture Notes in Computer Science, vol. 5759). Springer: Espoo, 2009; 185-195. DOI: 10.1007/978-3-642-03770-2-25.
118. Dorta AJ, Badía JM, Quintana-Ortí ES, de Sande F,. Parallelizing dense linear algebra operations with task queues in llc. PVM/MPI 2007 (Lecture Notes in Computer Science, vol. 4757). Springer: Paris, 2007; 89-96. DOI: 10.1007/978-3-540-75416-9-18.
119. Alba E, Almeida F, Blesa M, Cotta C, Díaz M, Dorta I, Gabarró J, León C, Luque G, Petit J, Rodríguez C, Rojas A, Xhafa F,. Efficient parallel LAN/WAN algorithms for optimization. The MALLBA project. Parallel Computing 2006; 32 (5-6): 415-440. DOI: 10.1016/j.parco.2006. 06.007.
120. Alba E, Luque G, García-Nieto J, Ordonez G, Leguizamon G,. MALLBA: A software library to design efficient optimisation algorithms. International Journal of Innovative Computing and Applications 2007; 1 (1): 74-85. DOI: 10.1504/IJICA.2007.013403.
121. 3L: A structured high level programming language and its structured support. Concurrency and Computation: Practice and Experience 1995; 7 (3): 225-255. DOI: 10.1002/cpe.4330070305.
122. Bacci B, Cantalupo B, Danelutto M, Orlando S, Pasetto D, Pelagatti S, Vanneschi M,. An environment for structured parallel programming. Advances in High Performance Computing (NATO Science Partnership Sub-Series, vol. 30). Kluwer Academic Press: Cetraro, 1997; 219-234.
123. Danelutto M, Pasqualetti F, Pelagatti S,. Skeletons for data parallelism in P3l. Euro-Par '97 (Lecture Notes in Computer Science, vol. 1300). Springer: London, 1997; 619-628. DOI: 10.1007/BFb0002792.
124. Bacci B, Danelutto M, Pelagatti S, Vanneschi M,. SkIE a heterogeneous environment for HPC applications. Parallel Computing 1999; 25 (13-14): 1827-1852. DOI: 10.1016/S0167-8191(99)00072-1.
125. Grelck C,. Shared memory multiprocessor support for SAC. IFL'98 (Lecture Notes in Computer Science, vol. 1595). Springer: London, 1998; 38-53. DOI: 10.1007/3-540-48515-5-3.
126. Grelck C, Scholz SB,. SAC-from high-level programming with arrays to efficient parallel execution. Parallel Processing Letters 2003; 13 (3): 401-412. DOI: 10.1142/S0129626403001379.
127. Grelck C, Julku J, Penczek F,. S-net for multi-memory multicores. DAMP '10. ACM: Madrid, 2010; 25-34. DOI: 10.1145/1708046.1708054.
128. Darlington J, Guo Y, To HW, Yang J,. Parallel skeletons for structured composition. PPOPP'95. ACM: Santa Barbara, 1995; 19-28. DOI: 10.1145/209936.209940.
129. Matsuzaki K, Hu Z, Takeichi M,. Parallelization with tree skeletons Euro-Par 2003 (Lecture Notes in Computer Science, vol. 2790). Springer: Klagenfurt, 2003; 789-798. DOI: 10.1007/b12024.
130. Matsuzaki K, Hu Z, Takeichi M,. Parallel skeletons for manipulating general trees. Parallel Computing 2006; 32 (7): 590-603. DOI: 10.1016/j.parco.2006.06.002.
131. Emoto K, Hu Z, Kakehi K, Takeichi M,. A compositional framework for developing parallel programs on two-dimensional arrays. International Journal of Parallel Programming 2007; 35 (6): 615-658. DOI: 10.1007/s10766-007-0043-4.
132. Matsuzaki K, Kakehi K, Iwasaki H, Hu Z, Akashi Y,. A fusion-embedded skeleton library. Euro-Par 2004 (Lecture Notes in Computer Science, vol. 3149). Springer: Pisa, 2004; 644-653. DOI: 10.1007/b99409.
133. Emoto K, Matsuzaki K, Hu Z, Takeichi M,. Domain-specific optimization strategy for skeleton programs. Euro-Par 2007 (Lecture Notes in Computer Science, vol. 4641). Springer: Rennes, 2007; 705-714. DOI: 10.1007/978-3-540- 74466-5-74.
134. Morihata A, Matsuzaki K, Hu Z, Takeichi M,. The third homomorphism theorem on trees: Downward & upward lead to divide-and-conquer. POPL '09. ACM: Savannah, 2009; 177-185. DOI: 10.1145/1480881.1480905.
135. Botorog GH, Kuchen H,. Algorithmic skeletons for adaptive multigrid methods. IRREGULAR'95 (Lecture Notes in Computer Science, vol. 980). Springer: Lyon, 1995; 27-41. DOI: 10.1007/3-540-60321-2.
136. Botorog GH, Kuchen H,. Efficient parallel programming with algorithmic skeletons. Euro-Par '96. Springer: Lyon, 1996; 718-731. DOI: 10.1007/3-540-61626-8-95.
137. Botorog GH, Kuchen H,. Using algorithmic skeletons with dynamic data structures. IRREGULAR '96 (Lecture Notes in Computer Science, vol. 1117). Springer: Santa Barbara, 1996; 263-276. DOI: 10.1007/BFb0030116.
138. Botorog GH, Kuchen H,. Efficient high-level parallel programming. Theoretical Computer Science 1998; 196 (1-2): 71-107. DOI: 10.1016/S0304- 3975(97)00196-5.
139. Kuchen H, Striegnitz J,. Higher-order functions and partial applications for a C + + skeleton library. JGI'02. ACM: Seattle, 2002; 122-130. DOI: 10.1145/583810.583824.
140. Kuchen H,. A skeleton library. Euro-Par 2002 (Lecture Notes in Computer Science, vol. 2400). Springer: Paderborn, 2002; 620-629. DOI: 10.1007/3-540-45706-2-86.
141. Kuchen H, Striegnitz J,. Features from functional programming for a C + + skeleton library. Concurrency and Computation: Practice and Experience 2005; 17 (7-8): 739-756. DOI: 10.1002/cpe.844.
142. Kuchen H, Cole M,. The integration of task and data parallel skeletons. Parallel Processing Letters 2002; 12 (2): 141-155. DOI: 10.1142/ S0129626402000896.
143. Kuchen H,. Optimizing sequences of skeleton calls. Domain-Specific Program Generation (Lecture Notes in Computer Science, vol. 3016). Springer: Dagstuhl, 2004; 254-273. DOI: 10.1007/b98156.
144. Poldner M, Kuchen H,. On implementing the farm skeleton. Parallel Processing Letters 2008; 18 (1): 117-131. DOI: 10.1142/S0129626408003260.
145. Poldner M, Kuchen H,. Optimizing skeletal stream processing for divide and conquer. ICSOFT 2008. INSTICC Press: Porto, 2008; 181-189.
146. Sérot J, Ginhac D, Dérutin J,. SKiPPER: a skeleton-based parallel programming environment for real-time image processing applications. PaCT-99 (Lecture Notes in Computer Science, vol. 1662). Springer: Berlin, 1999; 296-305. DOI: 10.1007/3-540-48387-X-31.
147. Falcou J, Sérot J,. Formal semantics applied to the implementation of a skeleton-based parallel programming library. ParCo 2007. NIC, vol. 38. John von Neumann Institute for Computing: Julich, 2007; 243-252.
148. González-Vélez H, de Luca A, González-Vélez V,. A comparative study of intrinsic parallel programming methodologies. ICEEE. IEEE: Acapulco, 2004; 200-205. DOI: 10.1109/ICEEE.2004.1433876.
149. Danelutto M,. HPC the easy way: new technologies for high performance application development and deployment. Journal of Systems Architectures 2003; 49 (10-11): 399-419. DOI: 10.1016/j.sysarc.2003.06.001.
150. Gamma E, Helm R, Johnson R, Vlissides J,. Design patterns: Abstraction and reuse of object-oriented design. ECOOP'93 (Lecture Notes in Computer Science, vol. 707). Springer: Kaiserslautern, 1993; 406-431. DOI: 10.1007/3-540-47910-4-21.
151. Gamma E, Helm R, Johnson R, Vlissides JM,. Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley Professional Computing Series. Addison-Wesley Longman: Upper Saddle River, 1995.
152. Mattson TG, Sanders BA, Massingill BL,. Patterns for Parallel Programming. Software Patterns Series. Addison-Wesley Longman: Boston, 2004.
153. MacDonald S, Anvik J, Bromling S, Schaeffer J, Szafron D, Tan K,. From patterns to frameworks to parallel programs. Parallel Computing 2002; 28 (12): 1663-1683. DOI: 10.1016/S0167-8191(02)00190-4.
154. Mehta P, Amaral JN, Szafron D,. Is MPI suitable for a generative design-pattern system? Parallel Computing 2006; 32 (7-8): 616-626. DOI: 10.1016/j.parco.2006.06.008.
155. Villacis J, Gannon D,. A web interface to parallel program source code archetypes. SC'95. IEEE: San Diego, 1995; 18. DOI: 10.1145/224170.224207.
156. McKenney PE,. Selecting locking primitives for parallel programming. Communications of the ACM 1996; 39 (10): 75-82. DOI: 10.1145/236156.236174.
157. Schmidt D, Stal M, Rohnert H, Buschmann F,. Pattern-oriented software architecture, software design patterns. Patterns for Concurrent and Networked Objects, vol. 2. Wiley: Chichester, 2000.
158. Gomes MC, Rana OF, Cunha JC,. Extending grid-based workflow tools with patterns/operators. International Journal of High Performance Computing Applications 2008; 22 (3): 301-318. DOI: 10.1177/1094342007086228.
159. Dean J, Ghemawat S,. MapReduce Simplified data processing on large clusters. OSDI'04. USENIX: San Francisco, 2004; 137-150.
160. Dean J, Ghemawat S,. MapReduce: Simplified data processing on large clusters. Communications of the ACM 2008; 51 (1): 107-113. DOI: 10.1145/1327452.1327492.
161. White T,. Hadoop: The Definitive Guide. O'Reilly Media: Sebastopol, 2009.
162. Ranger C, Raghuraman R, Penmetsa A, Bradski G, Kozyrakis C,. Evaluating MapReduce for multi-core and multiprocessor systems. HPCA-13. IEEE: Phoenix, 2007; 13-24. DOI: 10.1109/HPCA.2007.346181.
163. Reinders J,. Intel Threading Building Blocks: Outfitting C + + for Multi-core Processor Parallelism. O'Reilly Media: Sebastopol, 2007.
164. Willhalm T, Popovici N,. Putting Intel threading building blocks to work. IWMSE '08. ACM: Leipzig, 2008; 3-4. DOI: 10.1145/1370082.1370085.
165. Leijen D, Schulte W, Burckhardt S,. The design of a task parallel library. SIGPLAN Notes 2009; 44 (10): 227-242. DOI: 10.1145/1639949.1640106.
166. Asanovic K, Bodik R, Demmel J, Keaveny T, Keutzer K, Kubiatowicz J, Morgan N, Patterson D, Sen K, Wawrzynek J, Wessel D, Yelick K,. A view of the parallel computing landscape. Communication of the ACM 2009; 52 (10): 56-67. DOI: 10.1145/1562764.1562783.
167. Nolte J, Sato M, Ishikawa Y,. Exploiting cluster networks for distributed object groups and collective operations. Future Generation Computer Systems 2002; 18 (4): 461-476. DOI: 10.1016/S0167-739X(01)00075-9.
168. Quinlan DJ, Schordan M, Miller B, Kowarschik M,. Parallel object-oriented framework optimization. Concurrency and Computation: Practice and Experience 2004; 16 (2-3): 293-302. DOI: 10.1002/cpe.775.
169. Johnson E, Gannon D,. HP C + + experiments with the parallel standard template library. ICS '97. ACM: Vienna, 1997; 124-131. DOI: 10.1145/263580. 263614.
170. Austern MH,. Generic Programming and the STL: Using and Extending the C + + Standard Template Library. Addison-Wesley Longman: Boston, 1998.
171. An P, Jula A, Rus S, Saunders S, Smith TG, Tanase G, Thomas N, Amato NM, Rauchwerger L,. STAPL: An adaptive, generic parallel C + + library. LCPC 2001 (Lecture Notes in Computer Science, vol. 2624). Springer: Cumberland Falls, 2001; 193-208. DOI: 10.1007/3-540-35767-X-13.
172. Buss A, Harshvardhan, Papadopoulos I, Pearce O, Smith T, Tanase G, Thomas N, Xu X, Bianco M, Amato NM, Rauchwerger L,. STAPL: Standard template adaptive parallel library. SYSTOR '10. ACM: Haifa, 2010; 1-10. DOI: 10.1145/1815695. 1815713.
173. Kambadur P, Gregor D, Lumsdaine A, Dharurkar A,. Modernizing the C + + interface to MPI. European PVM/MPI (Lectuer Notes in Computer Science, vol. 4192). Springer: Bonn, 2006; 266-274. DOI: 10.1007/11846802-39.
174. Kambadur P, Gregor D, Lumsdaine A,. OpenMP extensions for generic libraries. IWOMP 2008 (Lecture Notes in Computer Science, vol. 5004). Springer: West Lafayette, 2008; 123-133. DOI: 10.1007/978-3-540-79561-2-11.
175. Singler J, Sanders P, Putze F,. MCSTL: The multi-core standard template library. Euro-Par 2007 (Lecure Notes in Computer Science, vol. 4641). Springer: Rennes, 2007; 682-694. DOI: 10.1007/978-3-540-74466-5-72.
176. Kambadur P, Gupta A, Ghoting A, Avron H, Lumsdaine A,. PFunc: modern task parallelism for modern high performance computing. SC '09. ACM: Portland, 2009; 1-11. DOI: 10.1145/1654059.1654103.
177. Reynders J, Gannon D, Chandy KM,. Parallel object-oriented libraries. The Sourcebook of Parallel Computing, Chapter 13, Dongarra et al. (eds.). Morgan Kaufmann: San Francisco, 2002; 383-407.
178. Gerlach J, Kneis J,. Generic programming for scientific computing in C + +, Java, and C#. APPT'03 (Lecture Notes in Computer Science, vol. 2834). Springer: Xiamen, 2003; 301-310. DOI: 10.1007/978-3-540-39425-9-37.
179. Siek JG, Lumsdaine A,. The Matrix Template Library: A generic programming approach to high performance numerical linear algebra. ISCOPE'98 (Lecture Notes in Computer Science, vol. 1505). Springer: Santa Fe, 1998; 59-70. DOI: 10.1007/3-540-49372-7-6.
180. Whaley RC, Petitet A, Dongarra J,. Automated empirical optimizations of software and the ATLAS project. Parallel Computing 2001; 27 (1-2): 3-35. DOI: 10.1016/S0167-8191(00)00087-9.
181. Foster I, Kesselman C,. Globus: A metacomputing infrastructure toolkit. International Journal of High Performance Computing Applications 1997; 11 (2): 115-128. DOI: 10.1177/109434209701100205.
182. Gannon D, Bramley R, Fox G, Smallen S, Rossi A, Ananthakrishnan R, Bertrand F, Chiu K, Farrellee M, Govindaraju M, Krishnan S, Ramakrishnan L, Simmhan Y, Slominski A, Ma Y, Olariu C, Rey-Cenvaz N,. Programming the grid: Distributed software components, P2P and grid web services for scientific applications. Cluster Computing 2002; 5 (3): 325-336. DOI: 10.1023/A: 1015633507128.
183. Armstrong R, Gannon D, Geist A, Keahey K, Kohn SR, McInnes LC, Parker SR, Smolinski BA,. Towards a common component architecture for high-performance scientific computing. HPDC'99. IEEE: Redondo Beach, 1999; 115-124. DOI: 10.1109/HPDC.1999.805289.
184. Czarnecki K, Eisenecker UW,. Generative Programming: Methods, Tools, and Applications. Addison-Wesley Longman: Boston, 2000.
185. Dangelmayr C, Blochinger W,. Aspect-oriented component assembly-A case study in parallel software design. Software: Practice and Experience 2009; 39 (9): 807-832. DOI: 10.1002/spe.912.
186. Crnkovic I, Larssom M,. Challenges of component-based development. Journal of Systems and Software 2002; 61 (3): 201-212. DOI: 10.1016/S0164- 1212(01)00148-0.
187. Kuang H, Bic LF, Dillencourt MB,. PODC Paradigm-oriented distributed computing. Journal of Parallel and Distributed Computing 2006; 65 (4): 506-518. DOI: 10.1016/j.jpdc.2004.11.009.
188. Dünnweber J, Gorlatch S,. HOC-SA: A grid service architecture for higher-order components. SCC'04. IEEE: Shanghai, 2004; 288-294. DOI: 10.1109/SCC.2004.1358017.
189. Goswami D, Singh A, Preiss BR,. From design patterns to parallel architectural skeletons. Journal of Parallel and Distributed Computing 2002; 62 (4): 669-695. DOI: 10.1006/jpdc.2001.1809.
190. McCool MD,. Structured parallel programming with deterministic patterns. HotPar '10. USENIX: Berkeley, 2010; 1-6.
191. Mannheim U,. Tennessee and NERSC. TOP500 supercomputer sites. Web site June 2010. Available at: http://www.top500.org/ [Accessed on 12 August 2010].
192. Vadhiyar SS, Dongarra J,. Self adaptivity in grid computing. Concurrency and Computation: Practice and Experience 2005; 17 (2-4): 235-257. DOI: 10.1002/cpe.v17:2/4.
193. Cunha JC, Rana OF, Medeiros PD,. Future trends in distributed applications and problem-solving environments. Future Generation Computer Systems 2005; 21 (6): 843-855. DOI: 10.1016/j.future.2003.12.015.