Mixed programming models using parallel tasks

The Handbook of Research on Scalable Computing Technologies

Volumn 1, Issue , 2009, Pages 246-275

  Dümmler, Jörg ^a   Rauber, Thomas ^b   Rünger, Gudula ^a  

^a CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

^b UNIVERSITY OF BAYREUTH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84872701556     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-661-7.ch011     Document Type: Chapter

References (74)

1. Aldinucci, M., Danelutto, M., & Teti, P. (2003). An advanced environment supporting structured parallel programming in Java. Future Generation Computer Systems, 19(5), 611-626. doi:10.1016/S0167739X(02)00172-3
2. Allen, E., Chase, D., Hallett, J., Luchangco, V., Maessen, J.-W., Ryo, S., et al. (2008). The Fortress language specification, Version 1.0. Santa Clara, CA: Sun Microsystems, Inc.
3. Bal, H. E., & Haines, M. (1998). Approaches for integrating task and data parallelism. IEEE Concurrency, 6(3), 74-84. doi:10.1109/4434.708258
4. Ben Hassen, S., Bal, H. E., & Jacobs, C. J. H. (1998). A task- and data-parallel programming language based on shared objects. [TOPLAS]. ACM Transactions on Programming Languages and Systems, 20(6), 1131-1170. doi:10.1145/295656.295658
5. Brandes, T. (1999). Exploiting advanced task parallelism in high performance Fortran via a task library. In Euro-Par '99: Proceedings of the 5th International Euro-Par Conference on Parallel Processing (pp. 833-844). London: Springer-Verlag.
6. Chamberlain, B. L., Callahan, D., & Zima, H. P. (2007). Parallel programmability and the chapel language. International Journal of High Performance Computing Applications, 21(3), 291-312. doi:10.1177/1094342007078442
7. Chandy, M., Foster, I., Kennedy, K., Koelbel, C., & Tseng, C.-W. (1994). Integrated support for task and data parallelism. The International Journal of Supercomputer Applications, 8(2), 80-98.
8. Chapman, B., Haines, M., Mehrota, P., Zima, H., & van Rosendale, J. (1997). Opus: A coordination language for multidisciplinary applications. Science Progress, 6(4), 345-362.
9. Chapman, B. M., Mehrotra, P., van Rosendale, J., & Zima, H. P. (1994). A software architecture for multidisciplinary applications: integrating task and data parallelism. In CONPAR 94 - VAPP VI: Proceedings of the Third Joint International Conference on Vector and Parallel Processing (pp. 664-676). London: Springer-Verlag.
10. Charles, P., Grothoff, C., Saraswat, V., Donawa, C., Kielstra, A., Ebcioglu, K., et al. (2005). X10: An object-oriented approach to non-uniform cluster computing. In OOPSLA '05 Proceedings of the 20th annual ACM SIGPLAN Conference on Object Oriented Programming, Systems, Languages, and Applications (pp. 519-538). New York: ACM.
11. Ciarpaglini, S., Folchi, L., Orlando, S., Pelagatti, S., & Perego, R. (2000). Integrating task and data parallelism with taskHPF. In H. R. Arabnia (Ed.). Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2000. Las Vegas, NV: CSREA Press.
12. Diaz, M., Rubio, B., Soler, E., & Troya, J. M. (2002). A border-based coordination language for integrating task and data parallelism. Journal of Parallel and Distributed Computing, 62(4), 715-740. doi:10.1006/jpdc.2001.1814
13. Diaz, M., Rubio, B., Soler, E., & Troya, J. M. (2003). Domain interaction patterns to coordinate HPF tasks. Parallel Computing, 29(7), 925-951. doi:10.1016/S0167-8191(03)00064-4
14. Diaz, M., Rubio, B., Soler, E., & Troya, J. M. (2004). SBASCO: Skeleton-based scientific components. In Proceedings of the 12th Euromicro Workshop on Parallel, Distributed and Network-Based Processing (PDP 2004) (pp. 318-325). Washington, DC: IEEE Computer Society.
15. Dorta, A. J., González, J. A., Rodriguez, C., & de Sande, F. (2003). LLC: A parallel skeletal language. Parallel Processing Letters, 13(3), 437-448. doi:10.1142/S0129626403001409
16. Dorta, A. J., López, P., & de Sande, F. (2006). Basic skeletons in LLC. Parallel Computing, 32(7-8), 491-506. doi:10.1016/j.parco.2006.07.001
17. Dümmler, J., Kunis, R., & Rünger, G. (2007a). A scheduling toolkit for multiprocessor-task programming with dependencies. In Proceedings of the 13th International Euro-Par Conference (pp. 23-32). Berlin: Springer.
18. Dümmler, J., Kunis, R., & Rünger, G. (2007b). A comparison of scheduling algorithms for multiprocessortasks with precedence constraints. In Proceedings of the 2007 High Performance Computing & Simulation (HPCS'07) Conference (pp. 663-669). ECMS.
19. Dümmler, J., Rauber, T., & Rünger, G. (2007). Communicating multiprocessor-tasks. In Proceedings of the 20th International Workshop on Languages and Compilers for Parallel Computing (LCPC 2007). Berlin: Springer.
20. Dümmler, J., Rauber, T., & Rünger, G. (2008a). A transformation framework for communicating multiprocessor-tasks. In Proceedings of the 16th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP 2008) (pp. 64-71). New York: IEEE Computer Society.
21. Dümmler, J., Rauber, T., & Rünger, G. (2008b). Mapping algorithms for multiprocessor tasks on multicore clusters. In Proceedings of the 37th International Conference on Parallel Processing (ICPP08). New York: IEEE Computer Society.
22. Fink, S. J. (1998). A programming model for block-structured scientific calculations on smp clusters. Doctoral thesis, University of California, San Diego, CA.
23. Foster, I., Kohr, D. R., Krishnaiyer, R., & Choudhary, A. (1996). Double standards: Bringing task parallelism to HPF via the message passing interface. In Proceedings of the 1996 ACM/IEEE Conference on Supercomputing (pp. 36-36). New York: IEEE Computer Society.
24. Foster, I. T., & Chandy, K. M. (1995). Fortran M: A language for modular parallel programming. Journal of Parallel and Distributed Computing, 26(1), 24-35. doi:10.1006/jpdc.1995.1044
25. Fox, G., Hiranandani, S., Kennedy, K., Koelbel, C., Kremer, U., Tseng, C.-W., et al. (1990). Fortran D Language Specification (No. CRPC-TR90079), Houston, TX.
26. Grelck, C., Scholz, S.-B., & Shafarenko, A. V. (2007). Coordinating data parallel SAC programs with S-Net. In Proceedings of the 21th International Parallel and Distributed Processing Symposium (IPDPS 2007) (pp. 1-8). New York: IEEE.
27. High Performance Fortran Forum. (1993). High performance Fortran language specification, version 1.0 (No. CRPC-TR92225). Center for Research on Parallel Computation, Rice University, Houston, TX.
28. High Performance Fortran Forum. (1997). High performance Fortran language specification 2.0. Center for Research on Parallel Computation, Rice University, Houston, TX.
29. Hunold, S., Rauber, T., & Rünger, G. (2004). Multilevel hierarchical matrix-matrix multiplication on clusters. In Proceedings of the 18th International Conference of Supercomputing (ICS'04) (pp. 136-145). New York: ACM.
30. Hunold, S., Rauber, T., & Rünger, G. (2008). Combining building blocks for parallel multi-level matrix multiplication. Parallel Computing, 34(6-8), 411-426. doi:10.1016/j.parco.2008.03.003
31. Joisha, P. G., & Banerjee, P. (1999). PARADIGM (version 2.0): A new HPF compilation system. In IPPS '99/SPDP '99: Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing (pp. 609-615). Washington, DC: IEEE Computer Society.
32. Kessler, C. W., & Löwe, W. (2007). A framework for performance-aware composition of explicitly parallel components. In [Jülich/Aachen, Germany: IOS Press.]. Proceedings of the International Conference ParCo, 2007, 227-234.
33. Knuth, D. E. (1975). The art of computer programming. Volume 1: Fundamental Algorithms. Reading, MA: Addison Wesley.
34. Kühnemann, M., Rauber, T., & Rünger, G. (2004). A source code analyzer for performance prediction. In Proceedings of IPDPS'04 Workshop on Massively Parallel Processing (WMPP'04. New York: IEEE.
35. Laure, E. (2001). OpusJava: A Java framework for distributed high performance computing. Future Generation Computer Systems, 18(2), 235-251. doi:10.1016/S0167-739X(00)00094-7
36. Laure, E., Mehrotra, P., & Zima, H. P. (1999). Opus: Heterogeneous computing with data parallel tasks. Parallel Processing Letters, 9(2). doi:10.1142/S0129626499000256
37. Merlin, J. H., Baden, S. B., Fink, S., & Chapman, B. M. (1999). Multiple data parallelism with HPF and KeLP. Future Generation Computer Systems, 15(3), 393-405. doi:10.1016/S0167-739X(98)00083-1
38. N'takpé T., & Suter, F. (2006). Critical path and area based scheduling of parallel task graphs on heterogeneous platforms. In Proceedings of the Twelfth International Conference on Parallel and Distributed Systems (ICPADS) (pp. 3-10), Minneapolis, MN.
39. N'takpé T., Suter, F., & Casanova, H. (2007). A comparison of scheduling approaches for mixed-parallel applications on heterogeneous platforms. In 6th International Symposium on Parallel and Distributed Computing (pp. 35-42). Hagenberg, Austria: IEEE Computer Press.
40. Orlando, S., Palmerini, P., & Perego, R. (2000). Coordinating HPF programs to mix task and data parallelism. In Proceedings of the 2000 ACM Symposium on Applied Computing (SAC'00) (pp. 240-247). New York: ACM Press.
41. Orlando, S., & Perego, R. (1999). COLTHPF, A run-time support for the high-level co-ordination of HPF tasks. Concurrency (Chichester, England), 11(8), 407-434. doi:10.1002/(SICI)1096-9128(199907)11:8<407::AID-CPE435>3.0.CO;2-0
42. Pelagatti, S. (2003). Task and Data Parallelism in P3L. In F. A. Rabhi & S. Gorlatch (Eds.), Patterns and skeletons for parallel and distributed computing (pp.155-186). London: Springer-Verlag.
43. Pelagatti, S., & Skillicorn, D. B. (2001). Coordinating programs in the network of tasks model. Journal of Systems Integration, 10(2), 107-126. doi:10.1023/A:1011228808844
44. Radulescu, A., Nicolescu, C., van Gemund, A. J. C., & Jonker, P. (2001). CPR: Mixed task and data parallel scheduling for distributed systems. In Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS'01) (pp. 39-46). New York: IEEE Computer Society.
45. Radulescu, A., & van Gemund, A. J. C. (2001). A low-cost approach towards mixed task and data parallel scheduling. In Proceedings of the International Conference on Parallel Processing (ICPP'01)(pp. 69-76). New York: IEEE Computer Society.
46. Ramaswamy, S. (1996). Simultaneous exploitation of task and data parallelism in regular scientific computations. Doctoral thesis, University of Illinois at Urbana-Champaign.
47. Ramaswamy, S., Sapatnekar, S., & Banerjee, P. (1997). A framework for exploiting task and data parallelism on distributed memory multicomputers. IEEE Transactions on Parallel and Distributed Systems, 8(11), 1098-1116. doi:10.1109/71.642945
48. Ramaswamy, S., Simons, B., & Banerjee, P. (1996). Optimizations for efficient array redistribution on distributed memory multicomputers. Journal of Parallel and Distributed Computing, 38(2), 217-228. doi:10.1006/jpdc.1996.0142
49. Rauber, T., Reilein-Ruß, R., & Rünger, G. (2004a). Group-SPMD programming with orthogonal processor groups. Concurrency and Computation: Practice and Experience. Special Issue on Compilers for Parallel Computers, 16(2-3), 173-195.
50. Rauber, T., Reilein-Ruß, R., & Rünger, G. (2004b). On compiler support for mixed task and data parallelism. In G. R. Joubert, W. E. Nagel, F. J. Peter, & W. V. Walter (Eds.), Parallel Computing: Software Technology, Algorithms, Architectures & Applications. Proceedings of 12th International Conference on Parallel Computing (ParCo'03) (pp. 23-30). New York: Elsevier.
51. Rauber, T., & Rünger, G. (1996). The compiler TwoL for the design of parallel implementations. In Proceedings of the 1996 Conference on Parallel Architectures and Compilation Techniques(PACT'96) (pp. 292-301). Washington, DC: IEEE Computer Society.
52. Rauber, T., & Rünger, G. (1999). Compiler support for task scheduling in hierarchical execution models. Journal of Systems Architecture, 45(6-7), 483-503. doi:10.1016/S1383-7621(98)00019-8
53. Rauber, T., & Rünger, G. (1999a). Parallel execution of embedded and iterated Runge-Kutta methods. Concurrency (Chichester, England), 11(7), 367-385. doi:10.1002/(SICI)1096-9128(199906)11:7<367::AIDCPE430>3.0.CO;2-G
54. Rauber, T., & Rünger, G. (1999b). Scheduling of data parallel modules for scientific computing. In Proceedings of the 9th SIAM Conference on Parallel Processing for Scientific Computing (PPSC), SIAM(CD-ROM), San Antonio, TX.
55. Rauber, T., & Rünger, G. (2000). A transformation approach to derive efficient parallel implementations. IEEE Transactions on Software Engineering, 26(4), 315-339. doi:10.1109/32.844492
56. Rauber, T., & Rünger, G. (2005). TLib - A library to support programming with hierarchical multiprocessor tasks. Journal of Parallel and Distributed Computing, 65(3), 347-360.
57. Rauber, T., & Rünger, G. (2006). A data re-distribution library for multi-processor task programming. International Journal of Foundations of Computer Science, 17(2), 251-270. doi:10.1142/S0129054106003814
58. Rauber, T., & Rünger, G. (2007). Mixed task and data parallel executions in general linear methods. Science Progress, 15(3), 137-155.
59. Rauber, T., Rünger, G., & Wilhelm, R. (1995). Deriving optimal data distributions for group parallel numerical algorithms. In Proceedings of the Conference on Programming Models for Massively Parallel Computers (PMMP'94) (pp. 33-41). Washington, DC: IEEE Computer Society.
60. Reilein-Ruß, R. (2005). Eine komponentenbasierte Realisierung der TwoL Spracharchitektur. PhD Thesis, TU Chemnitz, Fakultät für Informatik, Chemnitz, Germany.
61. Sips, H. J., & van Reeuwijk, C. (2004). An integrated annotation and compilation framework for task and data parallel programming in Java. In Parallel Computing (PARCO): Software Technology, Algorithms, Architectures and Applications (pp. 111-118). New York: Elsevier.
62. Skillicorn, D. B. (1999). The network of tasks model, (TR1999-427). Queen's University, Kingston, Canada.
63. Subhlok, J., & Vondran, G. (1995). Optimal mapping of sequences of data parallel tasks. ACM SIGPLAN Notices, 30(8), 134-143. doi:10.1145/209937.209951
64. Subhlok, J., & Yang, B. (1997). A new model for integrated nested task and data parallel programming. In Proceedings of the 6th ACM SIGPLAN symposium on Principles and Practice of Parallel Programming (pp. 1-12). New York: ACM Press.
65. Suter, F., Desprez, F., & Casanova, H. (2004). From heterogeneous task scheduling to heterogeneous mixed parallel scheduling. In Proceedings of the 10th International Euro-Par Conference (Euro-Par'04), (LNCS: Vol. 3149, pp. 230-237). Pisa, Italy: Springer.
66. van der Houwen, P. J., & Messina, E. (1999). Parallel Adams methods. Journal of Computational and Applied Mathematics, 101(1-2), 153-165. doi:10.1016/S0377-0427(98)00214-3
67. van der Houwen, P. J., & Sommeijer, B. P. (1991). Iterated Runge-Kutta methods on parallel computers. SIAM Journal on Scientific and Statistical Computing, 12(5), 1000-1028. doi:10.1137/0912054
68. van der Wijngaart, R. F., & Jin, H. (2003). The NAS parallel benchmarks, multi-zone versions (No. NAS-03-010). NASA Ames Research Center, Sunnydale, CA.
69. van Reeuwijk, C., Kuijlman, F., & Sips, H. J. (2003). Spar: A set of extensions to Java for scientific computation. Concurrency and Computation, 15, 277-299. doi:10.1002/cpe.659
70. Vanneschi, M. (2002). The programming model of ASSIST, an environment for parallel and distributed portable applications. Parallel Computing, 28(12), 1709-1732. doi:10.1016/S0167-8191(02)00188-6
71. Vanneschi, M., & Veraldi, L. (2007). Dynamicity in distributed applications: Issues, problems and the ASSIST approach. Parallel Computing, 33(12), 822-845. doi:10.1016/j.parco.2007.08.001
72. Vydyanathan, N., Krishnamoorthy, S., Sabin, G., Çatalyürek, Ü V., Kurç, T. M., Sadayappan, P., et al. (2006a). An integrated approach for processor allocation and scheduling of mixed-parallel applications. In Proceedings of the 2006 International Conference on Parallel Processing (ICPP'06) (pp. 443-450). New York: IEEE.
73. Vydyanathan, N., Krishnamoorthy, S., Sabin, G., Çatalyürek, Ü V., Kurç, T. M., Sadayappan, P., et al. (2006b). Locality conscious processor allocation and scheduling for mixed parallel applications. In Proceedings of the 2006 IEEE International Conference on Cluster Computing, September 25-28, 2006, Barcelona, Spain. New York: IEEE.
74. West, E. A., & Grimshaw, A. S. (1995). Braid: Integrating task and data parallelism. In Proceedings of the Fifth Symposium on the Frontiers of Massively Parallel Computation (Frontiers'95) (p. 211). New York: IEEE Computer Society.