Shared memory multiprocessor support for functional array processing in SAC

Journal of Functional Programming

Volumn 15, Issue 3, 2005, Pages 353-401

  Grelck, Clemens ^a  

^a UNIVERSITY OF LÜBECK   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

MULTI-DIMENSIONAL ARRAYS; RUNTIME SYSTEM SUPPORT; SAC; SHARED MEMORY ARCHITECTURE;

C (PROGRAMMING LANGUAGE); COMPUTATION THEORY; PROGRAM COMPILERS; PROGRAM PROCESSORS; SUPERCOMPUTERS; SYNCHRONIZATION;

PARALLEL PROCESSING SYSTEMS;

EID: 20544446941     PISSN: 09567968     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0956796805005538     Document Type: Article

References (89)

1. Achten, P. and Plasmeijer, M. J. (1995) The ins and outs of Clean I/O. J. Funct. Program. 5(1), 81-110.
2. Adams, J. C., Brainerd, W. S., Martin, J. T., Smith, B. T. and Wagener, J. L. (1997) Fortran-95 Handbook - Complete ANSI/ISO Reference. Scientific and Engineering Computation. MIT Press.
3. Allen, R. and Kennedy, K. (2001) Optimizing Compilers for Modern Architectures. Morgan Kaufmann.
4. Bailey, D. and Newey, M. (1993) An extension of ML for distributed memory computers. Proceedings 16th Australasian Computer Science Conference, pp. 387-396. Brisbane, Australia.
5. Bailey, D. H., Barszcz, E., Barton, J. T., Browning, D. S., Carter, R. L., Dagum, L., Fatoohi, R. A., Frederickson, P. O., Lasinski, T. A., Schreiber, T. A., Simon, R. S., Venkatakrishnam, V. and Weeratunga, S. K. (1991) The N AS Parallel Benchmarks. Int. J. Supercomput. Applic. 5(3), 63-73.
6. Barendsen, E. and Smetsers, S. (1995) Uniqueness Type Inference. In: Hermenegildo, M. and Swierstra, S. D., editors, Proceedings 7th International Symposium on Programming Language Implementation and Logic Programming (PLILP'95): Lecture Notes in Computer Science 982, pp. 189-206. Utrecht, The Netherlands. Springer-Verlag.
7. Bernecky, R. (1997) APEX: The APL Parallel Executor. MPhil thesis, University of Toronto, Toronto, Canada.
8. Blelloch, G. E. and Sabot, G. W. (1990) Compiling Collection-Oriented Languages onto Massively Parallel Computers. J. Parallel & Distributed Comput. 8(2), 119-134.
9. Blelloch, G. E., Chatterjee, S., Hardwick, J. C., Sipelstein, J. and Zagha, M. (1994) Implementation of a Portable Nested Data-Parallel Language. J. Parallel & Distributed Comput. 21(1), 4-14.
10. Blelloch, G. E. (1996) Programming parallel algorithms. Comm. ACM, 39(3).
11. Bratvold, T. A. (1993) A skeleton-based parallelising compiler for ML. In: Plasmeijer, M. J. and van Eekelen, M., editors, Proceedings 5th International Workshop on Parallel Implementations of Functional Languages, pp. 23-34. Nijmegen, The Netherlands.
12. Breitinger, S., Loogen, R., Ortega-Mallén, Y. and Peña, R. (1997) The Eden Coordination Model for distributed memory systems. Proceedings Conference on High-level Parallel Programming Models and Supportive Environments (HIPS'97), Geneva, Switzerland. IEEE Press.
13. Bülck, T., Held, A., Kluge, W. E., Pantke, S., Rathsack, C., Scholz, S.-B. and Schröder, R. (1994) Experience with the implementation of a concurrent graph reduction system on an ncube/2 platform. In : Buchberger, B. and Volkert, J., editors, Proceedings Joint International Conference on Parallel and Vector Processing: Lecture Notes in Computer Science 854, pp. 497-508. Springer-Verlag.
14. Cann, D. C. (1989) Compilation Techniques for High Performance Applicative Computation. Technical report CS-89-108, Lawrence Livermore National Laboratory, Livermore, California, USA.
15. Cann, D. C. (1992) Retire Fortran? A debate rekindled. Comm. ACM, 35(8), 81-89.
16. Cann, D. C. and Evripidou, P. (1995) Advanced Array Optimizations for High Performance Functional Languages. IEEE Trans. Parallel & Distributed Syst. 6(3), 229-239.
17. Chakravarty, M. M. T. and Keller, G. (2003) An approach to fast arrays in Haskell. In: Jeuring, J. and Peyton Jones, S., editors, Summer School and Workshop on Advanced Functional Programming: Lecture Notes in Computer Science 2638, pp. 27-58. Springer-Verlag.
18. Chamberlain, B. L., Choi, S.-E., Lewis, C., Snyder, L., Weathersby, W. D. and Lin, C. (1998) The Case for High-Level Parallel Programming in ZPL. IEEE Computational Sci. & Eng. 5(3).
19. Cohen, W. E., Dietz, H. G. and Sponaugle, J. B. (1994) Dynamic Barrier Architecture for Multi-Mode Fine-Grain Parallelism using Conventional Processors. Technical report, TR-EE 94-9, School of Electrical Engineering, Purdue University, Indiana, USA.
20. Cole, M. I. (1989) Algorithmic Skeletons: Structured Management of Parallel Computation. Reserach Monographs in Parallel and Distributed Computing. Pitman.
21. Cole, M. (2004) Bringing skeletons out of the closet: A pragmatic manifesto for skeletal parallel programming. Parallel Comput. 30(3), 389-406.
22. Cooper, E. C. and Morrisett, J. (1990) Adding Threads to Standard ML. Technical report, CMU-CS-90-186, Carnegie-Mellon-University, School of Computer Science, Pittsburgh, Pennsylvania, USA.
23. Dagum, L. and Menon, R. (1998) OpenMP: An Industry-Standard API for Shared-Memory Programming. IEEE Trans. Computational Sci. & Eng. 5(1).
24. Darlington, J., Field, A. J., Harrison, P. G., Kelly, P. H. J., Sharp, D. W. N., Wu, Q. and While, R. L. (1993) Parallel Programming using Skeleton Functions. In: Bode, A., Reeve, M. and Wolf, G., editors, Proceedings 5th Conference on Parallel Architectures and Languages Europe (PARLE'93): Lecture Notes in Computer Science 694, pp. 146-160. Springer-Verlag.
25. Dongarra, J. J., Meuer, H. W. and Strohmaier, E. (2003) TOP500 Supercomputer Sites, 22nd edition. Proceedings Supercomputing Conference (SC'03), Phoenix, AZ. ACM Press.
26. Feo, J. T., Miller, P. J., Skedzielewski, S. K., Denton, S. M. and Solomon, C. J. (1995) Sisal 90. In: Böhm, A. P. W. and Feo, J. T.editors, Proceedings Conference on High Performance Functional Computing (HPFC'95), pp. 35-47. Denver, CO. Lawrence Livermore National Laboratory, Livermore, California, USA.
27. Gorlatch, S., Wedler, C. and Lengauer, C. (1999) Optimization rules for programming with collective operations. In: Atallah, M., editor, Proceedings 13th International Parallel Processing Symposium and the 10th Symposium on Parallel and Distributed Processing (IPPS/SPDP'99), pp. 492-499. San Juan, Puerto Rico.
28. Grelck, C. (1999) Shared memory multiprocessor support for SAC. In: Hammond, K., Davie, T. and Clack, C., editors, Proceedings 10th International Workshop on Implementation of Functional Languages (IFL'98): Lecture Notes in Computer Science 1595, pp. 38-54. Springer-Verlag.
29. Grelck, C. (2001) Implicit Shared Memory Multiprocessor Support for the Functional Programming Language SAC - Single Assignment C. PhD thesis, Institute of Computer Science and Applied Mathematics, University of Kiel, Germany. Logos Verlag.
30. Grelck, C. (2002) Implementing the NAS Benchmark MG in SAC. In: Prasanna, V. K. and Westrom, G., editors, Proceedings 16th International Parallel and Distributed Processing Symposium (IPDPS'02), pp. 38-54. Fort Lauderdale, FL. IEEE Press.
31. Grelck, C. (2003) A multithreaded vompiler backend for high-level array programming. In: Hamza, M. H., editor, Proceedings 21st International Multi-conference on Applied Informatics (Al'03), Part ii: International conference on parallel and distributed computing and networks (pdcn'03), pp. 478-484. Innsbruck, Austria. ACTA Press.
32. Grelck, C. and Scholz, S.-B. (1995) Classes and objects as basis for I/O in SAC. In: Johnsson, T., editor, Proceedings 7th International Workshop on Implementation of Functional Languages (IFL'95), pp. 30-44. Bâstad, Sweden. Gothenburg, Sweden.
33. Grelck, C. and Scholz, S.-B. (1999) Accelerating APL programs with SAC. In: Lefèvre, O., editor, Proceedings International Conference on Array Processing Languages (APL'99), pp. 50-57. Scranton, PN. ACM Press.
34. Grelck, C. and Scholz, S.-B. (2000) HPF vs. SAC - A case study. In : Bode, A., Ludwig, T., Karl, W. and Wismüller, R., editors, Proceedings 6th European Conference on Parallel Processing (EURO-PAR'00): Lecture Notes in Computer Science 1900, pp. 620-624. Munich, Germany. Springer-Verlag.
35. Grelck, C. and Scholz, S.-B. (2003a) SAC - From high-level programming with arrays to efficient parallel execution. Parallel Process. Lett. 13(3), 401-412.
36. Grelck, C. and Scholz, S.-B. (2003b) Towards an Efficient Functional Implementation of the NAS Benchmark FT. In: Malyshkin, V., editor, Proceedings 7th International Conference on Parallel Computing Technologies (PACT'03): Lecture Notes in Computer Science 2763, ppp. 230-235. Nizhni Novgorod, Russia. Springer-Verlag.
37. Grelck, C., Kreye, D. and Scholz, S.-B. (2000) On code generation for multi-generator WITH-Loops in SAC. In: Koopman, P. and Clack, C., editors, Proceedings 11th International Workshop on Implementation of Functional Languages (IFL'99): Lecture Notes in Computer Science 1868, pp. 77-94. Lochem, The Netherlands. Springer-Verlag.
38. Grelck, C., Scholz, S.-B. and Trojahner, K. (2004) With-loop scalarization: merging nested array operations. In: Trinder, P. and Michaelson, G., editors, Proceedings 15th International Workshop on Implementation of Functional Languages (IFL'03): Lecture Notes in Computer Science 3145. Springer-Verlag.
39. Haines, M. and Böhm, W. (1993) Task management, virtual shared memory, and multithreading in a distributed memory implementation of SISAL. In: Bode, A., Reeve, M. and Wolf, G., editors, Proceedings 5th Conference on Parallel Architectures and Languages Europe (PARLE'93): Lecture Notes in Computer Science 694, pp. 12-23. Springer-Verlag.
40. Hamdan, M., Michaelson, G. and King, P. (1999) A framework for nesting algorithmic skeletons. Proceedings International Conference on Parallel Computing (PARCO'99), Delft, The Netherlands.
41. Hammes, J., Sur, S. and Böhm, W. (1997) On the effectiveness of functional language features: NAS Benchmark FT. J. Funct. Program. 7(1), 103-123.
42. Hammond, K. (1994) Parallel functional programming: an introduction (invited paper). In: Hong, H., editor, First International Symposium on Parallel Symbolic Computation (PASCO'94), pp. 181-193. Linz, Austria. World Scientific.
43. Hammond, K. and Portillo, A. J. R. (2000) HaskSkel: Algorithmic skeletons in Haskell. In: Clack, C. and Koopman, P., editors, Proceedings 11th International Workshop on Implementation of Functional Languages (IFL'00): Lecture Notes in Computer Science 1868, pp. 181-198. Lochem, The Netherlands. Springer-Verlag.
44. Han, H., Tseng, C.-W. and Keleher, P. (1998) Eliminating barrier synchronization for compiler-parallelized codes on software DSMs. Int. J. Parallel Program. 26(5), 591-612.
45. Hartel, P. H. and Langendoen, K. G. (1993) Benchmarking implementations of lazy functional languages. Proceedings Conference on Functional Programming Languages and Computer Architecture (FPCA'93), PP. 341-349. Copenhagen, Denmark. ACM Press.
46. Hartel, P. H. et al. (1996) Benchmarking implementations of functional languages with "Pseudoknot", a float-intensive benchmark. J. Funct. Program. 6(4).
47. Hennessy, J. L. and Patterson, D. A. (2003) Computer Architecture: A quantitative approach, third edition. Morgan Kaufmann.
48. Hill, J. M. D. and Skillicorn, D. B. (1998) Practical Barrier Synchronisation. Proceedings 6th Euromicro Workshop on Parallel and Distributed Processing (PDOP'98), pp. 438-444. Barcelona, Spain. IEEE Press.
49. Hudak, P. and Bloss, A. (1985) The aggregate update problem in functional programming systems. Proceedings 12th ACM Symposium on Principles of Programming Languages (POPL'85), pp. 300-313. New Orleans, LA. ACM Press.
50. Hummel, S. F., Schonberg, E. and Flynn, L. E. (1992) Factoring: A method for scheduling parallel loops. Comm. ACM, 35(8), 90-101.
51. Institute of Electrical and Electronic Engineers, Inc. (1995) Information Technology - Portable Operating Systems Interface (POSIX) - Part: System Application Program Interface (API) - Amendment 2: Threads Extension [C Language]. IEEE Standard 1003.1c-1995. IEEE, New York City, New York, USA. also ISO/IEC 9945-1:1990b.
52. Jones, S. L. Peyton, Gordon, A. and Finne, S. (1996) Concurrent Haskell. Proceedings 23rd ACM Symposium on Principles of Programming Languages (POPL'96), pp. 295-308. St. Petersburg Beach, FL. ACM Press.
53. Kelly, P. and Taylor, F. (1999) Coordination Languages. In: Hammond, K. and Michaelson, G., editors, Research Directions in Parallel Functional Programming, pp. 305-321. Springer-Verlag.
54. Koebel, C. H., Loveman, D. B., Schreiber, R. S., Steele, G. L. and Zosel, M. E. (1994) The High Performance Fortran Handbook. MIT Press.
55. Kruskal, C. and Weiss, A. (1985) Allocating independent subtasks on parallel processors. IEEE Trans. Softw. Eng., 11(10), 1001-1016
56. Li, H., Tandri, S., Stumm, M. and Sevcik, K. C. (1993) Locality and loop scheduling on NUMA multiprocessors. Proceedings 22nd International Conference on Parallel Processing (ICPP'93), pp. 140-147.Boca Raton, FL. CRC Press.
57. Loidl, H.-W., Trinder, P. W., Hammond, K., Junaidu, S. B., Morgan, R. G. and Jones, S. L. Peyton (1999) Engineering parallel symbolic programs in GPH. Concurrency - Practice & Exper. 11(12), 701-752.
58. Loveman, D. B. (1993) High Performance Fortran. IEEE J. Parallel & Distributed Tech.: Systems & Applic. 1(1), 25-42.
59. Markatos, E. P. and LeBlanc, T. J. (1994) Using processor affinity in loop scheduling on shared-memory multiprocessors. IEEE Trans. Parallel & Distributed Syst. 5(4), 379-400.
60. McGraw, J. R., Skedzielewski, S. K., Allan, S. J., Oldehoeft, R. R. et al. (1985) Sisal: Streams and Iteration in a Single Assignment Language: Reference Manual Version 1.2. M 146. Lawrence Livermore National Laboratory, Livermore, California, USA.
61. Michaelson, G., Scaife, N., Bristow, P. and King, P. (2001) Nested algorithmic skeletons from higher order functions. Parallel Algorithms & Applic. 16, 181-206.
62. Nöcker, E., Plasmeijer, M. J. and Smetsers, S. (1991) The Parallel ABC-machine. In: Glaser, H. and Hartel, P., editors, Proceedings 3rd International Workshop on Parallel Implementations of Functional Languages, pp. 351-382. Southampton, UK. Technical Report CSTR 91-07.
63. O'Boyle, M. F. P., Kervella, L. and Bodin, F. (1995) Synchronisation minimisation in a SPMD execution model. J. Parallel & Distributed Comput., 29(2), 196-210.
64. Oldehoeft, R. R. (1992) Implementing arrays in SISAL 2.0. Proceedings 2nd Sisal Users Conference, pp. 209-222. San Diego, CA. Lawrence Livermore National Laboratory.
65. Oldehoeft, R. R., Cann, D. C. and Allan, S. J. (1986) SISAL: Initial MIMD performance results. In: Händler, W., Haupt, D., Jeltsch, R., Juling, W. and Lange, O., editors, Proceedings Conference on Algorithms and Hardware for Parallel Processing (CONPAR'86): Lecture Notes in Computer Science 237, pp. 120-127. Aachen, Germany. Springer-Verlag.
66. Polychronopoulos, C. and Kuck, D. (1987) Guided Self Scheduling. IEEE Trans. Comput. 36(12), 1425-1439.
67. Reppy, J. H. (1991) CML: A higher-order concurrent language. Proceedings ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'91), pp. 293-305. Toronto, Canada. ACM Press.
68. Roth, G. (1997) Optimizing Fortran90D/HPF for Distributed-Memory Computers. PhD thesis, Department of Computer Science, Rice University, Houston, Texas, USA.
69. Scholz, S.-B. (1997) On programming scientific applications in SAC - A functional language extended by a subsystem for high-level array operations. In: Kluge, W., editor, Proceedings 8th International Workshop on Implementation of Functional Languages (IFL'96): Lecture Notes in Computer Science 1268, pp. 85-104. Bonnn, germany. Springer-Verlag.
70. Scholz, S.-B. (1998) With-loop-folding in SAC - Condensing consecutive array operations. In: Clack, C., Davie, T. and Hammond, K., editors, Proceedings 9th International Workshop on Implementation of Functional Languages (IFL'97): Lecture Notes in Computer Science 1467, pp. 72-92. Springer-Verlag.
71. Scholz, S.-B. (1999) A case study: Effects of WITH-Loop folding on the HAS Benchmark MG in SAC. In: Hammond, K., Davie, T. and Clack, C., editors, Proceedings 10th International Workshop on Implementation of Functional Languages (IFL'98): Lecture Notes in Computer Science 1595, pp. 216-228. London, UK. Springer-Verlag.
72. Scholz, S.-B. (2003) Single assignment C - Efficient support for high-level array operations in a functional setting. J. Funct. Program. 13(6), 1005-1059.
73. Serrarens, P. R. (1997) Implementing the conjugate gradient algorithm in a functional language. In: Kluge, W., editor, Proceedings 8th International Workshop on Implementation of Functional Languages (IFL'96): Lecture Notes in Computer Science 1268, pp. 125-140. Springer-Verlag.
74. Serrarens, P. R. (1999) Explicit message passing for Concurrent Clean. In: Hammond, K., Davie, T. and Clack, C., editors, Proceedings 10th International Workshop on Implementation of Functional Languages (IFL'98): Lecture Notes in Computer Science 1595, pp. 229-245. London, UK. Springer-Verlag.
75. Skedzielewski, S. and Welcome, M. L. (1985) Data flow graph optimization in IF1. In: Jouannaud, J.-P., editor, Proceedings Conference on Functional Programming Languages and Computer Architecture (FPCA'85): Lecture Notes in Computer Science 201, pp. 17-34. Nancy, France. Springer-Verlag.
76. Squillante, M. S. and Lazowska, E. D. (1993) Using processor-cache Affinity information in shared-memory multiprocessor scheduling. IEEE Trans. Parallel & Distributed Syst. 4(2), 131-143.
77. Tang, P. and Yew, P.-C. (1986) Processor self-scheduling for multiple nested Pparallel loops. Proceedings International Conference on Parallel Processing (ICPP'86), pp. 528-535. Chicago, IL.
78. Trinder, P., Hammond, K., Loidl, H.-W. and Jones, S. L. Peyton (1998) Algorithm + Strategy = Parallelism. J. Funct. Program. 8(1), 23-60.
79. Trinder, P. W., Hammond, K., Loidl, H.-W., Jones, S. L. Peyton and Wu, J. (1996) Accidents always come in trees: A case study of data-intensive programs in Parallel Haskell. In: Trinder, P. W., editor, Proceedings 9th Glasgow Functional Programming Workshop (GFPW'96), Ullapool, Scotland.
80. Trinder, P. W., Jr., Barry, E., Davis, M. K., Hammond, K., Junaidu, S. B., Klusik, U., Loidl, H.-W. and Jones, S. L. Peyton (1999) GPH: An architecture-independent functional language. IEEE Trans. Softw. Eng. Submitted.
81. Tseng, C.-W. (1993) An Optimizing Fortran D Compiler for MIMD Distributed-Memory Machines. PhD thesis, Rice University, Department of Computer Science, Houston, Texas, USA.
82. Tseng, C.-W. (1995) Compiler optimizations for eliminating barrier synchronization. Proceedings 5th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPOPP'95), pp. 144-155. Santa Barbara, CA. ACM Press.
83. Tzen, T. H. and Ni, L. M. (1993) Trapezoid self-scheduling: A practical scheduling scheme for parallel computers. IEEE Trans Parallel & Distributed Syst. 4(1), 87-98.
84. van Groningen, J. (1997) The implementation and efficiency of arrays in Clean 1.1. In: Kluge, W., editor, Proceedings 8th International Workshop on Implementation of Functional Languages (IFL'96): Lecture Notes in Computer Science 1268, pp. 105-124. Bonn, Germany. Springer-Verlag.
85. Wadler, P. (1992) The essence of functional programming. Proceedings 19th ACM Symposium on Principles of Programming Languages (OPOL'92), pp. 1-14. Albuquerque, NM. ACM Press.
86. Wolfe, M. J. (1995) High-Performance Compilers for Parallel Computing. Addison-Wesley.
87. Yan, Y., Jin, C. and Zhang, X. (1997) Adaptively scheduling parallel loops in distributed shared-memory systems. IEEE Trans. Parallel & Distributed Syst. 8(1), 70-81.
88. Zima, H. P. and Chapman, B. (1991) Supercompilers for Parallel and Vector Computers. Addison-Wesley.
89. Zörner, T. (1998) Numerical analysis and functional programming. In: Hammond, K., Davie, T. and Clack, C., editors, Proceedings 10th International Workshop on Implementation of Functional Languages (IFL'98), pp. 27-48. London,UK.