Pthreads for dynamic and irregular parallelism

Proceedings of the International Conference on Supercomputing

Volumn 1998-November, Issue , 1998, Pages

  Narlikar, Girija J ^a   Blelloch, Guy E ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Dynamic scheduling; Irregular parallelism; Lightweight threads; Multithreading; Pthreads; Space efficiency

Indexed keywords

BENCHMARKING; MEMORY ARCHITECTURE; MULTICORE PROGRAMMING; MULTITASKING; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS; SCHEDULING;

DYNAMIC SCHEDULING; IRREGULAR PARALLELISM; LIGHTWEIGHT THREAD; MULTI-THREADING; PARALLEL PROGRAM; PERFORMANCE; POSIX THREADS; SHARED MEMORY MACHINES; SPACE AND TIME; SPACE EFFICIENCIES;

VOLUME RENDERING;

EID: 84890024850     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.1998.10005     Document Type: Conference Paper

References (57)

1. S.J. Aarseth, M. Henon, and R. Wielen. Numerical methods for the study of star cluster dynamics. Astronomy and Astrophysics, 37(2):183-187, 1974.
2. Thomas E. Anderson, Brian N. Bershad, Edward D. Lazowska, and Henry M. Levy. Scheduler activations: effective kernel support for the user-level management of parallelism. In Proceedings of the 13th ACM Symposium on Operating Systems Principle, pages 95-109, October 1991.
3. Hesheng Bao, Jacobo Bielak, Omar Ghattas, Loukas F. Kallivokas, David R. O'Hallaron, Jonathan R. Shewchuk, and Jifeng Xu. Large-scale Simulation of Elastic Wave Propagation in Heterogeneous Media on Parallel Computers. Computer Methods in Applied Mechanics and Engineering, 152(1-2):85-102, January 1998.
4. Hesheng Bao, Jacobo Bielak, Omar Ghattas, David R. O'Hallaron, Loukas F. Kallivokas, Jonathan Richard Shewchuk, and Jifeng Xu. Earthquake Ground Motion Modeling on Parallel Computers. In Supercomputing '96, Pittsburgh, Pennsylvania, November 1996.
5. J. E. Barnes and P. Hut. A hierarchical O(N log N) force calculation algorithm. Nature, 324 (4):446-449, December 1986.
6. Frank Bellosa and Martin Steckermeier. The performance implications of locality information usage in shared-memory multiprocessors. Journal of Parallel and Distributed Computing, 37 (1):113-121, August 1996.
7. B. N. Bershad, E. Lazowska, and H. Levy. PRESTO: A System for Object-oriented Parallel Programming. Software - Practice and Experience, 18(8):713-732, August 1988.
8. Guy Blelloch and Girija Narlikar. A practical comparison of n-body algorithms. In Parallel Algorithms, Series in Discrete Mathematics and Theoretical Computer Science. American Mathematical Society, 1997.
9. Guy E. Blelloch, Phillip B. Gibbons, and Yossi Matias. Provably efficient scheduling for languages with fine-grained parallelism. In Proceedings of the 7th Annual ACM Symposium on Parallel Algorithms and Architectures, pages 1-12, Santa Barbara, California, July 17-19, 1995. ACM SIGACT/SIGARCH and EATCS.
10. R. D. Blumofe and D. Papadopoulos. The performance of work stealing in multiprogrammed environments. Technical report TR-98-13, University of Texas at Austin May 1998.
11. Robert D. Blumofe, Christopher F. Joerg, Bradley C. Kuszmaul, Charles E. Leiserson, Keith H. Randall, and Yuli Zhou. Cilk: An efficient multithreaded runtime system. Journal of Parallel and Distributed Computing, 37(1):55-69, August 1996.
12. F. W. Burton. Storage management in virtual tree machines. IEEE Trans. on Computers, 37 (3):321-328, 1988.
13. F. W. Burton and D. J. Simpson. Space efficient execution of deterministic parallel programs. Manuscript, December 1994.
14. Martin C. Carlisle, Anne Rogers, John H. Reppy, and Laurie J. Hendren. Early experiences with Olden. In Uptal Banerjee, David Gelernter, Alex Nicolau, and David Padua, editors, Proceedings of the 6th International Workshop on Languages and Compilers for Parallel Computing, Lecture Notes in Computer Science, pages 1-20, Portland, Oregon, August 12-14, 1993. Intel Corp. and the Portland Group, Inc., Springer-Verlag.
15. Rohit Chandra, Anoop Gupta, and John L. Hennessy. Data locality and load balancing in COOL. In Proceedings of the Fourth ACM SIGPLAN Symposium on Principles & Practice of Parallel Programming, pages 239-259, May 1993.
16. Cheng Che Chen, Jaswinder Pal Singh, and Russ B. Altman. Parallel hierarchical molecular structure estimation. In Supercomputing '96 Conference Proceedings: November 17-22, Pittsburgh, PA, 1996.
17. J. W. Cooley and J. W Tukey. An algorithm for the machine computation of complex fourier series. Mathematics of Computation, 19:297-301, Apr. 1965.
18. Digital Equipment Corporation. Guide to decthreads, December 1997. available at http://www.unix.digital.com/faqs/publications/pub_page/V40D_DOCS.HTM.
19. D. E. Culler and G. Arvind. Resource requirements of dataflow programs. In H. J. Siegel, editor, Proceedings of the 15th Annual International Symposium on Computer Architecture, pages 141-151, Honolulu, Hawaii, May-June 1988. IEEE Computer Society Press.
20. Jeremy D. Frens and David S. Wise. Auto-blocking matrix-multiplication or tracking BLAS3 performance from source code. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice od Parallel Programming (PPOPP), pages 206-216, 1997.
21. Matteo Frigo and Steven G. Johnson. The fastest fourier transform in the west. Technical Report MIT-LCS-TR-728, Massachusetts Institute of Technology, September 1997.
22. Seth C. Goldstein, Klaus E. Schauser, and David E. Culler. Enabling primitives for compiling parallel languages. In Third Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers, May 1995.
23. L. Greengard. The rapid evaluation of potential fields in particle systems. The MIT Press, 1987.
24. Dirk Grunwald and Richard Neves. Whole-Program Optimization for Time and Space Efficient Threads. In Proceedings of Seventh International Conference on Architectural Support for Programming Languages and Operating Systems, October 1996.
25. Michael Halbherr, Yuli Zhou, and Chris F. Joerg. Parallel programming based on continuation-passing thread. In Proceedings of the 2nd International Workshop on Massive Parallelism: Hardware, Software and Applications, Capri, Italy, October 1994.
26. IEEE. Information Technology-Portable Operating System Interface (POSIX®)-Part 1: System Application: Program Interface (API) [C Language]. IEEE/ANSI Std 1003.1, 1996 Edition.
27. Suresh Jagannathan and Jim Philbin. A customizable substrate for concurrent languages. In Proceedings of the ACM Symposium on Programming Language Design and Implementation, 1992.
28. David K. Lowenthal, Vincent W. Freeh, and Gregory R. Andrews. Efficient support for fine-grain parallelism on shared memory machines. Technical Report TR 96-1, University of Arizona, January 1996.
29. Evangelos P. Markatos and Thomas L. Blanc. Load balancing vs. locality management in shared-memory multiprocessor. In Proceedings of the 1992 International Conference on Parallel Processing, volume I, Architecture, pages I:258-267, Boca Raton, Florida, August 1992.
30. Brian D. Marsh, Michael L. Scott, Thomas J. LeBlanc, and Evangelos P. Markatos. First-class user-level threads. In Proceedings of the 13th ACM Symposium on Operating Systems Principle, pages 110-121, Pacific Grove, CA, October 1991.
31. T. Miyazaki, C. Sakamoto, M. Kuwayama, L. Saisho, and A. Fukuda. Parallel Pthread library (PPL): user-level thread library with parallelism and portability. In Proceedings of Eighteenth Annual International Computer Software and Applications Conference (COMPSAC 94), pages 301-306, November 1994.
32. Eric Mohr, David Kranz, and Robert Halstead. Lazy task creation: A technique for increasing the granularity of parallel programs. IEEE Transactions on Parallel and Distributed Systems, 1990.
33. Girija J. Narlikar and Guy E. Blelloch. A framework for space and time efficient scheduling of parallelism. Technical Report CMU-CS-96-197, Computer Science Department, Carnegie Mellon University, 1996.
34. Girija J. Narlikar and Guy E. Blelloch. Space-efficient implementation of nested parallelism. In Proceedings of the Sixth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pages 25-36, June 1997.
35. Girija J. Narlikar and Guy E. Blelloch. Pthreads for dynamic parallelism. Technical Report CMU-CS-98-114, Computer Science Department, Carnegie Mellon University, April 1998.
36. Rishiyur S. Nikhil. Cid: A parallel, "shared-memory" C for distributed-memory machines. In Keshav Pingali, Uptal Banerjee, David Gelernter, Alex Nicolau, and David Padua, editors, Proceedings of the 7th International Workshop on Languages and Compilers for Parallel Computing, Lecture Notes in Computer Science, pages 376-390, Ithaca, New York, August 8-10, 1994. Springer-Verlag.
37. D. O'Hallaron. Spark98: Sparse matrix kernels for shared memory and message passing systems. Technical Report CMU-CS-97-178, School of Computer Science, Carnegie Mellon University, October 1997.
38. D. W. Palmer, J. F. Prins, S. Chatterjee, and R. E. Faith. Piecewise execution of nested data-parallel programs. Lecture Notes in Computer Science, 1033, 1996.
39. James Philbin, Jan Edler, Otto J. Anshus, and Craig C. Douglas. Thread scheduling for cache locality. In Seventh International Conference on Architectural Support for Programming Languages and Operating Systems, pages 60-71, Cambridge, Massachusetts, 1-5 October 1996. ACM Press.
40. M. L. Powell, Steve R. Kleiman, Steve Barton, Devang Shah, Dan Stein, and Mary Weeks. SunOS multi-thread architecture. In Proceedings of the Winter 1991 USENIX Technical Conference and Exhibition, pages 65-80, Dallas, TX, USA, January 1991.
41. J. R. Quinlan. Induction of decision trees. Machine learning, 1(1):81-106, 1986.
42. J. R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA, 1993.
43. Jr. R. H. Halstead. Multilisp: A language for concurrent symbolic computation. ACM Trans. on Programming Languages and Systems, 7(4):501-538, 1985.
44. L. Rudolph, M. Slivkin-Allalouf, and E. Upfal. A simple load balancing scheme for task allocation in parallel machines. In ACM-SIGACT; ACM-SIGARCH, editor, Proceedings of the 3rd Annual ACM Symposium on Parallel Algorithms and Architectures, pages 237-245, Hilton Head, SC, July 1991. ACM Press.
45. C. A. Ruggiero and J. Sargeant. Control of parallelism in the manchester dataflow machine. In G. Kahn, editor, Functional Programming Languages and Computer Architecture, pages 1-16. Springer-Verlag, Berlin, DE, 1987.
46. Jaswinder Pal Singh, Anoop Gupta, and Marc Levoy. Parallel visualization algorithms: Performance and architectural implications. Computer, 27(7):45-55, July 1994.
47. Jaswinder Pal Singh, Chris Holt, Takashi Totsuka, Anoop Gupta, and John Hennessy. Load balancing and data locality in adaptive hierarchical N-body methods: Barnes-Hut, fast multipole, and radiosity. Journal of Parallel and Distributed Computing, 27(2):118-141, June 1995.
48. E. G. Sirer, P. Pardyak, and B. Bershad. Strands: An efficient and extensible thread management architecture. Technical Report TR-97-09-01, University of Washington, Department of Computer Science and Engineering, September 1997.
49. Deepak Srivastava and Stephen T. Barnard. Molecular dynamics simulation of large-scale carbon nanotubes on a shared-memory architecture. In Proceedings of SC'97: High Performance Networking and Computing, San Jose, California, November 1997.
50. Dan Stein and Devang Shah. Implementing lightweight threads. In Proceedings of the Summer 1992 USENIX Technical Conference and Exhibition, pages 1-10, San Antonio, TX, 1992. USENIX.
51. Andy Tucker and Anoop Gupta. Process control and scheduling issues for multiprogrammed shared-memory multiprocessors. Operating Systems Review, 23(5):159-66, 1989.
52. M. T. Vandevoorde and E. S. Roberts. WorkCrews: an abstraction for controlling parallelism. International Journal of Parallel Programming, 17(4):347-366, August 1988.
53. S. C. Woo, M. Ohara, E. Torrie, J. P. Singh, and A. Gupta. The SPLASH-2 programs: Characteriation and methodological considerations. In Proceedings of the 22nd Annual International Symposium on Computer Architecture, pages 24-37, New York, June 22-24 1995. ACM Press.
54. Bwolen Yang and David R. O'Hallaron. Parallel breadth-first BDD construction. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice od Parallel Programming (PPOPP), pages 145-156, June18-21 1997.
55. M. J. Zaki, M. Ogihara, S. Parthasarathy, and W. Li. Parallel data mining for association rules on shared-memory multi-processors. In CD-ROM Proceedings of Supercomputing'96, Pittsburgh, PA, November 1996. IEEE.
56. Matteo Frigo, Charles E. Leiserson, and Keith H. Randall. The Implementation of the Cilk-5 Multithreaded Language. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), pages 212-223, June 17-19, 1998.
57. A.G. Hauptmann, R.E. Jones, K. Seymore, M.A. Siegler, S.T. Slattery, and M.J. Witbrock. Experiments in Information Retrieval from Spoken Documents. In BNTUW-98 Proceedings of the DARPA Workshop on Broadcast News Understanding Systems, Lansdowne, VA, February, 1998