Eliminating synchronization overhead in automatically parallelized programs using dynamic feedback

ACM Transactions on Computer Systems

Volumn 17, Issue 2, 1999, Pages 89-132

  Diniz, Pedro C ^a   Rinard, Martin C ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

C.4 Computer Systems Organization : Performance of Systems Measurement techniques; D.1.3 Programming Techniques : Concurrent Programming; D.1.5 Programming Techniques : Object oriented Programming

Indexed keywords

EID: 0012711061     PISSN: 07342071     EISSN: None     Source Type: Journal    
DOI: 10.1145/312203.312210     Document Type: Article

References (51)

1. AMARASINGHE, S. P. AND LAM, M. S. 1993. Communication optimization and code generation for distributed memory machines. SIGPLAN Not. 28, 6 (June 1993), 126-138.
2. ANDERSON, J. M. AND LAM, M. S. 1993. Global optimizations for parallelism and locality on scalable parallel machines. In Proceedings of the ACM SIGPLAN '93 Conference on Program Language Design and Implementation. ACM Press, New York, NY, 112-125.
3. ANDERSON, J. M., BERC, L. M., DEAN, J., GHEMAWAT, S., HENZINGER, M. R., LEUNG, S.-T. A., SITES, R. L., VANDEVOORDE, M. T., WALDSPURGER, C. A., AND WEIHL, W. E. 1997. Continuous profiling: where have all the cycles gone?. ACM Trans. Comput. Syst. 15, 4, 357-390.
4. AUSLANDER, J., PHILIPOSE, M., CHAMBERS, C., EGGERS, S. J., AND BERSHAD, B. N. 1996. Fast, effective dynamic compilation. SIGPLAN Not. 31, 5, 149-159.
5. BARNES, J. AND HUT, P. 1986. A hierarchical O(NlogN) force calculation algorithm. Nature 324, 4, 446-449.
6. BREWER, E. A. 1995. High-level optimization via automated statistical modeling. SIGPLAN Not. 30, 8 (Aug. 1995), 80-91.
7. CHAMBERS, C. AND UNGAR, D. 1989. Customization: Optimizing compiler technology for SELF, a dynamically-typed object-oriented programming language. SIGPLAN Not. 24, 7 (July 1989), 146-160.
8. CHANG, P. P., MAHLKE, S. A., CHEN, W. Y., AND HWU, W.-M. W. 1992. Profile-guided automatic inline expansion for C programs. Softw. Pract. Exper. 22, 5 (May 1992), 349-369.
9. CHEN, W. Y., MAHLKE, S. A., WARTER, N. J., ANIK, S., AND HWU, W.-M. W. 1994. Profile-assisted instruction scheduling. Int. J. Parallel Program. 22, 2 (Apr. 1994), 151-181.
10. CHILIMBI, T. AND LARUS, J. 1994. Cachier: A tool for automatically inserting cico annotations. In Proceedings of the 1994 International Conference on Parallel Processing. CRC Press, Inc., Boca Raton, FL, 89-98.
11. COX, A. AND FOWLER, R. 1993. Adaptive cache coherency for detecting migratory shared data. In Proceedings of the 20th Annual International Symposium on Computer Architecture (ISCA '94, San Diego, CA, May 16-19), A. J. Smith, Ed. ACM Press, New York, NY, 98-108.
12. DINIZ, P. AND RINARD, M. 1997. Synchronization transformations for parallel computing. In Proceedings of the 24th ACM SIGPLAN-SIGACT symposium on Principles of programming languages (POPL '97, Paris, France, Jan. 15-17, 1997), P. Lee, Ed. ACM Press, New York, NY, 187-200.
13. DINIZ, P. AND RINARD, M. 1998. Lock coarsening: Eliminating lock overhead in automatically parallelized object-based programs. J. Parallel Distrib. Comput. 49, 2 (Mar.), 218-244.
14. DUBNICKI, C. AND LEBLANC, T. J. 1992. Adjustable block size coherent caches. SIGARCH Comput. Arch. News 20, 2 (May 1992), 170-180.
15. ENGLER, D. R. 1996. VCODE: a retargetable, extensible, very fast dynamic code generation system. SIGPLAN Not. 31, 5, 160-170.
16. FALSAFI, B. AND WOOD, D. 1997. Reactive-NUMA: A design for unifying S-COMA and CC-NUMA. In Proceedings of the 24th International Symposium on Computer Architecture. ACM Press, New York, NY, 229-240.
17. FALSAFI, B., LEBECK, A. R., REINHARDT, S. K., SCHOINAS, I., HILL, M. D., LARUS, J. R., ROGERS, A., AND WOOD, D. A. 1994. Application-specific protocols for user-level shared memory. In Proceedings of the Conference on Supercomputing '94 (Washington, DC, Nov. 14-18, 1994), G. M. Johnson, Ed. IEEE Computer Society Press, Los Alamitos, CA, 380-389.
18. FERNANDEZ, M. 1995. Simple and effective link-time optimization of Modula-3 programs. In Proceedings of the ACM SIGPLAN '95 Conference on Program Language Design and Implementation. ACM Press, New York, NY, 103-115.
19. FISHER, J. 1981. Trace scheduling: A technique for global microcode compaction. IEEE Trans. Comput. C-30, 7 (July), 478-490.
20. FOX, A., GRIBBLE, S. D., BREWER, E. A., AND AMIR, E. 1996. Adapting to network and client variability via on-demand dynamic distillation. ACM SIGOPS Oper. Syst. Rev. 30, 5, 160-170.
21. FREUDENBERGER, S., SCHWARTZ, J., AND SHARIR, M. 1983. Experience with the SETL optimizer. ACM Trans. Program. Lang. Syst. 5, 1 (Jan. 1983), 26-45.
22. GRAHAM, S. L., KESSLER, P. B., AND MCKUSICK, M. K. 1982. Gprof: A call graph execution profiler. In Proceedings of the SIGPLAN '82 Symposium on Compiler Construction (June). ACM, New York, NY, 120-126.
23. GROVE, D., DEAN, J., GARRETT, C., AND CHAMBERS, C. 1995. Profile-guided receiver class prediction. SIGPLAN Not. 30, 10 (Oct. 17, 1995), 108-123.
24. GUPTA, M. AND BANERJEE, P. 1992. Demonstration of automatic data partitioning techniques for parallelizing compilers on multicomputers. IEEE Trans. Parallel Distrib. Syst. 3, 2, 179-193.
25. HARRIS, J., LAZARATOS, S., AND MICHELENA, R. 1990. Tomographic string inversion. In Proceedings of the 60th Annual International Meeting, Society of Exploration and Geophysics, Extended Abstracts. 82-85.
26. HÖLZLE, U. AND UNGAR, D. 1994. Optimizing dynamically-dispatched calls with run-time type feedback. In Proceedings of the ACM SIGPLAN '94 Conference on Programming Language, Design and Implementation (PLDI '94, Orlando, FL, June 20-24, 1994), V. Sarkar, B. Ryder, and M. L. Soffa, Eds. ACM Press, New York, NY, 326-336.
27. IEEE. 1993. IEEE Standard for Scalable Coherent Interface (SCI). IEEE Standards Office, New York, NY.
28. KEMMERER, R. AND ECKMANN, S. 1985. UNISEX: A UNIx-based symbolic EXecutor for Pascal. Softw. Pract. Exper. 15, 5 (May), 439-458.
29. KENNEDY, K. AND KREMER, U. 1995. Automatic data layout for high performance Fortran. In Proceedings of the 1995 Conference on Supercomputing (CD-ROM) (San Diego, CA, Dec. 3-8, 1995), S. Karin, Ed. ACM Press, New York, NY.
30. KICZALES, G. 1996. Beyond the black box: Open implementation. IEEE Softw. 13, 1 (Jan.), 6-11.
31. KIM, J.-H. AND VAIDYA, N. H. 1996. A cost-comparison approach for adaptive distributed shared memory. In Proceedings of the 1996 ACM International Conference on Supercomputing. ACM Press, New York, NY.
32. KNUTH, D. E. 1971. An empirical study of FORTRAN programs. Softw. Pract. Exper. 1, 105-133.
33. LEE, P. AND LEONE, M. 1996. Optimizing ML with run-time code generation. SIGPLAN Not. 31, 5, 137-148.
34. LENOSKI, D. E. 1992. The design and analysis of DASH: A scalable directory-based multiprocessor. Ph.D. Dissertation. Stanford University, Stanford, CA.
35. LEUNG, S.-T. AND ZAHORJAN, J. 1993. Improving the performance of runtime parallelization. SIGPLAN Not. 28, 7 (July 1993), 83-91.
36. LIM, B.-H. AND AGARWAL, A. 1994. Reactive synchronization algorithms for multiprocessors. In Proceedings 6th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS VI, San Jose, CA, Oct. 4-7, 1994), F. Baskett and D. Clark, Eds. ACM Press, New York, NY, 25-37.
37. MOON, S., HALL, M., AND MURPHY, B. 1998. Predicated array data-flow analysis for run-time parallelization. In Proceedings of the 1998 ACM International Conference on Supercomputing. ACM Press, New York, NY, 204-211.
38. MORRIS, W. G. 1991. CCG: A prototype coagulating code generator. SIGPLAN Not. 26, 6 (June 1991), 45-58.
39. PETTIS, K. AND HANSEN, R. C. 1990. Profile guided code positioning. SIGPLAN Not. 25, 6 (Jun. 1990), 16-27.
40. PLEVYAK, J., ZHANG, X., AND CHIEN, A. A. 1995. Obtaining sequential efficiency for concurrent object-oriented languages. In Papers of the 22nd ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL '95, San Francisco, CA, Jan. 22-25, 1995), R. K. Cytron and P. Lee, Eds. ACM Press, New York, NY, 311-321.
41. POLYCHRONOPOULOS, C. D. AND KUCK, D. J. 1987. Guided self-scheduling: A practical scheduling scheme for parallel supercomputers. IEEE Trans. Comput. C-36, 12 (Dec. 1987), 1425-1439.
42. RAUCHWERGER, L. AND PADUA, D. 1995. The LRPD test: Speculative run-time parallelization of loops with privatization and reduction parallelization. SIGPLAN Not. 30, 6 (June 1995), 218-232.
43. RINARD, M. AND DINIZ, P. 1997. Commutativity analysis: A new analysis technique for parallelizing compilers. ACM Trans. Program. Lang. Syst. 19, 6 (Nov.), 941-992.
44. RINARD, M. C., SCALES, D. J., AND LAM, M. S. 1992. Heterogeneous parallel programming in Jade. In Proceedings of the 1992 Conference on Supercomputing (Supercomputing '92, Minneapolis, MN, Nov. 16-20), R. Werner, Ed. IEEE Computer Society Press, Los Alamitos, CA, 245-256.
45. ROMER, T., LEE, D., BERSHAD, B., AND CHEN, J. 1994. Dynamic page mapping policies for cache conflict resolution on standard hardware. In Proceedings of the 1st USENIX Symposium on Operating Systems Design and Implementation (Monterey, CA, May). USENIX Assoc., Berkeley, CA, 255-266.
46. SAAVEDRA, R. AND PARK, D. 1996. Improving the effectiveness of software prefetching with adaptive execution. In Proceedings of the Parallel Architectures and Compilation Techniques (PACT '96). IEEE Computer Society Press, Los Alamitos, CA.
47. SALTZ, J., BERRYMAN, H., AND WU, J. 1991. Multiprocessors and run-time compilation. In Proceedings of the Conference on Practical Parallel Computing: Achievements, Problems and Prospects (Capri, Italy, June 3-7, 1990), P. Messina and A. Murli, Eds. John Wiley & Sons, Inc., New York, NY, 573-592.
48. SINGH, J. P., WEBER, W.-D., AND GUPTA, A. 1992. SPLASH: Stanford parallel applications for shared-memory. SIGARCH Comput. Arch. News 20, 1 (Mar. 1992), 5-44.
49. SMITH, M. 1991. Tracing with Pixie. Tech. Rep. CSL-TR-91-497. Stanford University, Stanford, CA.
50. WALL, D. W 1986. Global register allocation at link time. SIGPLAN Not. 21, 7 (July 1986), 264-275.
51. ZHANG, X., WANG, Z., GLOY, N., CHEN, J. B., AND SMITH, M. D. 1997. System support for automatic profiling and optimization. ACM SIGOPS Oper. Syst. Rev. 31, 5, 15-26.