Semi-automatic extraction and exploitation of hierarchical pipeline parallelism using profiling information

Parallel Architectures and Compilation Techniques - Conference Proceedings, PACT

Volumn , Issue , 2010, Pages 377-388

  Tournavitis, Georgios ^a   Franke, Björn ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

parallelization; pipeline parallelism; program dependence graph; streaming applications

Indexed keywords

APPLICATION PROGRAMS; EMBEDDED SYSTEMS; EXTRACTION; LEGACY SYSTEMS; MULTICORE PROGRAMMING; PARALLEL ARCHITECTURES; PARALLEL PROGRAMMING; PERSONAL COMPUTERS;

AUTOMATIC PARALLELIZATION; EMBEDDED COMPUTING SYSTEM; HIGH PERFORMANCE COMPUTING; PARALLEL PROGRAMMING MODEL; PARALLELIZATIONS; PIPELINE PARALLELISMS; PROGRAM DEPENDENCE GRAPH; STREAMING APPLICATIONS;

PIPELINES;

EID: 78149252926     PISSN: 1089795X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1854273.1854321     Document Type: Conference Paper

References (33)

1. J. Allen and K. Kennedy. Optimizing compilers for modern architectures: a dependence-based approach. Morgan Kaufmann Publishers Inc. San Francisco, CA, USA, 2001.
2. T. Brandes, S. Chaumette, M. C. Counilh, J. Roman, A. Darte, F. Desprez, and J. C. Mignot. Hpfit: A set of integrated tools for the parallelization of applications using high performance fortran. part i: Hpfit and the transtool environment. Parallel Computing, 23(1-2):71-87, 1997. Environment and tools for parallel scientific computing.
3. M. G. Burke and R. K. Cytron. Interprocedural dependence analysis and parallelization. SIGPLAN Not., 39(4):139-154, 2004.
4. J. Ceng, J. Castrillon, W. Sheng, H. Scharwachter, R. Leupers, G. Ascheid, H. Meyr, T. Isshiki, and H. Kunieda. MAPS: an integrated framework for MPSoC application parallelization. In DAC 2008: Proceedings of the 45th Annual Design Automation Conference. ACM/IEEE, pages 754-759, 2008.
5. S. C. Chan, G. R. Gao, B. Chapman, T. Linthicum, and A. Dasgupta. Open64 compiler infrastructure for emerging multicore/manycore architecture all symposium tutorial. In IPDPS 2008: 22nd IEEE International Symposium on Parallel and Distributed Processing, Miami, FL, USA, 2008.
6. J. Ferrante, K. J. Ottenstein, and J. D. Warren. The program dependence graph and its use in optimization. ACM Trans. Program. Lang. Syst., 9(3):319-349, 1987.
7. M. Frigo, C. E. Leiserson, and K. H. Randall. The implementation of the Cilk-5 multithreaded language. volume 33, pages 212-223, New York, NY, USA, 1998. ACM.
8. M. I. Gordon, W. Thies, M. Karczmarek, J. Lin, A. S. Meli, A. A. Lamb, C. Leger, J. Wong, H. Hoffmann, D. Maze, and S. Amarasinghe. A stream compiler for communication-exposed architectures. In ASPLOS-X: Proceedings of the 10th international conference on Architectural support for programming languages and operating systems, pages 291-303, New York, NY, USA, 2002. ACM.
9. J. Guo, G. Bikshandi, D. Hoeflinger, G. Almasi, B. Fraguela, M. Garzaran, D. Padua, and C. von Praun. Hierarchically tiled arrays for parallelism and locality. volume 0, page 316, Los Alamitos, CA, USA, 2006. IEEE Computer Society.
10. M. W. Hall, J. M. Anderson, S. P. Amarasinghe, B. R. Murphy, S.-W. Liao, E. Bugnion, and M. S. Lam. Maximizing multiprocessor performance with the SUIF compiler. Computer, 29(12):84-89, 1996.
11. P. Husbands, C. Iancu, and K. Yelick. A performance analysis of the berkeley upc compiler. In ICS '03: Proceedings of the 17th annual international conference on Supercomputing, pages 63-73, New York, NY, USA, 2003. ACM.
12. F. Irigoin, P. Jouvelot, and R. Triolet. Semantical interprocedural parallelization: an overview of the PIPS project. In ICS '91: Proceedings of the 5th international conference on Supercomputing, pages 244-251, New York, NY, USA, 1991. ACM.
13. M. Ishihara, H. Honda, and M. Sato. Development and implementation of an interactive parallelization assistance tool for OpenMP: iPat/OMP. IEICE - Trans. Inf. Syst., E89-D(2):399-407, 2006.
14. I. Karkowski and H. Corporaal. Exploiting fine- and coarse-grain parallelism in embedded programs. In PACT '98: Proceedings of the 1998 International Conference on Parallel Architectures and Compilation Techniques, pages 60-67, 1998.
15. I. Karkowski and H. Corporaal. Overcoming the limitations of the traditional loop parallelization. High-Performance Computing and Networking, Jan 1998.
16. K. Kennedy, K. S. McKinley, and C. W. Tseng. Interactive parallel programming using the ParaScope editor. IEEE Trans. Parallel Distrib. Syst., 2(3):329-341, 1991.
17. M. Kulkarni, K. Pingali, B. Walter, G. Ramanarayanan, K. Bala, and L. Chew. Optimistic parallelism requires abstractions. In PLDI '07: Proceedings of the 2007 ACM SIGPLAN conference on Programming language design and implementation, pages 211-222, New York, USA, 2007. ACM.
18. L. Lamport. The parallel execution of do loops. Commun. ACM, 17(2):83-93, 1974.
19. A. W. Lim and M. S. Lam. Maximizing parallelism and minimizing synchronization with affine transforms. In POPL '97: Proceedings of the 24th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, pages 201-214, New York, NY, USA, 1997. ACM.
20. G. Ottoni, R. Rangan, A. Stoler, and D. I. August. Automatic thread extraction with decoupled software pipelining. In MICRO-38: Proceedings of the 38th IEEE/ACM International Symposium on Microarchitectureon, 0:105-118, 2005.
21. D. A. Padua, R. Eigenmann, J. Hoeflinger, P. Petersen, P. Tu, S. Weatherford, and K. Faigin. Polaris: A new-generation parallelizing compiler for mpps. Technical report, In CSRD Rept. No. 1306. Univ. of Illinois at Urbana-Champaign, 1993.
22. H. Park, Y. Park, and S. Mahlke. Polymorphic pipeline array: a flexible multicore accelerator with virtualized execution for mobile multimedia applications. In MICRO-42: Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture, pages 370-380, New York, NY, USA, 2009. ACM.
23. A. Raman, H. Kim, T. R. Mason, T. B. Jablin, and D. I. August. Speculative parallelization using software multi-threaded transactions. In ASPLOS XV: Proceedings of the Fifteenth International Conference on Architectural Support for Programming Languages and Operating Systems , March 2010.
24. E. Raman, G. Ottoni, A. Raman, M. J. Bridges, and D. I. August. Parallel-stage decoupled software pipelining. In CGO '08: Proceedings of the 6th annual IEEE/ACM international symposium on Code generation and optimization, pages 114-123, New York, NY, USA, 2008. ACM.
25. L. Rauchwerger, F. Arzu, and K. Ouchi. Standard templates adaptive parallel library. In 4th International Workshop on Languages, Compilers and Run-Time Systems for Scalable Computers (LCR), pages 402-409, 1998.
26. S. Rul, H. Vandierendonck, and K. Bosschere. Extracting coarse-grain parallelism in general-purpose programs. In PPoPP '08: Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming, Feb 2008.
27. V. A. Saraswat, V. Sarkar, and C. von Praun. X10: concurrent programming for modern architectures. In PPoPP '07: Proceedings of the 12th ACM SIGPLAN symposium on Principles and practice of parallel programming, pages 271-271, New York, NY, USA, 2007. ACM.
28. W. Thies, V. Chandrasekhar, and S. Amarasinghe. A practical approach to exploiting coarse-grained pipeline parallelism in c programs. In MICRO 40: Proceedings of the 40th Annual IEEE/ACM International Symposium on Microarchitecture, pages 356-369, Washington, DC, USA, 2007. IEEE Computer Society.
29. W. Thies, M. Karczmarek, and S. Amarasinghe. Streamit: A language for streaming applications. Lecture Notes in Computer Science, 2304:179-??, 2002.
30. C. Tian, M. Feng, V. Nagarajan, and R. Gupta. Copy or discard execution model for speculative parallelization on multicores. In MICRO 41: Proceedings of the 41st annual IEEE/ACM International Symposium on Microarchitecture, pages 330-341, Washington, DC, USA, 2008. IEEE Computer Society.
31. G. Tournavitis, Z. Wang, B. Franke, and M. F. O'Boyle. Towards a holistic approach to auto-parallelization: integrating profile-driven parallelism detection and machine-learning based mapping. In PLDI '09: Proceedings of the 2009 ACM SIGPLAN conference on Programming language design and implementation, pages 177-187, Dublin, Ireland, 2009. ACM.
32. N. Vachharajani. Intelligent Speculation for Pipelined Multithreading. PhD thesis, Princeton University, 2008.
33. N. Vachharajani, R. Rangan, E. Raman, M. J. Bridges, G. Ottoni, and D. I. August. Speculative decoupled software pipelining. In PACT '07: Proceedings of the 16th International Conference on Parallel Architecture and Compilation Techniques, pages 49-59, Washington, DC, USA, 2007. IEEE Computer Society.