Latency hiding and performance tuning with graph-based execution

Proceedings - 2011 1st Workshop on Data-Flow Execution Models for Extreme Scale Computing, DFM 2011

Volumn , Issue , 2011, Pages 28-37

  Cicotti, Pietro ^a   Baden, Scott B ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING; DATA TRANSFER; DYNAMIC PROGRAMMING; GRAPHIC METHODS; LINEAR ALGEBRA; MATLAB; SCHEDULING;

BULK SYNCHRONOUS PARALLEL MODEL; BULK SYNCHRONOUS PARALLELISM; COMMUNICATION DELAYS; COMMUNICATION LATENCY; DEGREE OF PARALLELISM; DISTRIBUTED MEMORY MACHINES; PROGRAMMING METHODOLOGY; SCIENTIFIC COMPUTATION;

DATA FLOW ANALYSIS;

EID: 84860523127     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DFM.2011.15     Document Type: Conference Paper

References (28)

1. "Top 500," http://top500.org.
2. Patterson, David A., "Latency lags bandwith," Commun. ACM, vol. 47, October 2004.
3. Leslie G. Valiant, "A Bridging Model for Parallel Computation," CACM, vol. 33, no. 8, Aug 1990.
4. A. Krishnamurthy and D. E. Culler and A. Dusseau and S. C. Goldstein and S. Lumetta and T. von Eicken and K. Yelick, "Parallel programming in Split-C," in Supercomputing '93: Proceedings of the 1993 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM Press, 1993.
5. Scott B. Baden and Stephen J. Fink, "Communication overlap in multi-tier parallel algorithms," in Proc. of SC '98, Orlando, Florida, November 1998.
6. Costin Iancu and Parry Husbands and Paul Hargrove, "HUNT-ing the Overlap," in PACT '05: Proceedings of the 14th International Conference on Parallel Architectures and Compilation Techniques. Washington, DC, USA: IEEE Computer Society, 2005.
7. Anthony Danalis and Ki-Yong Kim and Lori Pollock and Martin Swany, "Transformations to Parallel Codes for Communication-Computation Overlap," in SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2005.
8. Husbands, Parry and Yelick, Katherine, "Multi-threading and one-sided communication in parallel LU factorization," in Proceedings of the 2007 ACM/IEEE conference on Supercomputing, ser. SC '07. New York, NY, USA: ACM, 2007.
9. R. D. Blumofe and C. F. Joerg and B. C. Kuszmaul and C. E. Leiserson and K. H Randall and Y. Zhou, "Cilk: An Efficient Multithreaded Runtime System," Massachusetts Institute of Technology, Cambridge, MA, USA, Tech. Rep., 1996.
10. Planas, Judit and Badia, Rosa M. and Ayguadé, Eduard and Labarta, Jesus, "Hierarchical Task-Based Programming With StarSs," Int. J. High Perform. Comput. Appl., vol. 23, August 2009.
11. Kalé, L.V. and Krishnan, S., "CHARM++: A Portable Concurrent Object Oriented System Based on C++," in Proceedings of OOPSLA'93, Paepcke, A., Ed. ACM Press, September 1993.
12. Laxmikant V. Kalé, "The Virtualization Model of Parallel Programming : Runtime Optimizations and the State of Art," in LACSI 2002, Albuquerque, October 2002.
13. Pietro Cicotti and Scott B. Baden, "Short Paper: Asynchronous programming with Tarragon," High Performance Distributed Computing, 2006 15th IEEE International Symposium on, 2006.
14. Colella, Phil, "Designing Software Requirements for Scientific Computing," 2004.
15. Asanovic, Krste et. al., "The Landscape of Parallel Computing Research: A View from Berkeley," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2006-183, Dec 2006. [Online]. Available: {http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.html}
16. Jack B. Dennis, "Data Flow Supercomputers," Computer, vol. 13, no. 11, Nov 1980.
17. Jack B. Dennis and David P. Misunas, "A preliminary architecture for a basic data-flow processor," in ISCA '75: Proceedings of the 2nd annual symposium on Computer architecture. New York, NY, USA: ACM Press, 1975.
18. J. R Gurd and C. C Kirkham and I. Watson, "The Manchester prototype dataflow computer," Commun. ACM, vol. 28, no. 1, 1985.
19. Arvind, K. and Nikhil, Rishiyur S., "Executing a Program on the MIT Tagged-Token Dataflow Architecture," IEEE Trans. Comput., vol. 39, March 1990. [Online]. Available: {http://dx.doi.org/10.1109/12.48862}
20. Thorsten von Eicken and David E. Culler and Seth Copen Goldstein and Klaus Erik Schauser, "Active messages: a mechanism for integrated communication and computation," in ISCA '92: Proceedings of the 19th annual international symposium on Computer architecture. New York, NY, USA: ACM Press, 1992.
21. Aluru, S., Ed., Handbook of Computational Molecular Biology, ser. Computer and Information Science. Chapman & Hall/CRC, 2005, ch. 1.
22. Xiaoye S. Li and James W. Demmel, "SuperLU-DIST: A Scalable Distributed-Memory Sparse Direct Solver for Unsymmetric Linear Systems," ACM Trans. Mathematical Software, vol. 29, no. 2, June 2003.
23. Li, Xiaoye S. and Demmel, James W., "Making sparse Gaussian elimination scalable by static pivoting," in Proceedings of the 1998 ACM/IEEE conference on Supercomputing (CDROM), ser. Supercomputing '98. Washington, DC, USA: IEEE Computer Society, 1998.
24. Duff, I. S. and Grimes, Roger G. and Lewis, John G., "Sparse matrix test problems," ACM Trans. Math. Softw., vol. 15, no. 1, 1989.
25. Timothy A. Davis, "university of Florida Sparse Matrix Collection," 1994.
26. "Center for Extended MHD Modeling (CEMM)," http://w3.pppl.gov/ cemm.
27. "Community Petascale Project for Accelerator Science and Simulation (COMPASS)," https://compass.fnal.gov/.
28. Quinlan, Daniel J. and Miller, Brian and Philip, Bobby and Schordan, Markus, "Treating a User-Defined Parallel Library as a Domain-Specific Language," in Proceedings of the 16th International Parallel and Distributed Processing Symposium, ser. IPDPS '02. Washington, DC, USA: IEEE Computer Society, 2002.