Methods of inference and learning for performance modeling of parallel applications

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2007, Pages 249-258

  Lee, Benjamin C ^a   Brooks, David M ^a   De Supinski, Bronis R ^b   Schulz, Martin ^b   Singh, Karan ^c   McKee, Sally A ^c  

^a HARVARD UNIVERSITY   (United States)

^b LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^c Department of Obstetrics Gynecology

Author keywords

Neural networks; Numerical methods; Performance prediction; Regression; Statistics

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; MATHEMATICAL MODELS; NEURAL NETWORKS; NUMERICAL METHODS; REGRESSION ANALYSIS; STATISTICS;

ALGORITHMIC COMPLEXITY; PERFORMANCE PREDICTION;

LEARNING SYSTEMS;

EID: 34748909426     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1229428.1229479     Document Type: Conference Paper

References (20)

1. A.Petitet, R.Whaley, J.Dongarra, and A.Cleary. HPL - A portable implementation of the high-performance UNPACK benchmark for distributed-memory computers, www.netlib.org/benchmark/hpl.
2. P. N. Brown, R. D. Falgout, and J. E. Jones. Semicoarsening multigrid on distributed memory machines. SIAM Journal on Scientific Computing, 21(5), 2000.
3. L. Carrington, A. Snavely, X. Gao, and N. Wolter. A performance prediction framework for scientific applications. In International Conference on Computational Science Workshop on Performance Modeling and Analysis (PMA03), June 2003.
4. L. Carrington, N. Wolter, A. Snavely, and C. Lee. Applying an automatic framework to produce accurate blind performance predictions of full-scale hpc applications. In Department of Defense Users Group Conference, June 2004.
5. R. Caruana, S. Lawrence, and C. Giles. Overfitting in neural nets: backpropagation, conjugate gradient, and early stopping. In Neural Information Processing Systems (NIPS), November 2002.
6. R. Falgout and U. Yang. Hypre: A library of high performance preconditioners. Springer LNCS, 2331, 2002.
7. F. Harrell. Regression modeling strategies. Springer, 2001.
8. E. Ìpek, B. de Supinski, M. Schulz, and S. McKee. An approach to performance prediction for parallel applications. Euro-Par, Springer LNCS, 3648, 2005.
9. E. Ìpek, S. McKee, B. de Supinski, M. Schulz, and R. Caruana. Efficiently exploring architectural design spaces via predictive modeling. In Architectural Support for Programming Languages and Operating Systems (ASPLOS XII), October 2006.
10. P. Joseph, K. Vaswani, and M. J. Thazhuthaveetil. Construction and use of linear regression models for processor performance analysis. In International Symposium on High Performance Computer Architecture (HPCA-12), February 2006.
11. D. Kerbyson, H. Alme, A. Hoisie, F. Petrini, H. Wasserman, and M. Gittings. Predictive performance and scalability modeling of a large-scale application. In IEEE/ACM Supercomputing, November 2001.
12. B. Lee and D. Brooks. Accurate and efficient regression modeling for microarchitectural performance and power prediction. In Architectural Support for Programming Languages and Operating Systems (ASPLOS XII), October 2006.
13. B. Lee and D. Brooks. Illustrative design space studies with microarchitectural regression models. In International Symposium on High-Performance Computer Architecture (HPCA-13), February 2007.
14. G. Marin and J. Mellor-Crummey. Cross-architecture performance predictions for scientific applications using parameterized models. In International Conference on Measurement and Modeling of Computer Systems (Sigmetrics), June 2004.
15. T.Mitchell. Machine Learning. WCB/McGraw Hill, 1997.
16. M. Riedmiller and H. Braun. A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In IEEE International Conference on Neural Networks, May 1993.
17. C.Stone. Comment: Generalized additive models. Statistical Science, 1, 1986.
18. T. Yang, X. Ma, and F. Mueller. Cross-platform performance prediction of parallel applications using partial execution. In IEEE/ACM Supemomputing, November 2005.
19. J. Yi, D. Lilja, and D. Hawkins. Improving computer architecture simulation methodology by adding statistical rigor. IEEE Computer, 54(11), 2005.
20. A. Zell and et. al. Snns: Stuttgart neural network simulator, user manual, version 4.2. In User Manual, Version 4.2, University of Stuttgart.