ADP: Automated diagnosis of performance pathologies using hardware events

Performance Evaluation Review

Volumn 40, Issue 1 SPEC. ISS., 2012, Pages 283-294

  Yoo, Wucherl ^a   Larson, Kevin ^a   Baugh, Lee ^b   Kim, Sangkyum ^a   Campbell, Roy H ^a  

^a University of Illinois at Urbana Champaign   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

fingerprint; hardware event; machine learning; micro benchmark; performance analysis; resource bottleneck

Indexed keywords

ARCHITECTURAL KNOWLEDGE; AUTOMATED DIAGNOSIS; AUTOMATED SYSTEMS; BENCHMARK SUITES; DECISION-TREE ALGORITHM; FINGERPRINT; HARDWARE RESOURCES; HOT SPOT; MEMORY HIERARCHY; MICRO-BENCHMARK; MODERN ARCHITECTURES; PERFORMANCE ANALYSIS; PERFORMANCE BOTTLENECKS; PERFORMANCE CHARACTERIZATION; PERFORMANCE PROBLEMS; RANDOM FORESTS; RESOURCE BOTTLENECK;

AUTOMATION; COMPUTER SYSTEMS; DECISION TREES; HARDWARE; LEARNING SYSTEMS; SOFTWARE ARCHITECTURE;

BENCHMARKING;

EID: 84864665235     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2254756.2254791     Document Type: Conference Paper

References (45)

1. L. Adhianto, S. Banerjee, M. Fagan, M. Krentel, G. Marin, J. Mellor-Crummey, and N. R. Tallent. Hpctoolkit: tools for performance analysis of optimized parallel programs http://hpctoolkit.org. Concurr. Comput. : Pract. Exper., 22:685-701, April 2010.
2. R. Azimi, M. Stumm, and R. Wisniewski. Online performance analysis by statistical sampling of microprocessor performance counters. In Proc. of International Conference on Supercomputing, pages 101-110. ACM, 2005.
3. R. Bagrodia, R. Meyer, M. Takai, Y. Chen, X. Zeng, J. Martin, and H. Song. Parsec: A parallel simulation environment for complex systems. Computer, 31(10):77-85, 1998.
4. R. Bitirgen, E. Ipek, and J. Martinez. Coordinated management of multiple interacting resources in chip multiprocessors: A machine learning approach. In Proc. of IEEE/ACM International Symposium on Microarchitecture, pages 318-329. IEEE Computer Society, 2008.
5. L. Breiman. Classification and regression trees. Chapman & Hall/CRC, 1984.
6. L. Breiman. Random forests. Machine learning, 45(1):5-32, 2001.
7. S. Browne, J. Dongarra, N. Garner, G. Ho, and P. Mucci. A portable programming interface for performance evaluation on modern processors. International Journal of High Performance Computing Applications, 14(3), 2000.
8. S. Browne, J. Dongarra, N. Garner, K. London, and P. Mucci. A scalable cross-platform infrastructure for application performance tuning using hardware counters. In Proc. of ACM/IEEE Conference on Supercomputing. IEEE Computer Society, 2000.
9. M. Burtscher, B.-D. Kim, J. Diamond, J. McCalpin, L. Koesterke, and J. Browne. Perfexpert: An easy-to-use performance diagnosis tool for hpc applications. In Proc. of International Conference for High Performance Computing, Networking, Storage and Analysis, SC '10, pages 1-11. IEEE Computer Society, 2010.
10. M. Casas, R. M. Badia, and J. Labarta. Automatic phase detection and structure extraction of mpi applications. Int. J. High Perform. Comput. Appl., 24:335-360, August 2010.
11. P. Cheeseman and J. Stutz. Bayesian classification (AutoClass): Theory and results. In Advances in knowledge discovery and data mining. American Association for Artificial Intelligence, 1996.
12. M. Curtis-Maury, F. Blagojevic, C. Antonopoulos, and D. Nikolopoulos. Prediction-based power-performance adaptation of multithreaded scientific codes. IEEE Transactions on Parallel and Distributed Systems, pages 1396-1410, 2008.
13. B. David, M. Geimer, F. Wolf, and L. Arnold. Identifying the root causes of wait states in large-scale parallel applications. In Proc. of International Conference on Parallel Processing. IEEE Computer Society, 2010.
14. U. Fayyad and K. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. In Proc. of International Joint Conference on Artificial Intelligence, pages 1022-1029, 1993.
15. M. Gerndt and M. Ott. Automatic performance analysis with periscope. Concurr. Comput. : Pract. Exper., 22:736-748, 2010.
16. E. Ghiselli. Theory of psychological measurement. McGraw-Hill, 1964.
17. M. A. Hall. Correlation-based feature selection for discrete and numeric class machine learning. In Proc. of International Conference on Machine Learning, pages 359-366, 2000.
18. T. Heath, A. Centeno, P. George, L. Ramos, Y. Jaluria, and R. Bianchini. Mercury and freon: temperature emulation and management for server systems. In Proc. of International Conference on Architectural Support for Programming Languages and Operating Systems, pages 106-116. ACM, 2006.
19. J. Henning. SPEC CPU2006 benchmark descriptions. ACM SIGARCH Computer Architecture News, 34(4):1-17, 2006.
20. L. Hyafil and R. Rivest. Constructing optimal binary decision trees is NP-complete. Information Processing Letters, 5(1):15-17, 1976.
21. Intel. Vtune Amplifier XE. Web site: www.intel.com/software/products/ vtune, 2011.
22. R. Kufrin. Perfsuite: An accessible, open source performance analysis environment for linux. In The International Conference on Linux Clusters, volume 151, 2005.
23. J. Levon and P. Elie. Oprofile: A system profiler for linux. Web site: http://oprofile.sourceforge.net, 2011.
24. C. Luk, R. Cohn, R. Muth, H. Patil, A. Klauser, G. Lowney, S. Wallace, V. Reddi, and K. Hazelwood. Pin: building customized program analysis tools with dynamic instrumentation. ACM SIGPLAN Notices, 40(6):190-200, 2005.
25. D. T. Marr, F. Binns, D. L. Hill, G. Hinton, D. A. Koufaty, J. A. Miller, and M. Upton. Hyper-threading technology architecture and microarchitecture. Intel Technology Journal, 6(1):1-12, 2002.
26. A. Merkel, J. Stoess, and F. Bellosa. Resource-conscious scheduling for energy efficiency on multicore processors. In Proc. of European conference on Computer systems, EuroSys, pages 153-166. ACM, 2010.
27. W. E. Nagel, A. Arnold, M. Weber, H.-C. Hoppe, and K. Solchenbach. Vampir: Visualization and analysis of mpi resources. SUPERCOMPUTER, 12:69-80, 1996.
28. E. Ould-Ahmed-Vall, J. Woodlee, C. Yount, K. Doshi, and S. Abraham. Using model trees for computer architecture performance analysis of software applications. IEEE International Symmposium on Performance Analysis of Systems and Software, 0:116-125, 2007.
29. V. Pillet, J. Labarta, T. Cortes, and S. Girona. Paraver: A tool to visualize and analyze parallel code. IN WOTUG-18, pages 17-31, 1995.
30. J. Quinlan. Induction of decision trees. Machine learning, 1(1):81-106, 1986.
31. J. Quinlan. C4. 5: programs for machine learning. Morgan Kaufmann, 1993.
32. J. R. Quinlan and R. L. Rivest. Inferring decision trees using the minimum description length principle. Inf. Comput., 80:227-248, 1989.
33. P. C. Roth and B. P. Miller. On-line automated performance diagnosis on thousands of processes. In Proc. of Symposium on Principles and Practice of Parallel Programming, pages 69-80. ACM, 2006.
34. D. Rumelhart. Learning internal representations by error propagation. MIT Press, 1986.
35. F. Schneider, M. Payer, and T. Gross. Online optimizations driven by hardware performance monitoring. In Proc. of Conference on Programming Language Design and Implementation, pages 373-382. ACM, 2007.
36. K. Shen, M. Zhong, S. Dwarkadas, C. Li, C. Stewart, and X. Zhang. Hardware counter driven on-the-fly request signatures. ACM SIGOPS Operating Systems Review, 42(2), 2008.
37. S. S. Shende and A. D. Malony. The tau parallel performance system. Int. J. High Perform. Comput. Appl., 20:287-311, 2006.
38. J. Stoess, C. Lang, and F. Bellosa. Energy management for hypervisor-based virtual machines. In Proc. of the USENIX Annual Technical Conference, page 1. USENIX Association, 2007.
39. D. M. Tullsen, S. J. Eggers, and H. M. Levy. Simultaneous multithreading: maximizing on-chip parallelism. In Proc. of International Symposium on Computer Architecture, ISCA '95, pages 392-403. ACM, 1995.
40. V. Vapnik. An overview of statistical learning theory. Neural Networks, IEEE Transactions on, 10(5):988-999, 1999.
41. J. Vetter. Performance analysis of distributed applications using automatic classification of communication inefficiencies. In Proc. of International Conference on Supercomputing, pages 245-254. ACM, 2000.
42. L. Xu, P. Yan, and T. Chang. Best first strategy for feature selection. In International Conference on Pattern Recognition, pages 706 -708 vol.2, 1988.
43. W. Xu, L. Huang, A. Fox, D. Patterson, and M. Jordan. Detecting large-scale system problems by mining console logs. In Proc. of ACM Symposium on Operating Systems Principles, pages 117-132. ACM, 2009.
44. W. Yoo, K. Larson, S. Kim, W. Ahn, R. Campbell, and L. Baugh. Automated Fingerprinting of Performance Pathologies Using Performance Monitoring Units (PMUs). In Proc. of USENIX Workshop on Hot topics in parallelism. USENIX Association, 2011.
45. O. Zaki, E. Lusk, W. Gropp, and D. Swider. Toward scalable performance visualization with jumpshot. International Journal of High Performance Computing Applications, 13(3), 1999.