An approach for dynamic detection of inefficient supercomputer applications

Procedia Computer Science

Volumn 136, Issue , 2018, Pages 35-43

  Shaykhislamov, Denis ^a   Voevodin, Vadim ^a  

^a MOSCOW STATE UNIVERSITY   (Russian Federation)

Author keywords

anomaly detection; efficiency analysis; high performance computing; LSTM; parallel program

Indexed keywords

ANOMALY DETECTION; DECISION TREES; EFFICIENCY; LONG SHORT-TERM MEMORY; PETROLEUM PROSPECTING; SUPERCOMPUTERS;

CLASSIFICATION METHODS; EFFICIENCY ANALYSIS; HIGH PERFORMANCE COMPUTING; LSTM; OIL AND GAS EXPLORATION; PARALLEL PROGRAM; RANDOM FOREST ALGORITHM; REAL-LIFE APPLICATIONS;

APPLICATION PROGRAMS;

EID: 85060481695     PISSN: None     EISSN: 18770509     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2018.08.235     Document Type: Conference Paper

References (25)

1. Tuncer, O., Ates, E., Zhang, Y., Turk, A., Brandt, J., Leung, V.J., Egele, M., Coskun, A.K., 2017. Diagnosing performance variations in hpc applications using machine learning, in: International Supercomputing Conference, Springer. pp. 355-373. doi:10.1007/978-3-319-58667-0-19.
2. Lan Z., Zheng Z., and Li Y. Toward automated anomaly identification in large-scale systems IEEE Transactions on Parallel and Distributed Systems 21 2010 174 187 doi:10.1109/TPDS.2009.52
3. Guan, Q., Fu, S., 2013. Adaptive anomaly identification by exploring metric subspace in cloud computing infrastructures, in: 2013 IEEE 32nd International Symposium on Reliable Distributed Systems, pp. 205-214. doi:10.1109/SRDS.2013.29.
4. Fu S. Performance metric selection for autonomic anomaly detection on cloud computing systems GLOBECOM 2011 IEEE 1 5 doi:10.1109/GLOCOM.2011.6134532
5. Zhang, H., You, H., Hadri, B., Fahey, M., 2012. Hpc usage behavior analysis and performance estimation with machine learning techniques, in: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp). p. 1.
6. Sidnev A.A., and Gergel' V.P. Automatic selection of the fastest algorithm implementations Vychislitel'nye Metody i Programmirovanie 15 2014 579 592
7. Shaykhislamov, D., Voevodin, V., 2017. An approach for detecting abnormal parallel applications based on time series analysis methods, in: International Conference on Parallel Processing and Applied Mathematics, Springer. pp. 359-369. doi:10.1007/978-3-319-78024-5-32.
8. Aminikhanghahi S., and Cook D.J. A survey of methods for time series change point detection Knowledge and information systems 51 2017 339 367
9. Cheboli, D., 2010. Anomaly detection of time series.
10. Kulick, J., Implementation of bayesian changepoint detection. URL: https://github.com/hildensia/bayesianchangepointdetection.
11. Kelly, J., Implementation of bayesian changepoint detection. URL: https://github.com/JackKelly/bayesianchangepoint.
12. Adams, R.P., MacKay, D.J., 2007. Bayesian online changepoint detection. arXiv preprint arXiv:0710.3742.
13. Newbold P. Arima model building and the time series analysis approach to forecasting Journal of Forecasting 2 1983 23 35 doi:10.1002/for.3980020104
14. Rabiner L.R. A tutorial on hidden markov models and selected applications in speech recognition Readings in speech recognition 1990 Elsevier 267 296 doi:10.1109/5.18626
15. Hochreiter S., and Schmidhuber J. Long short-term memory Neural computation 9 1997 1735 1780 doi:10.1162/neco.1997.9.8.1735
16. Malhotra, P., Vig, L., Shroff, G., Agarwal, P., 2015. Long short term memory networks for anomaly detection in time series, in: Proceedings, Presses universitaires de Louvain. p. 89.
17. Jeong Y.-S., Jeong M.K., and Omitaomu O.A. Weighted dynamic time warping for time series classification Pattern Recognition 44 9 2011 2231 2240
18. Rasmussen C.E. Gaussian processes for machine learning 2006 MIT Press
19. Wang, X., Takaki, S., Yamagishi, J., 2016. A comparative study of the performance of hmm, dnn, and rnn based speech synthesis systems trained on very large speaker-dependent corpora, in: 9th ISCA Speech Synthesis Workshop, pp. 125-128.
20. Panzner M., and Cimiano P. Comparing hidden markov models and long short term memory neural networks for learning action representations International Workshop on Machine Learning, Optimization and Big Data 2016 Springer 94 105 doi:10.1007/978-3-319-51469-7-8
21. Graves, A., Ferńandez, S., Gomez, F., and Schmidhuber, J., 2006. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks, in: Proceedings of the 23rd international conference on Machine learning, pp. 369-376. ACM.
22. Liu, I., Ramakrishnan, B., et al., 2014. Bach in 2014: Music composition with recurrent neural network. arXiv preprint arXiv:1412.3191.
23. Yeung S., Russakovsky O., Jin N., Andriluka M., Mori G., and Fei-Fei L. Every moment counts: Dense detailed labeling of actions in complex videos International Journal of Computer Vision 126 2018 375 389 doi:10.1007/s11263-017-1013-y
24. Mehdiyev N., Lahann J., Emrich A., Enke D., Fettke P., and Loos P. Time series classification using deep learning for process planning: A case from the process industry Procedia Computer Science 114 2017 242 249 doi:10.1016/j.procs.2017.09.066
25. Chollet, F., et al., 2015. Keras. https://keras.io.