Analysis of application heartbeats: learning structural and temporal features in time series data for identification of performance problems

2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2008

Volumn , Issue , 2008, Pages

  Buneci, Emma S ^a   Reed, Daniel A ^b  

^a Duke University   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION PERFORMANCE; BEHAVIOR CHARACTERISTIC; COMPUTING FACILITIES; DEGRADED PERFORMANCE; GRID APPLICATIONS; PERFORMANCE ANALYSIS; PERFORMANCE DATA; PERFORMANCE PROBLEMS; SCIENTIFIC APPLICATIONS; SCIENTIFIC COLLABORATION; STRESS FACTORS; TEMPORAL FEATURES; TIME-SERIES DATA;

COMPUTER SCIENCE; QUALITY OF SERVICE; TIME SERIES;

TIME SERIES ANALYSIS;

EID: 70350764991     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2008.5219753     Document Type: Conference Paper

References (35)

1. Worldwide Large Hadron Collider (LHC) Computing Grid Project. http://lcg.web.cern.ch/LCG/.
2. R. L. Anderson. Distribution of the Serial Correlation Coefficients. Annals of Mathematical Statistics, 8(1):1-13, 1941.
3. B. G. Berriman, E. Deelman, J. C. Good, J. Jacob, D. Katz, C. Kesselman, A. C. Laity, T. Prince, G. Singh, and M.-H. Su. Montage: A Grid Enabled Engine for Delivering Custom Science-Grade Mosaics on Demand. In Proc. of SPIE: Astronomical Telescopes and Instrumentation, volume 5487, Glasgow, Scotland, 2004.
4. G. Box and G. Jenkins. Time Series Analysis: Forecasting and Control. Holden-Day, 1970.
5. P. Brunner, H.-L. Truong, and T. Fahringer. Performance Monitoring and Visualization of Grid Scientific Workflows in Askalon. In High Performance Computing and Communications, volume 4208, pages 170-179. Springer Berlin / Heidelberg, 2006.
6. I. Cohen, M. Goldszmidt, T. Kelly, J. Symons, and J. Chase. Correlating Instrumentation Data to System States: A Building Block for Automated Diagnosis and Control. In Proceedings of the OSDI, 2004.
7. I. Cohen, S. Zhang, M. Goldszmidt, J. Symons, T. Kelly, and A. Fox. Capturing, Indexing, Clustering, and Retrieving System History. In In Proceedings of SOSP, Brighton, United Kingdom, 2005.
8. K. Droegemeier. Linked Environments for Atmospheric Discovery. Technical report, University of Oklahoma, 1st July 2005.
9. K. Droegemeier, D. Gannon, D. Reed, B. Plale, J. Alameda, T. Blatzer, K. Brewster, R. Clark, B. Domenico, S. Graves, E. Joseph, D. Murray, R. Ramachandran, M. Ramamurthy, L. Ramakrishnan, J. A. Rushing, D. Weber, R. Wilhelmson, A. Wilson, M. Xue, and S. Yalda. Service-Oriented Environments for Dynamically Interacting with Mesoscale Weather. Computing in Science and Engineering, 7(6):12-29, 2005.
10. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. John Wiley & Sons, Inc, 2nd edition, 2001.
11. D. G. Galati and M. A. Simaan. Automatic Decomposition of Time Series into Step, Ramp, and Impulse Primitives. Pattern Recognition, 39:2166-2174, 2006.
12. S. Godard. The Sysstat Utilities. http://perso.orange.fr/sebastien. godard/.
13. I. Guyon and A. Elisseeff. An Introduction to Variable and Feature Selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
14. R. Jain. The Art of Computer Systems Performance Analysis. John Wiley and Sons, Inc, 1991.
15. G. Kandaswamy, A. Mandal, and D. A. Reed. Fault Tolerance and Recovery of Scientific Workflows on Computational Grids. In Workshop on Resiliency in High-Performance Computing in conjunction with CCGrid 08, 2008.
16. D. S. Katz, G. B. Berriman, E. Deelman, J. Good, C. Kesselman, A. C. Laity, T. A. Prince, G. Singh, and M.-H. Su. A Comparison of Two Methods for Building Astronomical Image Mosaics on a Grid. In 7th Workshop on High Performance Scientific and Engineering Computing (HPSEC-05), 2005.
17. A. C. Laity, N. Anagnostou, B. G. Berriman, J. C. Good, J. Jacob, D. Katz, and T. Prince. Montage: An Astronomical Image Mosaic Service for the NVO. In Astronomical Data Analysis Software and Systems XIV, ASP Conference Series, volume XXX, 2005.
18. I. C. Legrand, H. B. Newman, R. Voicu, C. Cirstoiu, C. Grigoras, M. Toarta, and C. Dobre. Monalisa: An Agent Based, Dynamic Service System to Monitor, Control and Optimize Grid Based Applications, September 2004.
19. J. Lin, E. Keogh, P. Patel, and S. Lonardi. Finding Motifs in Time Series. In 2nd Workshop on Temporal Data Mining, Edmonton, Alberta, Canada, 2002.
20. C.-d. Lu and D. A. Reed. Compact Application Signatures for Parallel and Distributed Scientific Codes. In Proc. SC '02, 2002.
21. M. L. Massie, B. Chun, and D. Culler. The Ganglia Distributed Monitoring System: Design, Implementation, and Experience. Parallel Computing, 30(7), 2004.
22. J. Michalakes, J. Dudhia, D. Gill, T. Henderson, J. Klemp, W. Skamarock, and W. Wang. The Weather Research and Forecast Model: Software Architecture and Performance. http://wrf-model.org/wrfadmin/docs/ecmwf-2004.pdf,2004.
23. E. L. Miller and R. H. Katz. Input/Output Behavior of Supercomputing Applications. In Proceedings of the ACM/IEEE Conference on Supercomputing, pages 567-576, Albuquerque, New Mexico, 1991.
24. The Montage Project: An Astronomical Image Mosaic Engine. http://montage.ipac.caltech.edu/, 2007.
25. J. Moore. Gamut: Generic Application EMULaTOR. http://issg.cs.duke.edu/ cod/, 2004.
26. R. T. Olszewski. Generalized Feature Extraction for Structural Pattern Recognition in Time-Series Data. PhD thesis, Carnegie Mellon Univeristy, 2001.
27. B. K. Pasquale and G. C. Polyzos. A Static Analysis of I/O Characteristics of Scientific Applications in a Production Workload. In Proc. SC '93, pages 388-397, Portland, Oregon, United States, 1993.
28. R. A. Pielke and R. Carbone. Weather Impacts, Forecasts, and Policy. Bulletin of the American Meteorological Society, 83:393-403, 2002.
29. R. Prodan and T. Fahringer. Dynamic Scheduling of Scientific Workflow Applications on the Grid: A Case Study. In 20th Symposium of Applied Computing, pages 687-694, Santa Fe, New Mexico, USA, 2005. ACM Press.
30. D. Reed and C. Mendes. Intelligent Monitoring for Adaptation in Grid Applications. Proceedings of the IEEE, 93(2), 2005.
31. R. Sugar. National Computational Infrastructure for Lattice Gauge Theory. http://www.scidac.gov/physics/quarks.html.
32. D. Sulakhe, A. Rodriguez, M. D'Souza, M. Wilde, V. Nefedova, I. Foster, and N. Maltsev. Gnare: An Environment for Grid-Based High-Throughput Genome Analysis. In CCGrid '05, Cardiff, UK, 2005.
33. H.-L. Truong, P. Brunner, T. Fahringer, F. Nerieri, R. Samborski, B. Balis, M. Bubak, and K. Rozkwitalski. K-Wfgrid Distributed Monitoring and Performance Analysis Services for Workflows in the Grid. In e-Science and Grid Computing (e-Science '06), Amsterdam, The Netherlands, 2006.
34. H. L. Truong and T. Fahringer. Scalea-G: A Unified Monitoring and Performance Analysis System for the Grid. In Second European AcrossGrids Conference, AxGrids 2004, volume 3165, pages 202-211, Nicosia, Cyprus, 2004. Springer-Verlag.
35. F. Vraalsen, R. A. Aydt, C. L. Mendes, and D. A. Reed. Performance Contracts: Predicting and Monitoring Grid Application Behavior. In Proc. 2nd International Workshop on Grid Computing, 2001.