Statistical data reduction for efficient application performance monitoring

Sixth IEEE International Symposium on Cluster Computing and the Grid, 2006. CCGRID 06

Volumn , Issue , 2006, Pages 327-334

  Yang, Lingyun ^a   Schopf, Jennifer M ^b   Dumitrescu, Catalin L ^a   Foster, Ian ^a,b  

^a THE UNIVERSITY OF CHICAGO   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INSTRUMENTATION PERTURBATION; PERFORMANCE MONITORING; STATISTICAL DATA REDUCTION; SYSTEM METRICS;

COMPUTATIONAL COMPLEXITY; COMPUTER SYSTEMS; DATA REDUCTION; DATA TRANSFER; DISTRIBUTED DATABASE SYSTEMS; INFORMATION RETRIEVAL; PERTURBATION TECHNIQUES;

STATISTICAL METHODS;

EID: 33751099073     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2006.97     Document Type: Conference Paper

References (22)

1. SYSSTAT utilities home page http://perso.wanadoo.fr/sebastien.godard/.
2. Allcock, B., Foster, I., Nefedova, V., et al., High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies. SC'01, 2001.
3. Allen, G., Benger, W., Dramlitsch, T., et al., Cactus Tools for Grid Applications, Cluster Computing, 4 (2001) 179-188.
4. Bavier, A., Bowman, M., Chun, B., et al., Operating System Support for Planetary-Scale Network Services. 1st Symp. on Network System Design and Implementation, 2004.
5. Duesterwald, E., Cascaval, C. and Dwarkads, S., Characterizing and Predicting Program Behavior and its Variability. 12th International Conference on Parallel Architecture and Compilation Techniques, 2003.
6. Foster, I. and Kesselman, C., The Globus Project: A Status Report. Proc. IPPS/SPDP '98 Heterogeneous Computing Workshop, 1998.
7. Jain, A.K., A Guideline to statistical approaches in computer performance evaluation studies, ACM SIGMETRICS Performance Evaluation Review, 1 (1978) 18-32.
8. Knop, M.W., Schopf, J.M. and Dinda, P.A., Windows Performance Monitoring and Data Reduction Using WatchTower. SHAMAN, 2002.
9. Liu, C., Yang, L., Foster, I., et al., Design and Evaluation of a Resource Selection Framework for Grid Applications. HPDC 11, 2002.
10. Malony, A.D., Reed, D.A. and Wijshoff, H.A.G., Performance Measurement Intrusion and Perturbation Analysis, IEEE Trans. Parallel and Distributed System, 3 (1992) 433-450.
11. Mendes, C.L. and Reed, D.A., Monitoring Larger Systems Via Statistical Sampling. LACSI Symposium, 2002.
12. Nabrzyski, J., Schopf, J.M. and Weglarz, J., Grid Resource Management.-State of the Art and Future Trends, Kluwer Publishing, 2003.
13. Nickolayev, O.Y., Roth, P.C. and Reed, D.A., Real-Time Statistical Clustering For Event Trace Reduction, The International Journal of Supercomputer Applications and High Performance Computing, 11 (1997) 144-159.
14. Reed, D.A., Aydt, R.A., Noe, R.J., et al., Scalable Performance Analysis: The pablo Performance Analysis Environment. Scalable Parallel Libraries Conference, 1993.
15. Ripeanu, M., Iamnitchi, A. and Foster, I., Performance Predictions for a Numerical Relativity Package in Grid Environments, International Journal of High Performance Computing Applications, 15 (2001).
16. Stockburger, D.W., Introductory Statistics: Concepts, Models, and Applications, 1996.
17. Vazhkudai, S. and Schopf, J.M., Using Disk Throughput Data in Predictions of End-to-End Grid Data Transfers. Grids2002, 2002.
18. Vetter, J.S. and Reed, D.A., Managing Performance Analysis with Dynamic Statistical Projection Pursuit. SC'99, Portland, OR, 1999.
19. Weisberg, S., Applied Linear Regression, 2 edn., John Wiley &Sons, 1985.
20. Wolski, R., Dynamically Forecasting Network Performance Using the Network Weather Service, Journal of Cluster Computing (1998).
21. Yang, L., Document: http://www.cs.uchicago.edu/~lyang/work/MetricsList. doc
22. Zhang, S., Cohen, I., Goldszmidt, M., et al., Ensembles of Models for Automated Diagnosis of System Performance Problems. IEEE Conference on Dependable Systems and Networks (DSN), 2005.