Identification, modelling and prediction of non-periodic bursts in workloads

CCGrid 2010 - 10th IEEE/ACM International Conference on Cluster, Cloud, and Grid Computing

Volumn , Issue , 2010, Pages 485-494

  Lassnig, Mario ^a,b   Fahringer, Thomas ^a   Garonne, Vincent ^b   Molfetas, Angelos ^b   Branco, Miguel ^c  

^a UNIVERSITY OF INNSBRUCK   (Austria)

^b CERN   (Switzerland)

^c UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BASE FUNCTION; COMPUTATIONAL GRIDS; DETRIMENTAL EFFECTS; DISTRIBUTED DATA; LARGE-SCALE APPLICATIONS; PERIODIC BURSTS; PREDICTION ACCURACY; PREDICTION MODEL; SYNTHETIC WORKLOADS; WORK-LOAD MODELS;

CLUSTER COMPUTING; GRID COMPUTING; MATHEMATICAL MODELS; TIME SERIES;

FORECASTING;

EID: 77954892253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2010.118     Document Type: Conference Paper

References (43)

1. H. Akaike, "A new look at the statistical model identification" , Transactions on Automatic Control, Vol. 19(6), IEEE, 1974.
2. C. Atkeson, A. Moore, S. Schaal, "Locally Weighted Learning", Artificial Intelligence Review, Vol. 11(11-73), Kluwer, 1997.
3. E. Baum, D. Haussler, "What Size Net Gives Valid Generalization?", Neur. Comp., Vol. 1(151), Massachusetts Institute of Technology, 1989.
4. D. Bates, D. Watts, "Nonlinear Regression Analysis and Its Applications", ISBN 0471816434, Wiley, 1988.
5. J. Beran, "Statistics for Long-Memory Processes", ISBN 0412049015, Chapman & Hall, 1994.
6. C. Bishop, "Pattern Recognition and Machine Learning", ISBN 0387310738, Springer, 2006.
7. G. Box, G. Jenkins, G. Reinsel, "Time Series Analysis: Forecasting and Control", 4th. Ed., ISBN 9780470272848, Wiley, 1st. Ed. 1976, 2008.
8. M. Branco, E. Zaluska, D. De Roure, P. Salgado, V. Garonne, M. Lassnig, R. Rocha, "Managing Very-Large Distributed Datasets", Lecture Notes in Computer Science, Vol. 5331(2008), Springer, 2008.
9. M. Branco, E. Zaluska, D. De Roure, M. Lassnig, V. Garonne, "Managing very large distributed datasets on a Data Grid", Concurrency and Computation: Practice & Experience, Wiley, 2009 (in press).
10. R. Brychta, S. Tuntrakool, M. Appalsamy, et al., "Wavelet Methods for Spike Detection in Mouse Renal Sympathetic Nerve Activity", Transactions on Biomedical Engineering, Vol. 54(1), IEEE, 2007.
11. M. Burtscher, B. Zorn, "Exploring Last n Value Prediction", Proc. Int. Conf. Par. Arch. & Compil. Tech., ACM SIGARCH, 1999.
12. C. Chatfield, "The Analysis of Time Series", 5th. Ed., ISBN 0412716402, Chapman & Hall/CRC, 1996.
13. W. Conover, "Practical Nonparametric Statistics", 3rd. Ed., ISBN 0471160687, Wiley, 1999.
14. M. Crovella, A. Bestavros, "Self-similarity in World Wide Web traffic: evidence and possible causes", IEEE/ACM Transactions on Networking, Vol. 5(6), IEEE/ACM, 2002.
15. L. Devroye, "Non-Uniform Random Variate Generation", ISBN 0387963057, Springer, 1986.
16. D. Feitelson, "Looking at data". Proc. 22nd Intl. Parallel and Distributed Processing Symp., IEEE, 2008.
17. E. Hulata, R. Segev, E. Ben-Jacob, "A method for spike sorting and detection based on wavelet packets and Shannon's mutual information", Neuroscience methods, Vol. 117(1-12), Elsevier, 2002.
18. A. Iosup, H. Li, M. Jan, S. Anoep, C. Dumitrescu, L. Wolters, D. Epema, "The Grid Workloads Archive", FGCS, Vol. 24(7), Elsevier, 2008.
19. J. Kleinberg, "Bursty and Hierarchical Structure in Streams", Data Mining and Knowledge Discovery, Vol. 7(373-397), Kluwer, 2002.
20. M. Lassnig, T. Fahringer, V. Garonne, A. Molfetas, M. Branco, "Stream monitoring in large-scale distributed concealed environments", Proc. 5th IEEE Int. Conference on e-Science, IEEE, 2009 (in press).
21. M. Lassnig, V. Garonne, A. Molfetas, M. Branco, "Analysing a petabyte-scale distributed data management system", Proc. 3rd Austrian Grid Symposium, TR-09-14, Johannes Kepler Universität Linz, Austria, 2009.
22. H. Li, "Workload dynamics on clusters and grids", Journal of Supercomputing, Vol. 47(120), Springer 2009.
23. X. Lu, Z. Dong, X. Li, "Electricity market price spike forecast with data mining techniques", EPSR, Vol. 73(19-29), Elsevier, 2005.
24. B. Lu, M. Tinker, A. Apon, D. Hoffman, L. Dowdy, "Adaptive Automatic Grid Reconfiguration Using Workload Phase Identification", Proc. 1st Int. Conf. e-Science and Grid Computing, IEEE Computer Society, 2005.
25. N. Parikh, N. Sundaresan, "Scalable and near Real-Time Burst Detection from eCommerce Queries", Proc. 14th International Conference on Knowledge Discovery and Data Mining, ACM, 2008.
26. S. Podlipnig, "Applying Ordinal Time Series Methods to Grid Workload Traces", Proc. 17th IEEE/ACM Int. Symp. on Modelling, Analysis and Simulation of Comp. and Telecom. Systems, IEEE, ACM, London, 2009.
27. R. Prodan, V. Nae, "Prediction-based real-time resource provisioning for massively multiplayer online games", Future Generation Computer Systems, Vol. 25(785-793), Elsevier, 2009.
28. G. Schwarz, "Estimating the Dimension of a Model", Annals of Statistics, Vol. 6(2), Institute of Mathematical Statistics, 1978.
29. N. Serban, "MICE: Multiple Peak Identification, Characterization, and Estimation", Biometrics, Vol. 63(531-539), Int. Biometric Society, 2007.
30. C. Shahabi, X. Tian, W. Zhao, "TSA-Tree: A Wavelet-Based Approach to Improve the Efficiency of Multi-Level Surprise and Trend Queries on Time-Series Data", Proc. 12th International Conference on Scientific and Statistical Database Management, IEEE Computer Society, 2000.
31. R. Shumway, D. Stoffer, "Time Series Analysis and Its Applications", 2nd. Ed., ISBN 0387293175, Springer, 2006.
32. M. Vlachos, C. Meek, et al., "Identifying Similarities, Periodicities and Bursts for Online Search Queries", SIGMOD, ACM, 2004.
33. R. Wolski, G. Obertelli, M. Allen, D. Nurmi, J. Brevik, "Predicting Grid Resource Performance On-line", in Handbook of Innovative Computing: Models, Enabling Technologies, and Applications, Springer, 2005.
34. R. Wolski, N. Spring, J. Hayes, "The Network Weather Service: a Distributed Resource Performance Forecasting Service for Metacomputing", Future Generation Computing Systems, Vol. 15(5-6), Elsevier, 1999.
35. G. Zhang, B. Patuwo, M. Hu, "Forecasting with artificial neural networks: The state of the art", Forecasting, Vol. 14(1), Elsevier, 1998.
36. H. Zhang, G. Jiang, K. Yoshihira, H. Chen, A. Saxena, "Resilient Workload Manager: Taming Bursty Workload of Scaling Internet Applications", Proc. 6th International Conference on Autonomic Computing and Communications, ACM, 2009.
37. X. Zhang, D. Shasha, "Better Burst Detection", Proc. 22nd International Conference on Data Engineering, IEEE Computer Society, 2006.
38. J. Zhao, Z. Dong, X. Li, K. Wong, "A General Method for Electricity Market Price Spike Analysis", Proc. Power Engineering Society General Meeting, IEEE, 2005.
39. http://castor.web.cern.ch/castor/, CERN, November 2009.
40. http://www.dcache.org/, dCache Collaboration, November 2009.
41. http://twiki.cern.ch/twiki/bin/view/LCG/DataManagementDocumentationEGEE, LCG, November 2009.
42. http://www.r-project.org/, GNU, FSF, November 2009.
43. http://mail.python.org/pipermail/python-list/2009-August/191190.html, MRAB, 2009.