Multi-scale real-time grid monitoring with job stream mining

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009

Volumn , Issue , 2009, Pages 420-427

  Zhang, Xiangliang ^a   Sebag, Michèle ^a   Cécile, Germain Renaud ^a  

^a UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ANOMALY DETECTION; AUTONOMIC COMPUTING; COMPUTATIONAL SYSTEM; COMPUTATIONAL WORKLOAD; DATA STREAMING; GRID MIDDLEWARE; LONG-TERM TREND; MANAGEMENT TOOL; MULTISCALES; OFF-LINE MONITORING; ONLINE MONITORING; REPORTING SERVICE; STATISTICAL LEARNING; STREAM MINING; TIME GRID; VISUAL INSPECTION;

CLUSTER COMPUTING; COMPUTATIONAL COMPLEXITY; COMPUTER SCIENCE; DATA REDUCTION; MIDDLEWARE; VISUAL COMMUNICATION;

GRID COMPUTING;

EID: 70349743748     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2009.20     Document Type: Conference Paper

References (31)

1. I. Rish, M. Brodie, S. Ma, and et al, "Adaptive diagnosis in distributed systems," IEEE Transactions on Neural Networks, vol. 16, pp. 1088- 1109, 2005.
2. J. O. Kephart and D. M. Chess, "The vision of autonomic computing," Computer, vol. 36, pp. 41-50, 2003.
3. E. Laure, S. Fisher, A. Frohner, C. Grandi, and et al., "Programming the grid with gLite," Computational Methods in Science and Technology, vol. 12, pp. 33-45, 2006.
4. R. Jones, "The EGEE project," Talk at EGEE'08 Conference, 2008, http://indico.cern.ch/contributionDisplay.py?contribId=116&sessionId =0&confId=32220.
5. X. Zhang, C. Furtlehner, and M. Sebag, "Data streaming with affinity propagation," in European Conference on Machine Learning and Practice of Knowledge Discovery in Databases, ECML/PKDD, 2008, pp.628-643.
6. E. Page, "Continuous inspection schemes," Biometrika, vol. 41, pp. 100- 115, 1954.
7. D. Hinkley, "Inference about the change-point from cumulative sum tests," Biometrika, vol. 58, pp. 509-523, 1971.
8. R. Byrom, D. Colling, S. M. Fisher, and et al., "Performance of R-GMA based grid job monitoring system for CMS data production," in IEEE Nuclear Science Symposium Conference Record, 2005, pp. 860-864.
9. E. Imamagic and D. Dobrenic, "Grid infrastructure monitoring system based on Nagios," in GMW '07: Proceedings of the 2007 workshop on Grid monitoring, 2007, pp. 23-28.
10. C. C. Cirstoiu, C. C. Grigoras, L. L. Betev, and et al., "Monitoring, accounting and automated decision support for the alice experiment based on the MonALISA framework," in GMW '07: Proceedings of the 2007 workshop on Grid monitoring, 2007, pp. 39-44.
11. G. Donvito, G. Tortone, M. Maggi, and et al., "Job-monitoring over the grid with GridIce infrastructure," CERN, Tech. Rep. EGEE-PUB-2004- 008, 2005.
12. H. linh Truong and T. Fahringer, "SCALEA-G: a unified monitoring and performance analysis system for the grid," Scientific Programming,vol. 12, pp. 225-237, 2004.
13. A. K?renek, J. Sitera, L. Matyska, and et al., "gLite job provenancea job-centric view," Concurr. Comput. : Pract. Exper., vol. 20, pp. 453-462, 2008.
14. R. Kalmady, D. Sonvane, P. Chand, and et al., "Monitoring the availability of grid services using SAM and gridview," in International Symposium on Grid Computing ISGC 2007, ser. LLC, 2007, pp. 163-168.
15. "LEMON - LHC Era Monitoring." [Online]. Available: http://lemon.web.cern.ch/lemon/docs.shtml
16. N. Palatin, A. Leizarowitz, A. Schuster, and et al., "Mining for misconfigured machines in grid systems," in International conference on Knowledge discovery and data mining(KDD), 2006, pp. 687-692.
17. J. Andreeva, B. Gaidioz, J. Herrala, and et al., "Dashboard for the LHC experiments," Journal of Physics: Conference Series, vol. 119, 2008.
18. Real Time Monitor: http://gridportal.hep.ph.ic.ac.uk/rtm/.
19. B. Kryza, R. Slota, M. Majewska, and et al., "Grid organizational memory-provision of a high-level grid abstraction layer supported by ontology alignment," Future Gener. Comput. Syst., vol. 23, pp. 348-358, 2007.
20. W. Xing, M. D. Dikaiakos, and R. Sakellariou, "A core grid ontology for the semantic grid," in IEEE International Symposium on Cluster Computing and the Grid (CCGRID), 2006, pp. 178-184.
21. R. Wolski, "Experiences with predicting resource performance on-line in computational grid settings," SIGMETRICS Perform. Eval. Rev., vol. 30, pp. 41-49, 2003.
22. A. Mutz, R. Wolski, and J. Brevik, "Eliciting honest value information in a batch-queue environment," in IEEE/ACM International Conference on Grid Computing, 2007, pp. 291-297.
23. P. A. Dinda, "Online prediction of the running time of tasks," Cluster Computing, vol. 5, pp. 225-236, 2002.
24. T. Fahringer, R. Prodan, R. Duan, and et al., "ASKALON: A grid application development and computing environment," in IEEE/ACM International Workshop on Grid Computing, 2005, pp. 122-131.
25. H.-L. Truong, T. Fahringer, and S. Dustdar, "Dynamic instrumentation, performance monitoring and analysis of grid scientific workflows,"Journal of Grid Computing, pp. 1-18, 2005.
26. C. Germain-Renaud and D. Monnier-Ragaigne, "Grid result checking," in CF '05: Proceedings of the 2nd conference on Computing frontiers, 2005, pp. 87-96.
27. L. F. G. Sarmenta, "Sabotage-tolerance mechanisms for volunteer computing systems," Future Gener. Comput. Syst., vol. 18, pp. 561-572, 2002.
28. G. Cormode, S. Muthukrishnan, andW. Zhuang, "Conquering the divide: Continuous clustering of distributed data streams," in ICDE, 2007, pp.1036-1045.
29. J. Gama and P. P. Rodrigues, "Stream-based electricity load forecast," in European conference on Principles and Practice of Knowledge Discovery in Databases(PKDD), 2007, pp. 446-453.
30. B. Frey and D. Dueck, "Clustering by passing messages between data points," Science, vol. 315, pp. 972-976, 2007.
31. K. Weinberger, J. Blitzer, and L. Saul, "Distance metric learning for large margin nearest neighbor classification," in Advances in Neural Information Processing Systems (NIPS), 2005.