A taxonomy of grid monitoring systems

Future Generation Computer Systems

Volumn 21, Issue 1, 2005, Pages 163-188

  Zanikolas, Serafeim ^a   Sakellariou, Rizos ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Grid Information Services; Grid monitoring; Grid Monitoring Architecture

Indexed keywords

COMPUTER SYSTEMS; GEOGRAPHIC INFORMATION SYSTEMS; INTEROPERABILITY; LARGE SCALE SYSTEMS; MIDDLEWARE; MONITORING; PROJECT MANAGEMENT; STANDARDIZATION;

GRID INFORMATION SERVICES; GRID MONITORING; GRID MONITORING ARCHITECTURE; TAXONOMY;

INFORMATION SERVICES;

EID: 10444251156     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2004.07.002     Document Type: Article

References (76)

1. I. Foster, C. Kesselman, S. Tuecke, The anatomy of the grid: enabling scalable virtual organizations, Int. J. Supercomput. Appl. 15 (3) (2001) 115-128.
2. S. Fitzgerald, I. Foster, C. Kesselman, G. von Laszewski, W. Smith, S. Tuecke, A directory service for configuring high-performance distributed computations, in: Proceedings of the Sixth IEEE Symposium on High Performance Distributed Computing, IEEE Computer Society Press, 1997, pp. 365-375.
3. S. Czajkowski, K. Fitzgerald, I. Foster, C. Kesselman, Grid information services for distributed resource sharing, in: Proceedings of the 10th IEEE International Symposium on High-Performance Distributed Computing (HPDC-10), IEEE Computer Society Press, San Francisco, CA, 2001, pp. 181-194.
4. Z. Balaton, P. Kacsuk, N. Podhorszki, F. Vajda, Use Cases and the Proposed Grid Monitoring Architecture, Tech. Rep. LDS-1/2001, Computer and Automation Research Institute of the Hungarian Academy of Sciences, 2001. http://www.lpds.sztaki.hu/publications/reports/lpds-1-2001.pdf.
5. G. Carlson, How to save money with computer monitoring, in: Proceedings of the ACM Annual Conference, ACM Press, Boston, MA, USA, 1972, pp. 1018-1023.
6. B. Tierney, R. Aydt, D. Gunter, W. Smith, M. Swany, V. Taylor, R. Wolski, A Grid Monitoring Architecture, GWD-Perf-16-3, Global Grid Forum, August 2002. http://www-didc.lbl.gov/GGF-PERF/GMA-WG/papers/GWD-GP-16-3.pdf.
7. B. Plale, P. Dinda, M. Helm, G. von Laszewski, J. McGee, Key concepts and services of a grid information service, in: Proceedings of the 15th International Conference on Parallel and Distributed Computing Systems (PDCS 2002), Louisville, KY, 2002.
8. M. Mansouri-Samani, Monitoring Distributed Systems (A Survey), Tech. Rep. DOC92/23, Imperial College, London, UK, 1992. http://www.citeseer.ist.psu.edu/mansouri-samani92monitoring.html.
9. M. Mansouri-Samani, M. Sloman, Monitoring distributed systems, IEEE Network 7 (6) (1993) 20-30.
10. R. Wolski, L.J. Miller, G. Obertelli, M. Swany, Performance information services for computational grids, Grid Resource Management, State of the Art and Future Trends, Kluwer Academic Publishers, 2003, pp. 193-213.
11. D.L. Mills, Network Time Protocol (Version 3) Specification, Implementation and Analysis, RFC 1305, March 1992. http://www.ietf.org/rfc/rfc 1305.txt.
12. A. Cooke, A.J.G. Gray, L. Ma, W. Nutt, J. Magowan, M. Oevers, P. Taylor, R. Byrom, L. Field, S. Hicks, J. Leake, M. Soni, A. Wilson, R. Cordenonsi, L. Cornwall, A. Djaoui, S. Fisher, N. Podhorszki, B. Coghlan, S. Kenny, D. O'Callaghan, R-GMA: an information integration system for grid monitoring, in: Proceedings of the 10th International Conference on Cooperative Information Systems, 2003.
13. W. Smith, D. Gunter, D. Quesnel, A Simple XML Producer/Consumer Protocol, GWD-Perf-8-2, Global Grid Forum, 2002. http://www-didc.lbl.gov/GGF-PERF/GMA-WG/papers/GWD-GP-8-2.pdf.
14. Distributed Management Task Force-Common Information Model (CIM), accessed on 3 December 2003. http://www.dmtf.org/standards/cim.
15. F. Bonnassieux, R. Harakaly, P. Primet, MapCenter: an open grid status visualization tool, in: Proceedings of the ISCA 15th International Conference on Parallel and Distributed Computing Systems, Louisville, KY, USA, 2002.
16. F. Bonnassieux, R. Harakaly, P. Primet, Automatic services discovery, monitoring and visualization of grid environments: the mapcenter approach, in: F.F. Rivera, M. Bubak, A.G. Tato, R. Doallo (Eds.), Proceedings of the First European Across Grids Conference, vol. 2970 of Lecture Notes in Computer Science, Springer-Verlag, Santiago de Compostela, Spain, 2004, pp. 222-229.
17. S. Andreozzi, N. De Bortoli, S. Fantinel, A. Ghiselli, G. Tortone, C. Vistoli, GridICE: A Monitoring Service for the Grid, in: Proceedings of the Third Cracow Grid Workshop, Cracow, Poland, October 27-29, 2003, pp. 220-226.
18. S. Andreozzi, S. Fantinel, D. Rebatto, L. Vaccarossa, G. Tortone, A monitoring tool for a grid operation center, in: Computing in High Energy and Nuclear Physics (CHEP03), La Jolla, CA, 2003.
19. R.L. Ribler, J.S. Vetter, H. Simitci, D.A. Reed, Autopilot: adaptive control of distributed applications, in: Proceedings of the Seventh IEEE Symposium on High-Performance Distributed Computing, 1998, pp. 172-179.
20. F. Berman, A. Chien, K. Cooper, J. Dongarra, I. Foster, D. Gannon, L. Johnsson, K. Kennedy, C. Kesselman, J. Mellor-Crummey, D. Reed, L. Torczon, R. Wolski, The GrADS project: software support for high-level grid application development, Int. J. High Perform. Comput. Appl. 15 (4) (2001) 327-344.
21. R. Aydt, The Pablo Self-Defining Data Format, Tech. Rep., Department of Computer Science, University of Illinois at Urbana-Champaign (Revised at 17 March 2003), March 1992. ftp://vibes.cs.uiuc.edu/pub/Pablo.Release.5/SDDF/ Documentation/SDDF.ps.gz.
22. W. Smith, A system for monitoring and management of computational grids, in: Proceedings of the 31st International Conference on Parallel Processing (ICPP2002), IEEE Computer Society Press, 2002, p. 55.
23. W. Smith, A Framework for Control and Observation in Distributed Environments, Tech. Rep. NAS-01-006, NASA Advanced Supercomputing Division, NASA Ames Research Center, July 2001.
24. M. A. Baker, G.C. Smith, GridRM: an extensible resource monitoring system, in: Proceedings of the IEEE International Cluster Computing Conference, 1-4 December 2003, pp. 207-214.
25. J.D. Case, M. Fedor, M.L. Schoffstall, C. Davin, Simple Network Management Protocol (SNMP), RFC 1157, May 1990. http://www.ietf.org/rfc/rfc1157.txt.
26. A. Hawkeye, Monitoring and Management Tool for Distributed Systems, accessed on 27 October 2003. http://www.cs.wisc.edu/condor/hawkeye/.
27. M. Litzkow, M. Livny, M. Mutka, Condor: a hunter of idle workstations, in: Proceedings of the Eighth International Conference of Distributed Computing Systems, San Jose, CA, 1988, pp. 104-111.
28. R. Raman, M. Livny, M. Solomon, Matchmaking: distributed resource management for high throughput computing, in: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC), IEEE Computer Society Press, Chicago, IL, USA, 1998, p. 140.
29. P. Stelling, I. Foster, C. Kesselman, C. Lee, G. von Laszewski, A fault detection service for wide area distributed computations, in: Proceedings of the Seventh IEEE International Sym posium on High Performance Distributed Computing, Chicago, IL, 1998, pp. 268-278.
30. B. Tierney, B. Crowley, D. Gunter, J. Lee, M. Thompson, A monitoring sensor management system for grid environments, Cluster Comput. 4 (1) (2001) 19-28.
31. Z. Balaton, P. Kacsuk, N. Podhorszki, Application monitoring in the grid with GRM and PROVE, in: Proceedings of the International Conference on Computational Science (ICCS2001), Part I, vol. 2073 of Lecture Notes in Computer Science, Springer-Verlag, San Francisco, CA, USA, 2001, p. 253.
32. Z. Balaton, G. Gombás, Resource and job monitoring in the grid, in: Proceedings of the Ninth International Euro-Par Conference, vol. 2790 of Lecture Notes in Computer Science, Springer-Verlag, Klagenfurt, Austria, 2003, pp. 404-411.
33. Z. Balaton, G. Gombás, GridLab Monitoring: Detailed Architecture Specification, Tech. Rep. GridLab-11-D11.2-01-vl.2, EU Information Society Technologies Programme (IST), 2001. http://www.gridlab.org/Resources/Deliverables/D 11.2.pdf.
34. G. Allen, K. Davis, K.N. Dolkas, N.D. Doulamis, T. Goodale, T. Kielmann, A. Merzky, J. Nabrzyski, J. Pukacki, T. Radke, M. Russell, E. Seidel, J. Shalf, I. Taylor, Enabling applications on the grid: a gridlab overview, Int. J. High Perform. Comput. Appl. 17 (4) (2003) 449-66.
35. N. Podhorszki, P. Kacsuk, Design and implementation of a distributed monitor for semi-on-line monitoring of VisualMP applications, in: Proceedings of the Third Austrian-Hungarian Workshop on Distributed and Parallel Systems (DAPSYS2000), From Instruction Parallelism to Cluster Computing, Hungary, 2000, pp. 23-32.
36. Z. Balaton, P. Kacsuk, N. Podhorszki, F. Vajda, From cluster monitoring to grid monitoring based on GRM, in: R. Sakellariou, et al. (Eds.), Proceedings of the Seventh International Euro-Par Conference, vol. 2150 of Lecture Notes in Computer Science, Springer-Verlag, Manchester, UK, 2001, pp. 874-881.
37. B. Tierney, D. Gunter, NetLogger: a toolkit for distributed system performance tuning and debugging, in: G.S. Goldszmidt, J. Schönwälder (Eds.), Proceedings of the IFIP/IEEE Eighth International Symposium on Integrated Network Management (IM 2003), vol. 246 of IFIP Conference Proceedings, Kluwer, 2003, pp. 97-100.
38. D. Gunter, B. Tierney, K. Jackson, J. Lee, M. Stoufer, Dynamic monitoring of high-performance distributed applications, in: Proceedings of the 11th IEEE Symposium on High Performance Distributed Computing, HPDC-11, IEEE Computer Society Press, Edinburgh, Scotland, 2002, p. 163.
39. C.E. Tull, D. Gunter, W. Lavrijsen, D. Quarrie, B. Tierney, GMA instrumentation of the athena framework using Net-Logger, in: Computing in High Energy and Nuclear Physics (CHEP03), La Jolla, CA, 2003.
40. R. Wolski, N. Spring, J. Hayes, The network weather service: a distributed resource performance forecasting service for meta-computing, J. Future Generation Comput. Syst. 15 (5/6) (1999) 757-768.
41. I. Foster, C. Kesselman, J. Nick, S. Tuecke, The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Tech. Rep., Global Grid Forum, June 2002. http://www.globus.org/research/papers/ogsa.pdf.
42. M. den Burger, T. Kielmann, H.E. Bal, TopoMon: a monitoring tool for grid network topology, in: Proceedings of the International Conference on Computational Science (ICCS 2002), vol. 2230, Springer-Verlag, 2002, pp. 558-567.
43. B. Balis, M. Bubak, T. Szepieniec, R. Wismüller, M. Radecki, Monitoring grid applications with grid-enabled OMIS monitor, in: F.F. Rivera, M. Bubak, A.G. Tato, R. Doallo (Eds.), Proceedings of the First European Across Grids Conference, vol. 2970 of Lecture Notes in Computer Science, Springer-Verlag, Santiago de Compostela, Spain, 2004, pp. 230-239.
44. The EU CrossGrid Project, accessed on 27 November 2003. http://www.eu-crossgrid.org.
45. T.L. II, R. Wismüller, OMIS 2.0: a universal interface for monitoring systems, in: M. Bubak, J. Dongarra, J. Wasniewski (Eds.), Proceedings of the Fourth European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, vol. 1332 of Lecture Notes in Computer Science, Springer-Verlag, Cracow, Poland, 1997, pp. 267-276.
46. T. DeWitt, T. Gross, B. Lowekamp, N. Miller, P. Steenkiste, J. Subhlok, D. Sutherland, ReMoS: A Resource Monitoring System for Network-Aware Applications, Tech. Rep. CMU-CS-97-194, School of Computer Science, Carnegie Mellon University, December 1998. http://www-2.cs.cmu. edu/afs/cs/project/cmcl/www/remulac/remos-tr-2.ps.
47. P. Dinda, T. Gross, R. Karrer, B. Lowekamp, N. Miller, P. Steenkiste, D. Sutherland, The architecture of the Remos system, in: Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing (HPDC-10 2001), IEEE Computer Society Press, San Francisco, CA, USA, August 7-9, 2001, pp. 252-265.
48. P. Dinda, D. O'Hallaron, An Extensible Toolkit for Resource Prediction in Distributed Systems, Tech. Rep. CMU-CS-99-138, School of Computer Science, Carnegie Mellon University, July 1999. http://www.reports-archive.adm. cs.cmu.edu/anon/1999/CMU-CS-99-138.pdf.
49. H.L. Truong, T. Fahringer, SCALEA-G: A Unified Monitoring and Performance Analysis System for the Grid, Tech. Rep., Institute for Software Science, University of Vienna, November 2003. ftp.vcpc.univie.ac.at/projects/aurora/reports/auroratr2.
50. H.L. Truong, T. Fahringer, SCALEA: a performance analysis tool for parallel programs, Concurrency Comput.: Pract. Experience 15 (11/12) (2003) 1001-1025.
51. B. Buck, J.K. Hollingsworth, An API for runtime code patching, Int. J. High Perform. Comput. Appl. 14 (4) (2000) 317-329.
52. M.L. Massie, B.N. Chun, D.E. Culler, Ganglia Distributed Monitoring System: Design, Implementation, and Experience, Parallel Computing 30 (2004) 817-840.
53. I. Foster, C. Kesselman, Globus: a toolkit-based grid architecture, in: The Grid: Blueprint for a Future Computing Infrastructure, Morgan-Kaufmann, 1999, pp. 259-278.
54. M. Wahl, T. Howes, S. Kille, Lightweight Directory Access Protocol (v3), RFC 2251, December 1997. http://www. ietf.org/rfc/rfc2251.txt.
55. I. Foster, C. Kesselman, G. Tsudik, S. Tuecke, A security architecture for computational grids, in: Proceedings of the ACM Conference on Computers and Security, ACM Press, 1998, pp. 83-91.
56. H.B. Newman, I.C. Legrand, P. Galvez, R. Voicu, C. Cirstoiu, MonALISA: a distributed monitoring service architecture, in: Computing in High Energy and Nuclear Physics (CHEP03), La Jolla, CA, 2003.
57. J. Waldo, The Jini Architecture for Network-Centric Computing, Commun. ACM 42 (7) (1999) 76-82.
58. H.B. Newman, I.C. Legrand, J.J. Bunn, A distributed agent-based architecture for dynamic services, in: Computing in High Energy and Nuclear Physics (CHEP01), 2001.
59. B. Miller, M. Callaghan, J. Cargille, J. Hollingsworth, R. Irvin, K. Karavanic, K. Kunchithapadam, T. Newhall, The paradyn parallel performance measurement tools, IEEE Comput. 28 (11) (1995) 37-46.
60. P.C. Roth, D.C. Arnold, B.P. Miller, MRNet: a software-based multicast/reduction network for scalable tools, in: Proceedings of the Supercomputing 2003 (SC 2003), Phoenix, AZ, 2003.
61. P.C. Roth, D.C. Arnold, B.P. Miller, Benchmarking the MRNet distributed tool infrastructure: lessons learned, in: Proceedings of the High-Performance Grid Computing Workshop, held in conjunction with IPDPS, IEEE Computer Society Press, Santa Fe, NM, USA, 2004.
62. B. Coghlan, A. Djaoui, S. Fisher, J. Magowan, M. Oevers, Time, information services and the grid, in: Advances in Database Systems (BNCOD): Supplement to the Proceedings of the 18th British National Conference on Databases at RAL, 9-11 July 2001.
63. X. Zhang, J. Freschl, J. Schopf, A performance study of monitoring and information services for distributed systems, in: Proceedings of the 12th IEEE High Performance Distributed Computing (HPDC-12 2003), IEEE Computer Society Press, Seattle, WA, USA, 2003, pp. 270-282.
64. M. Gerndt, R. Wismüller, Z. Balaton, G. Gombás, Z. Nérneth, N. Podhorski, H.-L. Truong, T. Fahringer, M. Bubak, E. Laure, T. Margalef, Performance Tools for the Grid: State of the Art and Future, Tech. Rep., Lehrstuhl fuer Rechnertechnik und Rechnerorganisation, Technische Universitaet Muenchen (LRR-TUM), January 2004. http://www.lpds.sztaki.hu/~zsnemeth/apart/repository/gridtools.pdf.
65. Z. Balaton, P. Kacsuk, N. Podhorszki, F. Vajda, Comparison of Representative Grid Monitoring Tools, Tech. Rep. LDS-2/2000, Computer and Automation Research Institute of the Hungarian Academy of Sciences, 2000. http://www.lpds.sztaki.hu/publications/reports/lpds-2.pdf.
66. M. Knop, J. Schopf, P. Dinda, Windows performance monitoring and data reduction using WatchTower, in: Proceedings of the Workshop on Serf-Healing, Adaptive and self-MANaged Systems (SHAMAN), New York, 2002.
67. N. Chalakornkosol, P. Uthayopas, Monitoring the dynamics of grid environment using grid observer (poster presentation), in: Proceedings of the IEEE CCGRID2003, Toshi Center, Tokyo, 2003.
68. C.L. Mendes, D.A. Reed, Monitoring large systems via statistical sampling, in: Proceedings of the Los Alamos Computer Science Intitute (LACSI) Symposium, Santa Fe, 2002.
69. Views of Monitoring Data, accessed on 27 November 2003. http://www-unix.mcs.anl.gov/~schopf/views.html.
70. CAIDA, the Cooperative Association for Internet Data Analysis: Performance Measurement Tools Taxonomy, accessed on 27 November 2003. http://www.caida.org/tools/taxonomy/performance.xml.
71. N. Podhorszki, Z. Balaton, G. Gombás, Monitoring message-passing parallel applications in the grid with GRM and mercury monitor, in: Proceedings of the Second European Across Grids Conference, Nicosia, Cyprus, 2004.
72. S. Zanikolas, R. Sakellariou, Towards a monitoring framework for worldwide grid information services, in: 10th International Euro-Par Conference, Vol. 3149, Lecture Notes in Computer Science, Springer-Verlag, Pisa, Italy, August 31-September 3, 2004, pp. 417-422.
73. Z. Balaton, G. Gombás, Z. Németh, Information system architecture for brokering in large scale grids, in: Proceedings of the DAPSYS 2002 on Parallel and Distributed Systems: Cluster and Grid Computing, Kluwer, Linz, 2002, pp. 57-65.
74. M. Dikaiakos, Y. Ioannidis, R. Sakellariou, Search engines for the grid: a research agenda, in: F.F. Rivera, M. Bubak, A.G. Tato, R. Doallo (Eds.), Proceedings of the First European Across Grids Conference, vol. 2970 of Lecture Notes in Computer Science, Springer-Verlag, Santiago de Compostela, Spain, 2004, pp. 49-58.
75. Netcraft, accessed on 2 February 2004. http://www. netcraft.com.
76. Alexa, accessed on 2 February 2004. http://www.alexa.com.