Job monitoring and steering in D-Grid's High Energy Physics Community Grid

Future Generation Computer Systems

Volumn 25, Issue 3, 2009, Pages 308-314

  Lorenz, D ^b   Borovac, S ^c   Buchholz, P ^b   Eichenhardt, H ^a   Harenberg, T ^c   Mattig P ^c   Mechtel, M ^c   Muller Pfefferkorn R ^a   Neumann, R ^a   Reeves, K ^c   Uebing, Ch ^b   Walkowiak, W ^b   William, Th ^a   Wismuller R ^b  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b UNIVERSITY OF SIEGEN   (Germany)

^c UNIVERSITY OF WUPPERTAL   (Germany)

Author keywords

Computational steering; Grid computing; High Energy Physics Community Grid; Job monitoring

Indexed keywords

GRID COMPUTING;

COMPUTATIONAL STEERING; GERMANY; INTERMEDIATE RESULTS; JOB EXECUTIONS; JOB MONITORING; JOB PARAMETERS; RESOURCE USAGES; TOOL SUPPORTS;

HIGH ENERGY PHYSICS;

EID: 56149119030     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.05.009     Document Type: Article

References (33)

1. Andreozzi S., et al. GridICE: A monitoring service for Grid systems. Future Generation Computer Systems 559-571 4 (2005)
2. ATLAS Collaboration, ATLAS TDR 14 detector and physics performance, volume 1. Technical Report LHCC 99-14, CERN, 1999
3. ATLAS Collaboration. ATLAS TDR 15 detector and physics performance, volume 2. Technical Report LHCC 99-15, CERN, 1999
4. Balis B., et al. Monitoring Grid applications with Grid-enabled OMIS-Monitor. In: Rivera F., et al. (Ed). Proceedings of First European Across Grids Conference. Lecture Notes in Computer Science vol. 2970 (Feb. 2003), Springer-Verlag, Santiago de Compostela, Spain 230-239
5. R. Brun, F. Rademakers, ROOT - an object oriented data analysis framework, in: Proceedings of AIHENP'96 Workshop, number A 389 in Nuclear Instruments and Methods in Physics research (1997), September 1996, pp. 81-86
6. J.D. Brunner, et al. VASE: the visualization and application steering environment, in: Proc. of the 1993 ACM/IEEE conf. on Supercomputing, 1993, pp. 560-569
7. Byrom R., et al. Fault tolerance in the R-GMA information and monitoring system. European Grid Conference 2005. LNCS vol. 2470 (Feb. 2005), Springer-Verlag Berlin Heidelberg New York, Amsterdam/Netherlands 751-760
8. CERN - European Laboratory for Particle Physics, Athena Developer Guide. http://atlas.web.cern.ch/Atlas/GROUPS/SOFTWARE/OO/z0_obsolete/architectu re/General/Tech.Doc/Manual/AthenaDeveloperGuide.pdf
9. D-Grid webpage: http://www.d-grid.de
10. Eisenhauer G.S., and Schwan K. An object-based infrastructure for program monitoring and steering. Proc. of the SIGMETRICS Symp. on Parallel and Distributed Tools. SPDT '98 (1998), ACM Press, New York, NY, USA 10-20
11. Esnard A., Dussere M., and Coulard O. A time-coherent model for the steering of parallel simulations. Proceedings of Euro-Par 2004. LNCS vol. 3149 (2004), Springer 90-97
12. Geist G.A., Kohl J.A., and Papadopoulos P.M. CUMULVS: Providing fault-tolerance, visualization and steering of parallel applications. International Journal of High Performance Computing Applications 11 3 (1997) 224-236
13. gLite webpage: http://glite.web.cern.ch/glite
14. RFC 2078: GSSAPI version 2
15. Gu W., et al. Falcon: On-line monitoring for steering parallel programs. Concurrency: Practice and Experience 6 2 (1998)
16. Harenberg T., et al. http://www.grid.uni-wuppertal.de/grid/jem
17. T. Harenberg, et al. Overview over the High Energy Physics Community Grid in Germany's D-Grid initiative, in: Proc. of XI Int. Workshop on Advanced Computing and Analysis Techniques in Physics Research, ACAT 07, POS(ACAT25)12, 2007
18. HEPCG webpage: http://www.hepcg.org
19. I.C. Legrand, H.B. Newman, R. Voicu, C. Cirstoiu, C. Grigoras, M. Toarta, C. Dobre, MonALISA: An agent based, dynamic service system to monitor, control and optimize Grid based applications, in: CHEP 2004, September 2004
20. S. Jha, S. Pickles, A. Porter, A computational steering API for scientific Grid applications: Design, implementation and lessons, in: Workshop on Grid Application Programming Interfaces, September 2004
21. J. Knobloch, LHC computing Grid technical design report. Technical Report LCG-TDR-001, CERN, Geneva, Switzerland, June 2005
22. LCG Real Time Monitor: http://gridportal.hep.ph.ic.ac.uk/rtm/
23. Lorenz D., Buchholz P., Uebing C., Walkowiak W., and Wismüller R. Online steering of HEP Grid applications. Proceedings of the Cracow Grid Workshop'06 (July, 2007), Academic Computer Centre CYFRONET AGH, Cracow, Poland 191-198
24. D. Lorenz, P. Buchholz, C. Uebing, W. Walkowiak, R. Wismüller, RMOST: A shared memory model for online steering, in: Proc of the Int. Conference on Computer Science, Cracow, Poland, June 2008
25. Lorenz D., Buchholz P., Uebing C., Walkowiak W., and Wismüller R. Secure connections for computational steering of Grid jobs. Proceedings of the 16th Euromicro International Conference on Parallel, Distributed and network-based Processing (2008), IEEE, Toulouse, France, February 209-217
26. R. Müller-Pfefferkorn, et al. AMon - monitoring of jobs and their resource usage, 2007. http://tu-dresden.de/die_tu_dresden/zentrale_einrichtungen/zih/forschung /grid_computing/amon
27. R. Müller-Pfefferkorn, et al. User-centric monitoring and steering of the execution of large job sets, in: Proceedings of German e-Science Conference 2007, Baden-Baden, Germany, May 2007
28. J. Novotny, M. Russell, O. Wehrens, Gridsphere: A portal framework for building collaborations, 2005. GridSphere webpage: http://www.gridsphere.org:80/gridsphere/gridsphere?cid=publications
29. Placek M., and Buyya R. G-Monitor: A web portal for monitoring and steering application execution on global grids. Proceedings of the International Workshop on Challenges of Large Applications in Distributed Environments. CLADE '03 (2003), IEEE Computer Society, Washington, DC, USA page 10
30. RMOST webpage: http://www.hep.physik.uni-siegen.de/grid/rmost
31. J.M. Schopf, M. D'Arcy, N. Miller, L. Pearlman, I. Foster, C. Kesselman, Monitoring and discovery in a web services framework: Functionality and performance of the Globus toolkit's MDS4. Technical Report Tech Report ANL/MCS-P1248-0405, Argonne National Laboratory, April 2005
32. C.D. Steenberg, S.-C. Hsu, E. Lipeles, F. Würthwein, JobMon: A secure, scalable, interactive Grid job monitor, in: Proccedings of CHEP'06, February 2006
33. Vetter J.S., and Schwan K. High performance computational steering of physical simulations. Proceedings of the 11th International Symposium on Parallel Processing (1999), IEEE 128-134