System-level resource monitoring in high-performance computing environments

Journal of Grid Computing

Volumn 1, Issue 3, 2003, Pages 273-289

  Agarwala, Sandip ^a   Poellabauer, Christian ^a   Kong, Jiantao ^a   Schwan, Karsten ^a   Wolf, Matthew ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Cluster computing; Customizability; Distributed systems; Dynamic adaptation; High performance computing; Kernel level resource management; Monitoring

Indexed keywords

CUSTOMIZABILITY; DISTRIBUTED SYSTEMS; DYNAMIC ADAPTATIONS; HIGH PERFORMANCE COMPUTING; RESOURCE MANAGEMENT;

CLUSTER COMPUTING; COMPUTER SOFTWARE SELECTION AND EVALUATION; DECISION MAKING; MONITORING; QUALITY OF SERVICE;

INFORMATION MANAGEMENT;

EID: 63149178365     PISSN: 15707873     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:GRID.0000035189.80518.5d     Document Type: Article

References (32)

1. S. Agarwala, C. Poellabauer, J. Kong, K. Schwan and M. Wolf, "Resource-Aware Stream Management with the Customizable dproc Distributed Monitoring Mechanisms", in: Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12), Seattle, Washington, 2003, pp. 250-259.
2. E. Al-Shaer, H. Abdel-Wahab and K. Maly, "HiFi: A New Monitoring Architecture for Distributed Systems Management", in Proceedings of the 19th International IEEE Conference on Distributed Computing Systems, Austin, TX, 1999, pp. 171-178.
3. R. Buyya, "PARMON: A Portable and Scalable Monitoring System for Clusters", Software Practice and Experience Journal, Vol. 30, No. 7, pp. 723-739, 2000.
4. G. Eisenhauer, "Portable Self-Describing Binary Data Streams", Technical Report GIT-CC-94-45, College of Computing, Georgia Institute of Technology, 1994. http://www.cc.gatech.edu/tech_reports
5. G. Eisenhauer, "Dynamic Code Generation with the E-Code Language", Technical Report GIT-CC-02-42, Georgia Institute of Technology, College of Computing, 2002.
6. G. Eisenhauer, F. Bustamante and K. Schwan, "Event Services for High Performance Computing", in: Proceedings of High Performance Distributed Computing (HPDC), 2000.
7. G. Eisenhauer, F. Bustamante and K. Schwan, "Native Data Representations: An Efficient Wire Format for High Performance Computing", IEEE Transactions on Parallel and Distributed Systems, Vol. 13, No. 12, pp. 1234-1246, 2002.
8. W. Feng, M. Broxton, A. Engelhart and G. Hurwitz, "MAGNeT: A Tool for Debugging, Analysis and Reflection in Computing Systems", in 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003.
9. I. Foster and C. Kesselman, "Computational Grids", in The Grid: Blueprint for a New Computing Infrastructure, Chapter 2, Morgan Kaufmann Publishers, 1999.
10. I. Foster, C. Kesselman and S. Tuecke, "The Anatomy of the Grid: Enabling Scalable Virtual Organizations", International Jounal of Supercomputer Applications, Vol. 15, No. 3, 2001.
11. R. Fowler, A. Cox, S. Elnikety and W. Zwaenepoel, "Using Performance Reflection in Systems Software", in HotOS IX: Ninth Workshop on Hot Topics in Operating, Lihue, Hawaii, USA, 2003.
12. GANGLIA, "Ganglia Toolkit: A Distributed Monitoring and Execution System". http://ganglia.sourceforge.net/
13. C. Glasner, R. Huegl, B. Reitinger, D. Kranzmueller and J. Volkert, "The Monitoring and Steering Environment", in Proceedings of the International Conference on Computational Science (ICCS), San Francisco, CA, 2001, pp. 781-790.
14. W. Gu, G. Eisenhauer, K. Schwan and J. Vetter, "Falcon: On-line Monitoring and Steering of Large-Scale Parallel Programs", Concurrency: Practice and Experience, Vol. 6, No. 2, 1998.
15. S.M. Inc, "RPC: Remote Procedure Call Protocol Specification Version 2", 1988. http://www.ietf.org/rfc/rfcl057.txt.
16. V. Jacobson, C. Leres and S. McCanne, "Tcpdump", Lawrence Berkeley Laboratory (LBL), Available from ftp://ee.lbl.gov/tcpdump.tar.Z.
17. J. Jancic, C. Poellabauer, K. Schwan, M. Wolf and N. Bright, "dproc - Extensible Run-Time Resource Monitoring for Cluster Applications", in Proceedings of the International Conference on Computational Science, 2002.
18. J. Leigh, G. Dawe, J. Talandis, E. He, S. Venkataraman, J. Ge, D. Sandin and T. DeFanti, "AGAVE: Access Grid Augmented Virtual Environment", in Proceedings of AccessGrid Retreat, Argonne, Illinois, 2001.
19. C. Liao, M. Martonosi and D.W. Clark, "Performance Monitoring in a Myrinet-connected Shrimp Cluster", in Proceedings of 2nd SIGMETRICS Symposium on Parallel and Distributed Tools, 1998, pp. 21-29.
20. B. Lowekamp, N. Miller, R. Karrer, T. Gross and P. Steenkiste, "Design, Implementation, and Evaluation of the Remos Network Monitoring System", Journal of Grid Computing, Vol. 1, No. 1, 2003, pp. 75-93.
21. M. Mansouri-Samani and M. Sloman, "A Generalised Event Monitoring Lanaguage for Distributed Systems", IEE/IOP/BCS Distributed Systems Engineering Journal, Vol. 4, No. 2, pp. 96-108, 1997.
22. B.P. Miller, M.D. Callaghan, J.M. Cargille, J.K. Hollingsworth, R.B. Irvin, K.L. Karavanic, K. Kunchithapadam and T. Newhall, "The Paradyn Parallel Performance Measurement Tool", IEEE Computer, Vol. 28, No. 11, pp. 37-46, 1995.
23. Z. Nemeth and V. Sunderam, "Characterizing Grids: Attributes, Definitions, and Formalisms", Journal of Grid Computing, Vol. 1, No. 1, pp. 9-23, 2003.
24. C. Poellabauer, H. Abbasi and K. Schwan, "Cooperative Runtime Management of Adaptive Applications and Distributed Resources", in Proceedings of the 10th ACM Multimedia Conference, Juan-les-Pins, France, 2002, pp. 402-411.
25. C. Poellabauer, K. Schwan, S. Agarwala, A. Gavrilovska, G. Eisenhauer, S. Pande, C. Pu and M. Wolf, "Service Morphing: Integrated Systemand Application-Level Service Adaptation in Autonomic Systems", in Proceedings of the 5th Annual International Workshop on Active Middleware Services (AMS), 2003.
26. C. Poellabauer, K. Schwan, G. Eisenhauer and J. Kong, "KECho - Event Communication for Distributed Kernel Services", in Proceedings of the International Conference on Architecture of Computing Systems (ARCS'02), Karlsruhe, Germany, 2002.
27. D.A. Reed, R.A. Aydt, R.J. Noe, P.C. Roth, K.A. Shields, B.W. Schwartz and L.F. Tavera, "Scalable Performance Analysis: The Pablo Performance Analysis Environment", in Proceedings of the Scalable Parallel Libraries Conference, 1993, pp. 104-113.
28. D. Rosu, K. Schwan and S. Yalamanchili, "FARA - A Framework for Adaptive Resource Allocation in Complex RealTime Systems", in Proceedings of the 4th IEEE Real-Time Technology and Applications Symposium (RTAS), Denver, USA, 1998, pp. 79-84.
29. D. Rosu, K. Schwan, S. Yalamanchili and R. Jha, "On Adaptive Resource Allocation for Complex Real-Time Applications", in Proceedings of the 18th IEEE Real-Time Systems Symposium (RTSS), San Francisco, USA, 1997, pp. 320-329.
30. M. Sottile and R. Minnich, "Supermon: A High-Speed Cluster Monitoring System", in Proceedings of IEEE International Conference on Cluster Computing, 2002.
31. P. Uthayopas, S. Phaisithbenchapol and K. Chongbarirux, "Building a Resources Monitoring System for SMILE Beowulf Cluster", in Proceeding of the Third International Conference/Exhibition on High Performance Computing in Asia-Pacific Region (HPC ASIA'99), Singapore, 1998.
32. M. Wolf, Z. Cai, W. Huang and K. Schwan, "SmartPointers: Personalized Scientific Data Portals in your Hand", in: Proceedings of ACM Supercomputing, 2002.