Grid harvest service: A performance system of grid computing

Journal of Parallel and Distributed Computing

Volumn 66, Issue 10, 2006, Pages 1322-1337

  Wu, Ming ^a   Sun, Xian He ^a  

^a Illinois Institute of Technology   (United States)

Author keywords

Grid computing; Performance modeling; Performance prediction and measurement; Resources sharing; Task scheduling

Indexed keywords

ALGORITHMS; LARGE SCALE SYSTEMS; MATHEMATICAL MODELS; PARALLEL PROCESSING SYSTEMS; RESOURCE ALLOCATION; SCHEDULING;

GRID COMPUTING; PERFORMANCE MODELING; PERFORMANCE PREDICTION AND MEASUREMENT; TASK SCHEDULING;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33748087133     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2006.05.008     Document Type: Article

References (48)

1. D. Abramson, R. Sosic, J. Giddy, B. Hall, Nimrod: a tool for performing parametised simulations using distributed workstations, in: Proceedings of the 4th IEEE Symposium on High Performance Distributed Computing, Virginia, August 1995, pp. 112-121.
2. A. Acharya, G. Edjlali, J. Saltz, The utility of exploiting idle workstations for parallel computation, in: Proceedings of the 1997 ACM SIGMETRICS, Seattle, Washington, 1997, pp. 225-236.
3. G. Allen, W. Benger, T. Goodale, H.-C. Hege, G. Lanfermann, A. Merzky, T. Radke, E. Seidel, J. Shalf, The Cactus Code: a problem solving environment for the Grid, in: Proceedings of the Ninth IEEE International Symposium on High Performance Distributed Computing (HPDC9), Pittsburgh, 2000.
4. Allen G., Benger W., Goodale T., Hege H.-C., Lanfermann G., Merzky A., Radke T., Seidel E., and Shalf J. Cactus tools for Grid applications. Cluster Comput. 4 (2001) 179-188
5. Amir Y., Awerbuch B., Barak A., Borgstrom R.S., and Keren A. An opportunity cost approach for job assignment in a scalable computing cluster. IEEE Trans. Parallel Distrib. Systems 11 (2000) 760-768
6. R.H. Arpaci, A.C. Dusseau, A.M. Vahdat, et al., The interaction of parallel and sequential workloads on a network of machines, in: Proceedings of ACM SIGMETRICS/Performance Joint International Conference on Measurement and Modeling of Computer Systems, Ottawa, 1995, pp. 267-278.
7. D. Bailey, T. Harris, W. Saphir, R. van der Wijngaart, A. Woo, M. Yarrow, The NAS Parallel Benchmarks 2.0, Technical Report 95-020, NASA Ames Research Center, December 1995.
8. Barak A., Guday S., and Wheeler R. The MOSIX Distributed Operating System, Load Balancing for UNIX. Lecture Notes in Computer Science vol. 672 (1993), Springer, Berlin
9. Berman F., Chien A., Cooper K., Dongarra J., et al. The GrADS project: software support for high-level Grid application development. Internat. J. High Performance Comput. Appl. 15 (2001) 327-344
10. Berman F., Wolski R., Casanova H., Cirne W., et al. Adaptive computing on the Grid using AppLeS. IEEE Trans. Parallel Distrib. Systems 14 (2003) 369-382
11. F. Berman, R. Wolski, S. Figueira, J. Schopf, G. Shao, Application-level scheduling on distributed heterogeneous networks, in: Proceedings of Supercomputing' 96, Pittsburgh, PA, November 1996.
12. Casanova H., and Dongarra J. NetSolve: a network server for solving computational science problems. Internat. J. Supercomputer Appl. High Performance Comput. 11 (1997) 212-223
13. H. Casanova, A. Legrand, D. Zagorodnov, F. Berman, Heuristics for scheduling parameter sweep applications in Grid environments, in: Proceedings of the Ninth Heterogeneous Computing Workshop, 2000, pp. 349-363.
14. H. Casanova, G. Obertelli, F. Berman, Rich Wolski, The AppLeS parameter sweep template: user-level middleware for the Grid, in: Proceedings of Super Computer 2000, Dallas, TX, November 2000.
15. Deelman E., Blythe J., Gil Y., Kesselman C., Mehta G., et al. Mapping abstract complex workflows onto Grid environments. J. Grid Comput. 1 (2003) 25-39
16. P. Dinda, D. O'Hallaron, An extensible toolkit for resource prediction in distributed systems, Technical Report CMU-CS-99-138, School of Computer Science, Carnegie Mellon University, July, 1999.
17. Dinda P., and O'Hallaron D. Host load prediction using linear models. Cluster Comput. 3 (2000) 265-280
18. Distributed Optical Testbed (DOT), 〈http://www.dotresearch.org/〉.
19. Downey A.B. A parallel workload model and its implications for processor allocation. J. Cluster Comput. 1 (1998) 133-145
20. C. Du, S. Ghosh, S. Shankar, Xian-He Sun, A runtime system for automatic rescheduling of MPI Program, in: 33rd International Conference on Parallel Processing, Montreal, Que., Canada, August 15-18, 2004.
21. Eswaradass A., Sun X.-H., and Wu M. A neural network based predictive mechanism for available bandwidth. Proceedings of the 19th International Parallel and Distributed Processing Symposium (April 2005), Denver, CO
22. Foster I., and Kesselman C. The Grid2: Blueprint for a New Computing Infrastructure (2004), Morgan-Kaufman, San Francisco, CA
23. Foster I., and Kesselman C. The Grid: Blueprint for a New Computing Infrastructure (1999), Morgan Kaufmann, San Francisco, CA
24. Foster I., and Iamnitchi A. On death, taxes, and the convergence of peer-to-peer and Grid computing. Proceedings of the Second International Workshop on Peer-to-Peer Systems (2003), Berkeley, CA
25. I. Foster, C. Kesselman, J. Nick, S. Tuecke, The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Open Grid Service Infrastructure WG, Global Grid Forum, June 22, 2002.
26. Foster I., Roy A., and Sander V. A quality of service architecture that combines resource reservation and application adaptation. Proceedings of the Eighth International Workshop on Quality of Service (2000), Pittsburgh, PA 181-188
27. Frey J., Tannenbaum T., Foster I., and Tuecke S. Condor-G: a computation management agent for multi-institutional Grids. Proceedings of the 10th IEEE Symposium on High Performance Distributed Computing (August 2001), San Francisco, CA
28. Globus Toolkit, 〈http://www.globus.org/toolkit/〉.
29. Gong L., Sun X.-H., and Waston E.F. Performance modeling and prediction of non-dedicated network computing. IEEE Trans. Comput. 51 (2002) 1041-1055
30. Harchol-Balter M., and Downey A. Exploiting process lifetime distributions for dynamic load balancing. ACM Trans. Comput. Systems 15 (1997) 253-285
31. Jain R. The Art of Computer Systems Performance Analysis (1992), Wiley, New York
32. J.A. Kaplan, M.K. Nelson, A comparison of queuing, cluster, and distributed computing systems, NASA TM 109025, June 1994.
33. Kleinrock L., and Korfhage W. Collecting unused processing capacity: an analysis of transient distributed systems. IEEE Trans. Parallel Distrib. Systems 4 (1993) 535-546
34. T. Kosar, M. Livny, Stork: making data placement a first class citizen in the Grid, in: Proceedings of the 24th IEEE International Conference on Distributed Computing Systems, Tokyo, Japan, March 2004.
35. Leutenegger S.T., and Sun X.-H. Limitations of cycle stealing of parallel processing on a network of homogeneous machines. J. Parallel Distrib. Comput. 43 (1997) 169-178
36. Lewis M.J., and Grimshaw A. The core Legion object model. Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing (August 1996), IEEE Computer Society Press, Los Alamitos, California
37. M. Litzkow, M. Livny, M. Mutka, Condor-a hunter of idle workstations, in: Proceedings of the Eighth International Conference of Distributed Computing Systems, San Jose, 1988, pp. 104-111.
38. Miller B.P., Callaghan M.D., et al. The Paradyn parallel performance measurement tools. IEEE Computer 28 (1995) 37-46
39. Mutka M., and Livny M. The available capacity of a privately owned machine environment. Performance Evaluation 12 (1991) 269-284
40. R. Raman, M. Livny, M. Solomon, Matchmaking: distributed resource management for high throughput computing, in: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing, Chicago, IL, July 28-31, 1998.
41. S. Shende, A.D. Malony, J. Cuny, K. Lindlan, P. Beckman, S. Karmesin, Portable profiling and tracing for parallel scientific applications using C ++, in: Proceedings of SPDT'98: ACM SIGMETRICS Symposium on Parallel and Distributed Tools, Welches, Oregon, August 1998, pp. 134-145.
42. Sun X.-H., and Wu M. Grid Harvest Service: A system for long-term, application-level task scheduling. Proceedings of 2003 IEEE International Parallel and Distributed Processing Symposium (April 2003), Nice, France
43. Taylor V., Wu X., Geisler J., and Stevens R. Using kernel couplings to predict parallel application performance. Proceedings of the 11th IEEE International Symposium on High-Performance Distributed Computing (2002), Edinburgh, Scotland
44. Truong H.L., Fahringer T., Madsen G., Malony A.D., Moritsch H., and Shende S. On using SCALEA for performance analysis of distributed and parallel programs. Proceedings of the ACM/IEEE SC2001 Conference. Denver, CO, USA (November 2001)
45. Vilalta R., Apte C.V., Hellerstein J.L., Ma S., and Weiss S.M. Predictive algorithms in the management of computer system. IBM Systems J. 41 (2002) 461-474
46. Wolski R. Dynamically forecasting network performance using the network weather service. Cluster Computing 1 (1998) 119-132
47. Wolski R., Spring N.T., and Hayes J. The network weather service: a distributed resource performance forecasting service for metacomputing. J. Future Generation Comput. Systems 15 (1999) 757-768
48. Wu M., and Sun X.-H. A general self-adaptive task scheduling system for non-dedicated heterogeneous computing. Proceedings of IEEE Cluster Computing Conference. Hong Kong (2003) 354-361