Grid resource monitoring and selection for rapid turnaround applications

IEICE Transactions on Information and Systems

Volumn E89-D, Issue 9, 2006, Pages 2491-2501

  Muraki, Kensuke ^a,c   Kawasaki, Yasuhiro ^a   Mizutani, Yasuharu ^b   Ino, Fumihiko ^a   Hagihara, Kenichi ^a  

^a OSAKA UNIVERSITY   (Japan)

^b OSAKA INSTITUTE OF TECHNOLOGY   (Japan)

^c Nintendo Inc   (Japan)

Author keywords

Evaluation; Grid computing; Rapid turnaround; Resource management

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; MATHEMATICAL MODELS; MONITORING; RESOURCE ALLOCATION; SCHEDULING; WIDE AREA NETWORKS;

GRID COMPUTING; RAPID TURNAROUND; RESOURCE MANAGEMENT; RESOURCE SELECTION TIME;

COMPUTER APPLICATIONS;

EID: 33748765223     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1093/ietisy/e89-d.9.2491     Document Type: Article

References (36)

1. I. Foster and C. Kesselman, eds., The Grid 2: Blueprint of a New Computing Infrastructure, second ed., Morgan Kaufmann, San Mateo, CA, 2003.
2. I. Foster, "What is the grid? a three point checklist," 2002. http://www-fp.mcs.anl.gov/%7Efoster/Articles/WhatIsTheGrid.pdf
3. W.T. Sullivan, D. Werthimer, S. Bowyer, J. Cobb, D. Gedye, and D. Anderson, "A new major SETI project based on project serendip data and 100,000 personal computers," Proc. 5th Int. Conf. Bioastronomy, p.729, Jan. 1997.
4. A. Chien, B. Calder, S. Elbert, and K. Bhatia, "Entropia: Architecture and performance of an enterprise desktop grid system," J. Parallel Distrib. Comput., vol.63, no.5, pp.597-610, May 2003.
5. M.J. Litzkow, M. Livny, and M.W. Mutka, "Condor - A hunter of idle workstations," Proc. 8th Int. Conf. Distributed Computing Systems (ICDCS'88), pp.104-111, June 1988.
6. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, "The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets," J. Network and Computer Applications, vol.23, no.3, pp. 187-200, July 2000.
7. W. Hoschek, J. Jaen-Martinez, A. Samar, H. Stockinger, and K. Stockinger, "Data management in an international data grid project," Proc. 1st IEEE/ACM Int. Workshop Grid Computing (GRID'00), pp.77-90, Dec. 2000.
8. The DataGrid Project, http://www.edg.org/
9. I. Foster and C. Kesselman, "Globus: A metacomputing infrastructure toolkit," Int. J. Supercomputer Applications and High Performance Computing, vol.11, no.2, pp.115-128, 1997.
10. A.S. Grimshaw, W.A. Wulf, and the Legion team, "The Legion vision of a worldwide virtual computer," Commun. ACM, vol.40, no.1, pp.39-45, Jan. 1997.
11. J. Nabrzyski, J.M. Schopf, and J. Wȩglarz, eds., Grid Resource Management: State of the Art and Future Trends, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2003.
12. X. Zhang, J.L. Freschl, and J.M. Schopf, "A performance study of monitoring and information services for distributed systems," Proc. 12th IEEE Int. Symp. High Performance Distributed Computing (HPDC'03), pp.270-282, June 2003.
13. D. Kondo, A. Chien, and H. Casanova, "Resource management for rapid application turnaround on enterprise desktop grids," Proc. High Performance Networking and Computing Conf. (SC2004), Nov. 2004.
14. Y. Kawasaki, F. Ino, Y. Mizutani, N. Fujimoto, T. Sasama, Y. Sato, N. Sugano, S. Tamura, and K. Hagihara, "High-performance computing service over the Internet for intraoperative image processing," IEEE Trans. Inf. Technol. Biomed., vol.8, no.1, pp.36-46, March 2004.
15. K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman, "Grid information services for distributed resource sharing," Proc. 10th IEEE Int. Symp. High Performance Distributed Computing (HPDC'01), pp.181-194, Aug. 2001.
16. Y. Tanaka, H. Nakada, S. Sekiguchi, T. Suzumura, and S. Matsuoka, "Ninf-G: A reference implementation of RPC-based programming middleware for grid computing," J. Grid Computing, vol.1, no.1, pp.41-51, March 2003.
17. W. Smith, "A system for monitoring and management of computational grids," Proc. 31st Int. Conf. Parallel Processing (ICPP'02), pp.55-62, Aug. 2002.
18. M.H. Haji, I. Gourlay, K. Djemame, and P.M. Dew, "A SNAP-based community resource broker using a three-phase commit protocol: A performance study," Comput. J., vol.48, no.3, pp.333-346, May 2005.
19. I. Foster, C. Kesselman, and S. Tuecke, "The anatomy of the grid: Enabling scalable virtual organizations," Int. J. High Performance Computing Applications, vol.15, no.3, pp.200-222, 2001.
20. R. Buyya, ed., High Performance Cluster Computing, Prentice Hall PTR, Upper Saddle River, NJ, June 1999.
21. MDS 2.2 GRIS Specification Document, "Creating new information provider," 2003. http://www.globus.Org/toolkit/docs/2.4/mds/ creating_new_providers.pdf
22. W. Allcock, "GridFTP: Protocol extensions to FTP for the Grid," Global Grid Forum Recommendation GFD.20, April 2003.
23. The Network Simulator - ns-2 -. http://www.isi.edu/nsnam/ns/
24. M. Mathis, J. Mahdavi, S. Floyd, and A. Romanow, "TCP selective acknowledgement options," RFC (Request for comments) 2018, Oct. 1996.
25. A. Cooke, A. Gray, W. Nutt, J. Magowan, M. Oevers, P. Taylor, R. Cordenonsi, R. Byrom, L. Cornwall, A. Djaoui, L. Field, S. Fisher, S. Hicks, J. Leake, R. Middleton, A. Wilson, X. Zhu, N. Podhorszki, B. Coghlan, S. Kenny, and D. O'Callaghan, "The relational grid monitoring architecture: Mediating information about the Grid," J. Grid Computing, vol.2, no.4, pp.323-339, Dec. 2004.
26. Hawkeye. http://www.cs.wisc.edu/condor/hawkeye/
27. R. Raman, M. Livny, and M. Solomon, "Matchmaking: An extensible framework for distributed resource management," Cluster Computing, vol.2, no.2, pp.129-138, 1999.
28. C. Liu, L. Yang, I. Foster, and D. Angulo, "Design and evaluation of a resource selection framework for grid applications," Proc. 11th IEEE Int. Symp. High Performance Distributed Computing (HPDC'02), pp.63-72, July 2002.
29. W. Allcock, J. Bester, J. Bresnahan, I. Foster, and J. Gawor, "GridMapper: A tool for visualizing the behavior of large-scale distributed systems," Proc. 11th IEEE Int. Symp. High Performance Distributed Computing (HPDC'02), pp. 163-170, July 2002.
30. M.L. Massie, B.N. Chun, and D.E. Culler, "The ganglia distributed monitoring system: Design, implementation, and experience," Parallel Comput., vol.30, no.7, pp.817-840, July 2004.
31. V. Talwar, S. Basu, and R. Kumar, "Architecture and environment for enabling Interactive Grids," J. Grid Computing, vol.1, no.3, pp.231-250, Sept. 2003.
32. R. Wismüller, M. Bubak, W. Funika, and B. Baliś, "A performance analysis tool for interactive applications on the Grid," Int. J. High Performance Computing Applications, vol.18, no.3, pp.305-316, 2004.
33. J.S. Vetter and D.A. Reed, "Real-time performance monitoring, adaptive control, and interactive steering of computational grids," Int. J. High Performance Computing Applications, vol.14, no.4, pp.357-366, 2000.
34. D. Gunter, B. Tierney, K. Jackson, J. Lee, and M. Stoufer, "Dynamic monitoring of high-performance distributed applications," Proc. 11th IEEE Int. Symp. High Performance Distributed Computing (HPDC'02), pp. 163-170, July 2002.
35. S. Agarwala, C. Poellabauer, J. Kong, K. Schwan, and M. Wolf, "Resource-aware stream management with the customizable dproc distributed monitoring mechanisms," Proc. 12th IEEE Int. Symp. High Performance Distributed Computing (HPDC'03), pp.250-259, June 2003.
36. K. Kaneda, K. Taura, and A. Yonezawa, "Virtual private grid: A command shell for utilizing hundreds of machines efficiently," Future Generation Computer Systems, vol.19, no.4, pp.563-573, May 2003.