Legion: Lessons learned building a grid operating system

Proceedings of the IEEE

Volumn 93, Issue 3, 2005, Pages 589-603

  Grimshaw, Andrew S ^a   Natrajan, Anand ^a  

^a University of Virginia   (United States)

Author keywords

Distributed object system; Grid; Grid architecture; Grid design philosophy; Large scale distributed system; Metaoperating systems; Metasystems

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER OPERATING SYSTEMS; EMBEDDED SYSTEMS; INFORMATION MANAGEMENT; MIDDLEWARE; SOCIETIES AND INSTITUTIONS; VIRTUAL REALITY;

DISTRIBUTED OBJECT SYSTEM; GRID; GRID ARCHITECTURE; GRID DESIGN PHILOSOPHY; LARGE-SCALE DISTRIBUTED SYSTEM; METAOPERATING SYSTEMS; METASYSTEMS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 20744459746     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2004.842764     Document Type: Conference Paper

References (98)

1. S. Wells, Legion 1.8 Basic User Manual. Charlottesville, VA: Dept. Comput. Sci., Univ. Virginia, 2003.
2. _, Legion 1.8 System Administrator Manual. Charlottesville, VA: Dept. Comput. Sci., Univ. Virginia, 2003.
3. A. Natrajan, M. A. Humphrey, and A. S. Grimshaw, "Grid resource management in Legion," in Grid Resource Management: State of the Art and Future Trends, J. Nabrzyski and J. M. Schopf, Eds. Norwell, MA: Kluwer, 2003.
4. S. J. Chapin et al., "Resource management in Legion," J. Future Gener. Comput. Syst., vol. 15, pp. 583-594, 1999.
5. B. White et al., "LegionFS: A secure and scalable file system supporting cross-domain high-performance applications," presented at the Supercomputing Conf. '01, Denver, CO.
6. S. J. Chapin et al., "A new model of security for metasystems," J. Future Gener. Comput. Syst., vol. 15, pp. 713-722, 1999.
7. D. Katramatos et al., "JobQueue: A computational grid-wide queuing system," in Lecture Notes in Computer Science, Grid Computing-GRID 2001. Heidelberg, Germany: Springer-Verlag, 2001, vol. 2242, pp. 99-110.
8. A. Natrajan et al., "The Legion grid portal," Concurrency Comput. Pract. Exper. (Special Issue on Grid Computing Environments), vol. 14, no. 13-15, pp. 1365-1394, 2002.
9. M. J. Lewis et al., "Support for extensibility and site autonomy in the Legion grid system object model," J. Parallel Distrib. Comput., vol. 63, pp. 525-538, 2003.
10. M. J. Lewis and A. S. Grimshaw, "The core Legion object model," presented at the Symp. High Performance Distributed Computing (HPDC-5), Syracuse, NY, 1996.
11. C. L. Viles et al., "Enabling flexibility in the Legion run-time library," presented at the Int. Conf. Parallel and Distributed Processing Techniques and Applications (PDPTA'97), Las Vegas, NV.
12. M. Morgan, "Post mortem debugger for Legion," M.S. thesis, Univ. Virginia, Charlottesville, 1999.
13. A. Nguyen-Tuong and A. S. Grimshaw, "Using reflection for incorporating fault-tolerance techniques into distributed applications," Parallel Process. Lett., vol. 9, no. 2, pp. 291-301, 1999.
14. A. Nguyen-Tuong, "Integrating fault-tolerance techniques into grid applications," Ph.D. dissertation, Dept. Comput. Sci., Univ. Virginia, Charlottesville, 2000.
15. J. F. Karpovich, A. S. Grimshaw, and J. C. French, "Extensible file systems (ELFS): An object-oriented approach to high performance file I/O," presented at the ACM Conf. Object-Oriented Programming, Systems, Languages, and Applications '94, Portland, OR.
16. A. Nguyen-Tuong, A. S. Grimshaw, and M. Hyett, "Exploiting data-flow for fault-tolerance in a wide-area parallel system," in Proc. 15th Int. Symp. Reliable and Distributed Systems, 1996, pp. 1-11.
17. W. Wulf, C. Wang, and D. Kienzle, "A new model of security for distributed systems," Dept. Comput. Sci., Univ. Virginia, Charlottesville, Tech. Rep. CS-95-34, 1995.
18. A. J. Ferrari et al., "A flexible security system for metacomputing environments," presented at the 7th Int. Conf. High-Performance Computing and Networking Europe (HPCN'99), Amsterdam, The Netherlands, 1999.
19. M. Humphrey et al., "Accountability and control of process creation in metasystems," presented at the 2000 Network and Distributed Systems Security Conf. (NDSS'00), San Diego, CA.
20. L. Smarr and C. E. Catlett, "Metacomputing," Commun. ACM, vol. 35, no. 6, pp. 44-52, 1992.
21. A. S. Grimshaw et al., "Metasystems," Commun. ACM, vol. 41, no. 11, pp. 46-55, 1998.
22. A. S. Grimshaw et al., "Metasystems: An approach combining parallel processing and heterogeneous distributed computing systems," J. Parallel Distrib. Comput., vol. 21, no. 3, pp. 257-270, 1994.
23. A. S. Grimshaw, "Enterprise-wide computing," Science, vol. 256, pp. 892-894, 1994.
24. I. Foster and C. Kesselman, The Grid: Blueprint for a New Computing Infrastructure. San Francisco, CA: Morgan Kaufmann, 1999.
25. F. Berman, G. C. Fox, and A. J. G. Hey, Grid Computing: Making the Global Infrastructure a Reality, ser. Wiley Series in Communication Networking and Distributed Systems. New York: Wiley, 2003.
26. A. Natrajan et al., "Studying protein folding on the grid: Experiences using CHARMM on NPACI resources under Legion," Concurrency Comput. Pract. Exper. (Special Issue on Grid Computing Environments 2003), vol. 16, no. 4, pp. 385-397, 2004.
27. A. Natrajan, M. Humphrey, and A. Grimshaw, "Capacity and capability computing using Legion," presented at the 2001 Int. Conf. Computational Science, San Francisco, CA, 2001.
28. A. Natrajan, M. Humphrey, and A. S. Grimshaw, "The Legion support for advanced parameter-space studies on a grid," Future Gener. Comput. Syst., vol. 18, pp. 1033-1052, 2002.
29. _, "Grids: Harnessing geographically-separated resources in a multi-organizational context," presented at the 15th Annu. Symp. High Performance Computing Systems and Applications, Windsor, ON, Canada, 2001.
30. A. Ferrari and A. Grimshaw, "Basic Fortran support in Legion," Dept. Comput. Sci., Univ. Virginia, Charlottesville, Tech. Rep. CS-98-11, 1998.
31. M. Humphrey et al., "Legion MPI: High performance in secure, cross-MSRC, cross-architecture MPI applications," presented at the 2001 DoD HPC Users Group Conf., Biloxi, Mississippi, 2001.
32. Avaki Corp. [Online]. Available: http://www.avaki.com/
33. S. J. Chapin, D. Katramatos, J. F. Karpovich, and A. S. Grimshaw et al., "The Legion resource management system," in Lecture Notes in Computer Science, Job Scheduling Strategies for Parallel Processing, Heidelberg, Germany: Springer-Verlag, 1999, vol. 1659, pp. 162-178.
34. A. J. Ferrari, S. J. Chapin, and A. S. Grimshaw, "Heterogeneous process state capture and recovery through process introspection," Cluster Comput., vol. 3, no. 2, pp. 63-73, 2000.
35. A. Grimshaw, "Meta-systems: An approach combining parallel processing and heterogeneous distributed computing systems," presented at the 6th Int. Parallel Processing Symp. Workshop Heterogeneous Processing, Beverly Hills, CA, 1992.
36. A. S. Grimshaw and W. A. Wulf, "Legion - A view from 50000 feet," in Proc. 5th IEEE Int. Symp. High Performance Distributed Computing, 1996, p. 89.
37. _, "Legion flexible support for wide-area computing," presented at the 7th ACM SIGOPS Eur. Workshop, Connemara, Ireland, 1996.
38. _, "The Legion vision of a worldwide virtual computer," Commun. ACM, vol. 40, no. 1, pp. 39-45, 1997.
39. A. S. Grimshaw et al., "Campus-wide computing: Early results using Legion at the university of Virginia," Int. J. Supercomput. Appl., vol. 11, no. 2, pp. 129-143, 1997.
40. A. S. Grimshaw et al., "Wide-area computing: Resource sharing on a large scale," IEEE Computer, vol. 32, no. 5, pp. 29-37, May 1999.
41. A. S. Grimshaw et al., "Architectural support for extensibility and autonomy in wide-area distributed object systems," presented at the 2000 Network and Distributed Systems Security Conf. (NDSS'00), San Diego, CA.
42. A. S. Grimshaw et al., "From Legion to Avaki: The persistence of vision," in Grid Computing: Making the Global Infrastructure a Reality, ser. Wiley Series in Communication Networking and Distributed Systems, F. Berman, G. Fox, and T. Hey, Eds. New York: Wiley, 2003.
43. A. Grimshaw, "Avaki data grid-Secure transparent access to data," in Grid Computing: A Practical Guide to Technology And Applications, A. Abbas, Ed. Hingham, MA: Charles River Media, 2003.
44. A. S. Grimshaw, M. A. Humphrey, and A. Natrajan, "A philosophical and technical comparison of Legion and globus," IBM J. Res. Develop., vol. 48, no. 2, pp. 233-254, 2004.
45. B. White, A. Grimshaw, and A. Nguyen-Tuong, "Grid based file access: The Legion I/O model," presented at the Symp. High Performance Distributed Computing (HPDC-9), Pittsburgh, PA, 2000.
46. B. Clarke and M. Humphrey, "Beyond the "Device as portal": Meeting the requirements of wireless and mobile devices in the Legion grid computing system," presented at the 2nd Int. Workshop Parallel and Distributed Computing Issues in Wireless Networks and Mobile Computing (associated with IPDPS 2002), Ft. Lauderdale, FL, 2002.
47. H. Dail et al., "Application-aware scheduling of a magnetohydro-dynamics application in the Legion metasystems," presented at the Int. Parallel Processing Symp. Workshop Heterogeneous Processing, Cancun, Mexico, 2000.
48. E. D. Lazowska et al., "The architecture of the Eden system," in Proc. 8th Symp. Operating System Principles, 1981, pp. 148-159.
49. G. R. Andrews and F. B. Schneider, "Concepts and notions for concurrent programming," ACM Comput. Surv., vol. 15, no. 1, pp. 3-44, 1983.
50. W. F. Applebe and K. Hansen, "A survey of systems programming languages: Concepts and facilities," Softw. Pract. Exper., vol. 15, no. 2, pp. 169-190, 1985.
51. H. Bai, J. Steiner, and A. Tanenbaum, "Programming languages for distributed computing systems," ACM Comput. Surv., vol. 21, no. 3, pp. 261-322, 1989.
52. R. Ben-Naten, CORBA: A Guide to the Common Object Request Broker Architecture. New York: McGraw-Hill, 1995.
53. B. N. Bershad and H. M. Levy, "Remote computation in a heterogeneous environment," Dept. Comput. Sci., Univ. Washington, Seattle, Tech. Rep. 87-06-04, 1987.
54. B. N. Bershad, E. D. Lazowska, and H. M. Levy, "Presto: A system for object-oriented parallel programming," Softw. Pract. Exper., vol. 18, no. 8, pp. 713-732, 1988.
55. A. Black et al., "Distribution and abstract types in Emerald," Univ. Washington, Seattle, Tech. Rep. 85-08-05, 1985.
56. T. L. Casavant and J. G. Kuhl, "A taxonomy of scheduling in general-purpose distributed computing systems," IEEE Trans. Softw. Eng., vol. 14, no. 2, pp. 141-154, Feb. 1988.
57. R. Chin and S. Chanson, "Distributed object-based programming systems," ACM Comput. Surv., vol. 23, no. 1, pp. 91-127, 1991.
58. Object Management Group, "The common object request broker: Architecture and specification,", Needham, MA, OMG Doc. No. 93.xx.yy, Revision 1.2, Draft 29, 1993.
59. D. L. Eager, E. D. Lazowska, and J. Zahorjan, "A comparison of receiver-initiated and sender-initiated adaptive load sharing," Perform. Eval. Rev., vol. 6, pp. 53-68, 1986.
60. _, "Adaptive load sharing in homogeneous distributed systems," IEEE Trans. Softw. Eng., vol. SE-12, no. 5, pp. 662-675, May 1986.
61. _, "The limited performance benefits of migrating active processes for load sharing," Perform. Eval. Rev., vol. 16, pp. 63-72, 1986.
62. _, "Speedup versus efficiency in parallel systems," IEEE Trans. Comput., vol. 38, no. 3, pp. 408-423, Mar. 1989.
63. J. A. Feldman, "High level programming for distributed computing," Commun. ACM, vol. 22, no. 6, pp. 353-368, 1979.
64. P. B. Gibbond, "A stub generator for multi-language RFC in heterogeneous environments," IEEE Trans. Softw. Eng., vol. SE-13, no. 1, pp. 77-87, Jan. 1987.
65. A. Hac, "Load balancing in distributed systems: A summary," Perform. Eval. Rev., vol. 16, pp. 17-25, 1989.
66. C. A. R. Hoare, "Monitors: An operating system structing concept," Commun. ACM, vol. 17, no. 10, pp. 549-557, 1974.
67. R. H. LeBlanc and C. T. Wilkes, "Systems programming with objects and actions," in Proc. 7th Int. Conf. Distributed Computer Systems, 1985, pp. 132-138.
68. E. Levy and A. Silberschatz, "Distributed file systems: Concepts and examples," ACM Comput. Surv., vol. 22, no. 4, pp. 321-374, 1990.
69. B. Liskov and R. Scheifler, "Guardians and actions: Linguistic support for robust, distributed programs," ACM Trans. Program. Lang. Syst., vol. 5, no. 3, pp. 381-414, 1983.
70. B. Liskov and L. Shrira, "Promises: Linguistic support for efficient asynchronous procedure calls in distributed systems," presented at the SIGPLAN'88 Conf. Programming Language Design and Implementation, Atlanta, GA.
71. F. Manola et al., "Distributed object management," Int. J. Intell. Coop. Inf. Syst., vol. 1, no. 1, 1992.
72. J. H. E. A. Morris, "Andrew: A distributed personal computing environment," Commun. ACM, vol. 29, no. 3, 1986.
73. R. Mirchandaney, D. Towsley, and J. Stankovic, "Adaptive load sharing in heterogeneous distributed systems," J. Parallel Distrib. Comput., vol. 9, pp. 331-346, 1990.
74. O. M. Nierstrasz, "Hybrid: A unified object-oriented system," IEEE Database Eng. Bull., vol. 8, no. 4, pp. 49-57, Dec. 1985.
75. D. E. A. Notkin, "Interconnecting heterogeneous computer systems," Commun. ACM, vol. 31, no. 3, pp. 258-273, 1988.
76. G. E. A. Popek, "LOCUS: A network transparent, high reliability distributed system," in Proc. 8th Symp. Operating System Principles, 1981, pp. 169-177.
77. M. L. Powell and B. P. Miller, "Process migration in DEMOS/MP," in Proc. 9th ACM Symp. Operating System Prinicples, 1983, pp. 110-119.
78. A. S. Tanenbaum and R. V. Renesse, "Distributed operating systems," ACM Comput. Surv., vol. 17, no. 4, pp. 419-470, 1985.
79. R. N. E. A. Taylor, "Foundations for the Arcadia environment architecture," in Proc. 3rd ACM SIGSOFT/SIGPLAN Symp. Practical Software Development, 1989, pp. 1-13.
80. M. M. Theimer and B. Hayes, "Heterogeneous process migration by recompilation," presented at the 11th Int. Conf. Distributed Computing Systems, Arlington, TX, 1991.
81. B. E. A. Walker, "The LOCUS distributed operating system," presented at the 9th ACM Symp. Operating Systems Principles, Bretton Woods, NH, 1983.
82. S. A. E. A. Yemini, "Concert: A heterogeneous high-level-language approach to heterogeneous distributed systems," in IEEE Int. Conf. Distributed Computing Systems, Newport, CA.
83. B. N. E. A. Bershad, "A remote procedure call facility for interconnecting heterogeneous computer systems," IEEE Trans. Software. Eng., vol. SE-13, no. 8, pp. 880-894, Aug. 1987.
84. M. Satyanarayanan, "Scalable, secure, and highly available distributed file access," IEEE Computer, vol. 23, no. 5, pp. 9-21, May 1990.
85. R. H. Campbell et al., "Principles of object oriented operating system design," Dept. Comput. Sci., Univ. Illinois, Urbana, Tech. Rep. R89-1510, 1989.
86. A. Chervenak et al., "The data grid: Toward an architecture for the distributed management and analysis of large scientific datasets," J. Netw. Comput. Appl., vol. 23, pp. 187-200, 2001.
87. I. Foster et al., "Software infrastructure for the I-WAY high performance distributed computing experiment," in 5th IEEE Symp. High Performance Distributed Computing, 1997, pp. 562-571.
88. Globus Project. Globus.
89. K. Czajkowski, "A resource management architecture for metacomputing systems," in Proc. IPPS/SPDP'98 Workshop Job Scheduling Strategies for Parallel Processing, pp. 62-82.
90. K. Czajkowski, I. Foster, and C. Kesselman, "Co-allocation services for computational grids," presented at the 8th IEEE Symp. High Performance Distributed Computing, Redondo Beach, CA, 1999.
91. K. Czajkowski et al., "SNAP: A protocol for negotiating service level agreements and coordinating resource management in distributed systems," in Lecture Notes in Computer Science, Job Scheduling Strategies for Parallel Processing, 2002, vol. 2537, pp. 153-183.
92. K. Czajkowski et al., "Agreement-based service management (WS-agreement)," Global Grid Forum, draft-ggf-graap-agreement-1, 2004.
93. I. Foster and C. Kesselman, "Globus: A metacomputing infrastructure toolkit," Int. J. Supercomput. Appl., vol. 11, no. 2, pp. 115-128, 1997.
94. Legion Web pages (1997). [Online]. Available: http://www.legion. virginia.edu
95. A. S. Grimshaw, J. B. Weissman, and W. T. Strayer, "Portable runtime support for dynamic object-oriented parallel processing," ACM Trans. Comput. Syst., vol. 14, no. 2, pp. 139-170, 1996.
96. P.-C. Yew, N.-F. Tzeng, and D. H. Lawrie, "Distributing hot-spot addressing in large-scale multiprocessors," IEEE Trans. Comput., vol. C-36, no. 4, pp. 388-395, Apr. 1987.
97. G. Stoker et al., "Toward realizable restricted delegation in computational grids," presented at the Int. Conf. High Performance Computing and Networking Europe (HPCN Eur. 2001), Amsterdam, The Netherlands, 2001.
98. A. S. Grimshaw, "The ROI case for grids," Grid Today, vol. 1, no. 27, 2002.