Satin: A high-level and efficient grid programming model

ACM Transactions on Programming Languages and Systems

Volumn 32, Issue 3, 2010, Pages

  Van Nieuwpoort, Rob V ^a   Wrzesńiska, Gosia ^b   Jacobs, Ceriel J H ^a   Bal, Henri E ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b Pointlogic Development   (Netherlands)

Author keywords

Divide and conquer; Grid computing; Programming model

Indexed keywords

ADAPTIVITY; COMPUTATIONAL GRIDS; COMPUTE RESOURCES; CONSISTENCY MODEL; DIVIDE-AND-CONQUER; DYNAMIC LOAD BALANCING; EFFICIENT IMPLEMENTATION; EXCELLENT PERFORMANCE; GRID PROBLEMS; GRID PROGRAMMING MODELS; HIGH-LEVEL PROGRAMMING MODELS; LARGE SYSTEM; MODEL SCALE; NETWORKING ENVIRONMENT; PARALLEL GRIDS; PARALLEL PROGRAM; PERFORMANCE PENALTIES; PROGRAMMING MODELS; RUNTIME SYSTEMS; SHARED OBJECTS; WIDE AREA; WIDE-AREA COMMUNICATION;

COMPUTATIONAL EFFICIENCY; DATA FLOW ANALYSIS; GRID COMPUTING; JAVA PROGRAMMING LANGUAGE; MULTITASKING; NETWORK MANAGEMENT; PARALLEL ARCHITECTURES; PARALLEL PROGRAMMING; PROBLEM SOLVING; SCHEDULING ALGORITHMS; SILK;

COMPUTER SYSTEMS PROGRAMMING;

EID: 77949562027     PISSN: 01640925     EISSN: 15584593     Source Type: Journal    
DOI: 10.1145/1709093.1709096     Document Type: Article

References (73)

1. ADRIAANS, P. AND JACOBS, C. 2006. Using MDL for grammar induction. In 8th International Colloquium on Grammatical Inference (ICGI'06).
2. ARNOLD, D., AGRAWAL, S., BLACKFORD, S., DONGARRA, J., MILLER, M., SEYMOUR, K., SAGI, K., SHI, Z., AND VADHIYAR, S. 2002. Users' guide to NetSolve V1.4.1. Tech. rep. ICL-UL-02-05, University of Tennessee, Knoxville, TN.
3. BADIA, R. M., LABARTA, J., SIRVENT, R., PEREZ, J. M., CELA, J. M., AND GRIMA, R. 2003. Programming grid applications with GRID superscalar. J. Grid Comput. 1, 2.
4. BADUEL, L., BAUDE, F., CAROMEL, D., CONTES, A., HUET, F., MOREL, M., AND QUILICI, R. 2006. Grid Computing: Software Environments and Tools. Springer.
5. BAL, H. E., BHOEDJANG, R., HOFMAN, R., JACOBS, C., LANGENDOEN, K., RUEHL, T., AND KAASHOEK, M. F. 1998. Performance evaluation of the Orca shared object system.ACMTrans. Comput. Syst. 16, 1, 1-40.
6. BALDESCHWIELER, E. J., BLUMOFE, R., AND BREWER, E. 1996. ATLAS: An infrastructure for global computing. In Proceedings of the 7th ACM SIGOPS European Workshop on System Support for Worldwide Applications. 165-172.
7. BIRREL, A. D. ANDNIELSON, B. J. 1984. Implementing remote procedure calls. ACMTrans. Comput. Syst. 2, 1, 39-59.
8. BLACKSTON, D. AND SUEL, T. 1997. Highly portable and efficient implementations of parallel adaptive N-body methods. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC'97). http://www.supercomp.org.
9. BLUMOFE, R. D., JOERG, C. F., KUSZMAUL, B. C., LEISERSON, C. E., RANDALL, K. H., AND ZHOU., Y. 1995. Cilk: An efficient multithreaded runtime system. In Proceedings of the 5th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'95). 207-216.
10. BLUMOFE, R. D. AND LEISERSON, C. E. 1994. Scheduling multithreaded computations by work stealing. In Proceedings of the 35th Annual Symposium on Foundations of Computer Science (FOCS'94). 356-368.
11. BLUMOFE, R. D. AND LISIECKI, P. 1997. Adaptive and reliable parallel computing on networks of workstations. In Proceedings of the USENIX Annual Technical Conference on UNIX and Advanced Computing Systems. 133-147.
12. BORNEMANN, M., NIEUWPOORT, R. V. V., AND KIELMANN, T. 2005. MPJ/Ibis: A flexible and efficient message passing platform for java. In Proceedings of EuroPVM/MPI. Lecture Notes in Computer Science, vol.3666. Springer, 217-224.
13. BUTENHOF, D. 1997. Programming with POSIX Threads. Professional Computing. Addison-Wesley.
14. CAPPELLO, F. AND BAL, H. 2007. Towards an international computer science grid (keynote paper). In Proceedings of the 7th IEEE International Symposium on Cluster Computing and the Grid (CCGRID'07). 230-237.
15. CARPENTER, B., GETOV, V., JUDD, G., SKJELLUM, A., AND FOX, G. 2000. MPJ: MPI-Like message passing for Java. Concurr. Pract. Exper. 12, 11, 1019-1038.
16. CHIU, D.-M., KADANSKY, M., PROVINO, J., AND WESLEY, J. 2000. Experiences in programming a traffic shaper. In Proceedings of the 5th IEEE Symposium on Computers and Communications (ISCC'00). 470-476.
17. DANAHER, J. S., LEE, I.-T. A., AND LEISERSON, C. E. 2005. The JCilk language for multithreaded computing. In Proceedings of the Synchronization and Concurrency in Object-Oriented Languages (SCOOL). DE CARVALHO JR., S. A. AND CROCHEMORE, M. The neobio library. http:// neobio.sourceforge.net.
18. EAGER, D. L., ZAHORJAN, J., AND LAZOWSKA, E. D. 1989. Speedup versus efficiency in parallel systems. IEEE Trans. Comput. 38, 3, 408-423.
19. EICKERMANN, T., GRUND, H., AND HENRICHS, J. 1999. Performance issues of distributed MPI applicatins in a German gigabit testbed. In Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. Lecture Notes in Computer Science, vol.1697. Springer, 3-10.
20. FOSTER, I. 2006. Globus toolkit version 4: Software for service-oriented systems. In Proceedings of the IFIP International Conference on Network and Parallel Computing. Lecture Notes in Computer Science, vol.3779. Springer, 2-13.
21. FOSTER, I. AND KESSELMAN, C., EDS. 2003. Th e Grid 2: Blueprint for a New Computing Infrastructure, 2nd ed. The Morgan Kaufmann Series in Computer Architecture and Design. Morgan Kaufmann.
22. FREISLEBEN, B. AND KIELMANN, T. 1995. Automated transformation of sequential divide-and- conquer algorithms into parallel programs. Comput. Artif. Int. 14, 6, 579-596.
23. FRIGO, M., LEISERSON, C. E., AND RANDALL, K. H. 1998. The implementation of the Cilk-5 multithreaded language. In Proceedings of the SIGPLAN Conference on Programming Language Design and Implementation (PLDI'98). 212-223.
24. GABRIEL, E., RESCH, M., BEISEL, T., ANDKELLER, R. 1998. Distributed computing in a heterogeneous computing environment. In Proceedings of the 5th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. Lecture Notes in Computer Science, vol.1497, Springer, 180-187.
25. GOUX, J.-P., KULKARNI, S., YODER, M., AND LINDEROTH, J. 2000. An enabling framework for masterworker applications on the computational grid. In Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC'00). 43-50.
26. GRAHAM, R., SHIPMAN, G., BARRETT, B., CASTAIN, R., BOSILCA, G., AND LUMSDAINE, A. 2006. Open MPI: A high-performance, heterogeneous MPI. In Proceedings of the IEEE International Conference on Cluster Computing.
27. GROPP, W., LUSK, E., DOSS, N., AND SKJELLUM, A. 1996. A high-performance, portable implementation of the MPI message passing interface. Parall. Comput. 22, 6, 789-828.
28. HUANG, C., ZHENG, G., KUMAR, S., AND KALE, L. V. 2006. Performance evaluation of adaptive MPI. In Proceedings of the ACMSIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'06).
29. IWATA, S. AND KASAI, T. 1994. The Othello game on an n*n board is PSPACE-complete. Theor. Comp. Sci. 123, 123, 329-340.
30. KALE, L. V., KUMAR, S., AND DESOUZA, J. 2002. A malleable-job system for timeshared parallel machines. In Proceedings of the 2nd IEEE/ACMInternational Symposium on Cluster Computing and the Grid (CCGRID'02). 230-237.
31. KARONIS, N. T., TOONEN, B., AND FOSTER, I. 2003. MPICH-G2: A grid-enabled implementation of the message passing interface. J. Parall. Distrib. Comput. 63, 5, 551-563.
32. KIELMANN, T., HOFMAN, R. F. H., BAL, H. E., PLAAT, A., AND BHOEDJANG, R. A. F. 1999. MAGPIE:MPI's collective communication operations for clustered wide area systems. In Proceedings of the 7th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'99). 131-140.
33. KISHIMOTO, A. AND SCHAEFFER, J. 2002. Transposition table driven work scheduling in distributed game-tree search. In Proceedings of the 15th Canadian Conference on Artificial Intelligence (AI'02). Lecture Notes in Artificial Intelligence, vol.2338. Springer, 56-68.
34. KITSUREGAWA, M. 2007. The info-plosion project. In Proceedings of the IFIP International Conference on Network and Parallel Computing Workshops (NPC'07). IEEE Computer Society, 3-6.
35. LANG, K. J., PEARLMUTTER, B. A., AND PRICE, R. A. 1998. Results of the Abbadingo one DFA learning competition and a new evidence-driven state merging algorithm. V. Honavar and G. Slutzki, Eds. Lecture Notes in Artificial Intelligence, vol.1433. Springer, 1-12.
36. LEA, D. 2000. A Java Fork/Join Framework. In Proceedings of the ACMJava Grande Conference. 36-43.
37. LEE, H.-K., CARPENTER, B., FOX, G., AND LIM, S. B. 2004. HPJava: Programming support for high-performance grid-enabled applications. Int. J. Parall. Algor. Appl. 19, 2-3, 175-193.
38. LINDHOLM, T. AND YELLIN, F. 1999. Java(TM) Virtual Machine Specification, 2nd ed. Prentice Hall PTR.
39. MAASSEN, J. AND BAL, H. E. 2007. Smartsockets: Solving the connectivity problems in grid computing. In Proceedings of the 16th International Symposium on High-Performance Distributed Computing (HPDC'07). 1-10.
40. MAASSEN, J., NIEUWPOORT, R. V. V., VELDEMA, R., BAL, H., KIELMANN, T., JACOBS, C., AND HOFMAN, R. 2001. Efficient Java RMI for parallel programming. ACM Trans. Program. Lang. Syst. 23, 6, 747-775.
41. MAASSEN, J., SEINSTRA, F., KEMP, R., DROST, N., AND NIEUWPOORT, R. V. V. 2008. Going nova. The First International Data Challenge for Finding SuperNovae, held in conjunction with IEEE Cluster2008. First prize winner.
42. MARLOW, S., JONES, S. L. P.,MORAN, A., AND REPPY, J. H. 2001. Asynchronous exceptions in Haskell. In Proceedings of the SIGPLAN Conference on Programming Language Design and Implementation (PLDI). 274-285.
43. MOHR, E., KRANZ, D., AND HALSTEAD, R. 1990. Lazy task creation: A technique for increasing the granularity of parallel programs. In Proceedings of the ACM Conference on Lisp and Functional Programming. 185-197.
44. MPIF, M. P. I. F. 1996. MPI-2: Extensions to the message-passing interface. Tech. rep.University of Tennessee, Knoxville.
45. NEARY, M. O. AND CAPPELLO, P. 2002. Advanced eager scheduling for Java-based adaptively parallel computing. In Proceedings of the Joint ACMJava Grande - ISCOPE (International Symposium on Computing in Object-Oriented Parallel Environments) Conference. 56-65.
46. NIEUWPOORT, R. V. V. 2003. Efficient Java-centric grid-computing. Ph.D. thesis, Vrije Universiteit Amsterdam. http://www.cs.vu.nl/~rob/.
47. NIEUWPOORT, R. V. V., KIELMANN, T., AND BAL, H. E. 2001. Efficient load balancing for wide-area divide-and-conquer applications. In Proceedings of the 8th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'01). 34-43.
48. NIEUWPOORT, R. V. V., KIELMANN, T., AND BAL,H. E. 2007. User-Friendly and reliable grid computing based on imperfect middleware. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC'07).
49. NIEUWPOORT, R. V. V., MAASSEN, J., AGAPI, A., OPRESCU, A.-M., AND KIELMANN, T. 2006. Experiences deploying parallel applications on a large-scale grid. In Proceedings of EXPGRID - Experimental Grid Testbeds for the Assessment of Large-Scale Distributed Applications and Tools, Workshop in Conjunction with the 15th International Symposium on High Performance Distributed Computing (HPDC-15).
50. NIEUWPOORT, R. V. V., MAASSEN, J., BAL, H. E., KIELMANN, T., AND VELDEMA, R. 2000. Wide-Area parallel programming using the remote method invocation model. Concurr. Pract. Exper. 12, 8, 643-666.
51. NIEUWPOORT, R. V. V.,MAASSEN, J., KIELMANN, T., AND BAL, H. E. 2005-A. Satin: Simple and efficient Java-based grid programming. Scalable Comput. Pract. Exper. 6, 3 19-32.
52. NIEUWPOORT, R. V. V., MAASSEN, J., WRZESÍNSKA, G., HOFMAN, R., JACOBS, C., KIELMANN, T., AND BAL, H. E. 2005-B. Ibis: A flexible and efficient Java-based grid programming environment. Concurr. Comput. Pract. Exper. 17, 7-8, 1079-1107.
53. PENG, L.,WONG,W., FENG, M., AND YUEN, C. 2000. SilkRoad: A multithreaded runtime system with software distributed shared memory for SMP clusters. In Proceedings of the IEEE International Conference on Cluster Computing (Cluster'00). 243-249.
54. PLAAT, A., BAL, H. E., AND HOFMAN, R. F. 1999. Sensitivity of parallel applications to large differences in bandwidth and latency in two-layer interconnects. In Proceedings of High Performance Computer Architecture (HPCA-5). 244-253.
55. PLAAT, A., SCHAEFFER, J., PIJLS, W., AND DE BRUIN, A. 1996. Best-First fixed-depth minimax algorithms. Artif. Intell. 87, 1-2, 255-293.
56. ROBINSON, J., RUSS, S., HECKEL, B., AND FLACHS, B. 1996. A task migration implementation of the message-passing interface. In Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing (HPDC'96). IEEE Computer Society, 61-68.
57. ROMEIN, J. W., BAL, H. E., SCHAEFFER, J., AND PLAAT, A. 2002. A performance analysis of transposition-table-driven work scheduling in distributed search. IEEE Trans. Parall. Distrib. Syst. 13, 5, 447-459.
58. SEINSTRA, F., DROST, N., KEMP, R., MAASSEN, J., NIEUWPOORT, R. V. V., VERSTOEP, K., AND BAL, H. 2008. Scalable wall-socket multimedia grid computing. 1st IEEE International Scalable Computing Challenge (SCALE'08), held in conjunction with the 8th IEEE International Symposium on Cluster Computing and the Grid (CCGrid'08). First prize winner.
59. SEYMOUR, K., NAKADA, H., MATSUOKA, S., DONGARRA, J., LEE, C., AND CASANOVA, H. 2002. Overview of GridRPC: A remote procedure call API for grid computing. In Proceedings of the International Workshop on Grid Computing (GRID02). Lecture Notes in Computer Science, vol.2536. Springer, 274-278.
60. SLATE, D. AND ATKIN, L. 1977. Chess 4.5 -The Northwestern Univeristy chess program. Chess Skill Man Mach. 82-118.
61. SMITH, T. AND WATHERMAN, M. 1981. Identification of common molecular subsequences. J. Molec. Biol. 147, 195-197.
62. SUN MICROSYSTEMS. 2008. Java Remote Method Invocation Specification. http://java.sun.com/javase/technologies/core/basic/rmi.
63. TANAKA, Y., NAKADA, H., SEKIGUCHI, S., SUZUMURA, T., AND MATSUOKA, S. 2003. Ninf-G: A reference implementation of RPC-based programming middleware for grid computing. J. Grid Comput. 1, 1, 41-51.
64. TAURA, K., ENDO, T., KANEDA, K., AND YONEZAWA, A. 2003. Phoenix : A parallel programming model for accommodating dynamically joining/leaving resources. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'03). 216-229.
65. VADHIYAR, S. S. AND DONGARRA, J. J. 2005. Self adaptivity in grid computing. Concurr. Comput. Pract. Exper. 17, 2-4, 235-257.
66. VERSTOEP, K., MAASSEN, J., BAL, H. E., AND ROMEIN, J. W. 2008. Experiences with fine-grained distributed supercomputing on a 10g testbed. In Proceedings of the 8th IEEE International Symposium on Cluster Computing and the Grid (CCGRID). 376-383.
67. WALDO, J. 1998. Remote procedure calls and java remote method invocation. IEEE Concurr. 6, 3, 5-7.
68. WOLLRATH, A., WALDO, J., AND RIGGS, R. 1997. Java-Centric distributed computing. IEEE Micro 17, 3, 44-53.
69. WOLSKI, R., SPRING, N., AND HAYES, J. 1999. The network weather service: A distributed resource performance forecasting service for metacomputing. J. Future Gener. Comput. Syst. 15, 5-6, 757-768.
70. WRZESÍNSKA, G., MAASSEN, J., AND BAL, H. E. 2007-A. Self-Adaptive applications on the grid. In Proceedings of ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'07).
71. WRZESÍNSKA, G., MAASSEN, J., VERSTOEP, K., AND BAL, H. E. 2007-B. Satin++: Divide-and-share on the grid. In Proceedings of the 2nd IEEE International Conference on e-Science and Grid Computing.
72. WRZESÍNSKA, G., NIEUWPOORT, R. V. V., MAASSEN, J., AND BAL, H. E. 2005. Fault-Tolerance, malleability and migration for divide-and-conquer applications on the grid. In Proceedings of the 19th International Parallel and Distributed Processing Symposium (IPDPS).
73. WRZESÍNSKA, G., OPRESCU, A.-M., KIELMANN, T., AND BAL, H. 2007-C. Persistent fault-tolerance for divide-and-conquer applications on the grid. In Proceedings of the CoreGRID Symposium. 230-237.