Towards jungle computing with Ibis/Constellation

3DAPAS'11 - Proceedings of the Workshop on Dynamic Distributed Data-Intensive Applications, Programming Abstractions and Systems

Volumn , Issue , 2011, Pages 7-18

  Maassen, Jason ^a   Drost, Niels ^a   Bal, Henri E ^a   Seinstra, Frank J ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Design; Experimentation; Performance

Indexed keywords

COMPUTING ENVIRONMENTS; CONTEXT-AWARE; DATA DISTRIBUTION; DATA LOCALITY; DATA SIZE; EXPERIMENTATION; GPU CLUSTERS; MANY-CORE; MULTIPLE COMPUTING PLATFORMS; PERFORMANCE; SOFTWARE PLATFORMS;

ABSTRACTING; COBALT COMPOUNDS; PARALLEL PROGRAMMING; PROGRAM PROCESSORS; SUPERCOMPUTERS;

CLUSTER COMPUTING;

EID: 79960945909     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1996010.1996013     Document Type: Conference Paper

References (32)

1. C. Augonnet et al. StarPU: a unified platform for task scheduling on heterogeneous multicore architectures. Concurrency and Computation: Practice and Experience, 23:187-198, 2011.
2. H. E. Bal et al. Real-world distributed computing with Ibis. Computer, 43:54-62, August 2010.
3. B. Bode et al. The portable batch scheduler and the maui scheduler on linux clusters. In Proc. of the 4th annual Linux Showcase & Conference, ALS'00, pages 27-27, Atlanta, Georgia, 2000. USENIX Association.
4. M. Bornemann et al. MPJ/Ibis: a flexible and efficient message passing platform for Java. In Proc. of 12th European PVM/MPI Users' Group Meeting, pages 217-224, Sorrento, Italy, September 2005.
5. NVIDIA CUDA Programming Guide Version 2.0, 2008. http://www.nvidia.com/ cuda.html.
6. E. Deelman et al. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Sci. Program., 13:219-237, July 2005. (Pubitemid 43022937)
7. E. Deelman et al. Workflows and e-Science: An overview of workflow system features and capabilities. Future Generation Computer Systems, 25(5):528 - 540, 2009.
8. N. Drost et al. Zorilla: A peer-to-peer middleware for real-world distributed systems. Concurrency and Computation: Practice and Experience, 2011. Accepted for publication.
9. W. Gentzsch. Sun Grid Engine: Towards creating a compute power grid. In 1st International Symposium on Cluster Computing and the Grid, 2001.
10. R. L. Graham et al. Open MPI: A flexible high performance MPI. In Proc. 6th Int. Conf. Par. Proc. and Appl. Math., pages 228-239, Poznan, Poland, Sept. 2005.
11. T. D. Hartley et al. Biomedical image analysis on a cooperative cluster of GPUs and multicores. In Proc. of the 22nd annual international conference on Supercomputing, ICS'08, pages 15-25, Island of Kos, Greece, 2008. ACM.
12. V. Karamcheti and A. A. Chien. A hierarchical load-balancing framework for dynamic multithreaded computations. In Proc. of the 1998 ACM/IEEE conference on Supercomputing, SC'98, pages 1-17, San Jose, CA, 1998. IEEE Computer Society.
13. J. Maassen and H. Bal. SmartSockets: Solving the Connectivity Problems in Grid Computing. In Proc. of the 16th International Symposium on High Performance Distributed Computing, HPDC'07.
14. J. Makino et al. GRAPE-6: Massively-Parallel Special-Purpose Computer for Astrophysical Particle Simulations. Publications of the Astronomical Society of Japan, 55:1163-1187, Dec. 2003.
15. E. Ogasawara et al. Exploring many task computing in scientific workflows. In Proc. of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers, MTAGS'09, pages 2:1-2:10, Portland, Oregon, 2009. ACM.
16. A. Plaza. Recent developments and future directions in parallel processing of remotely sensed hyperspectral images. In Proc. of the 6th International Symposium on Image and Signal Processing and Analysis, pages 626-631, Salzburg, Austria, september 2009.
17. S. Portegies Zwart et al. A multiphysics and multiscale software environment for modeling astrophysical systems. New Astronomy, 14(4):369 - 378, 2009.
18. I. Raicu et al. Falkon: a fast and light-weight task execution framework. In Proc. of the 2007 ACM/IEEE conference on Supercomputing, SC'07, pages 1-12, Reno, Nevada, 2007. ACM.
19. I. Raicu et al. Many-task computing for grids and supercomputers. In Proc. of the 1st Workshop on Many-Task Computing on Grids and Supercomputers, MTAGS'08, 2008.
20. I. Raicu et al. Toward loosely coupled programming on petascale systems. In Proc. of the 2008 ACM/IEEE conference on Supercomputing, SC'08, pages 1-12, Austin, Texas, 2008. IEEE Press.
21. R. Raman et al. Matchmaking: Distributed resource management for high throughput computing. In Proc. of the Seventh IEEE International Symposium on High Performance Distributed Computing, HPDC'98.
22. F. Seinstra et al. High-performance distributed video content analysis with Parallel-Horus. IEEE Multimedia, 14(4):64-75, October-December 2007. (Pubitemid 350120533)
23. F. J. Seinstra et al. Jungle computing: Distributed supercomputing beyond clusters, grids, and clouds. In M. Cafaro and G. Aloisio, editors, Grids, Clouds and Virtualization, Computer Communications and Networks, pages 167-197. Springer London, 2011.
24. D. Thain et al. Distributed computing in practice: The Condor experience. Concurrency and Computation: Practice and Experience, 17:2-4, 2005.
25. A. Tsaregorodtsev et al. DIRAC: A scalable lightweight architecture for high throughput computing. In Proc. of the 5th IEEE/ACM International Workshop on Grid Computing, GRID'04, pages 19-25, Washington, DC, USA, 2004. IEEE Computer Society. (Pubitemid 40752121)
26. J. Urbani et al. Owl reasoning with WebPIE: calculating the closure of 100 billion triples. In Proc. of the ESWC'10, Heraklion, Greece, may-june 2010.
27. R. V. Van Nieuwpoort et al. User-friendly and reliable grid computing based on imperfect middleware. In Proc. of the 2006 ACM/IEEE conference on Supercomputing, SC'07, Reno, NV, Nov. 2007.
28. R. V. Van Nieuwpoort et al. Satin: A high-level and efficient grid programming model. ACM Trans. Program. Lang. Syst., 32(3):1-39, 2010.
29. K. van Reeuwijk. Maestro: a self-organizing peer-to-peer dataflow framework using reinforcement learning. In Proc. of The International ACM Symposium on High Performance Distributed Computing, HPDC'09, Munich, Germany, June 11-13 2009.
30. E. Walker et al. Personal adaptive clusters as containers for scientific jobs. Cluster Computing, 10(3):339-350, 2007. (Pubitemid 47278346)
31. D. Warneke and O. Kao. Nephele: efficient parallel data processing in the cloud. In Proc. of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers, MTAGS'09, pages 8:1-8:10, Portland, Oregon, 2009. ACM.
32. S. Zhou. LSF: load sharing in large-scale heterogeneous distributed systems. In Workshop on Cluster Computing, 1992.