GridBot: Execution of bags of tasks in multiple grids

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC '09

Volumn , Issue , 2009, Pages

  Silberstein, Mark ^a   Sharov, Artyom ^a   Geiger, Dan ^a   Schuster, Assaf ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

CAMPUS GRID; GENERIC MECHANISM; HOLISTIC APPROACH; LOCAL CLUSTER; OPEN SCIENCE GRID; SINGLE COMPUTING; SYSTEM STATE; TECHNION; VOLUNTEER COMPUTING;

EID: 74049118429     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1654059.1654071     Document Type: Conference Paper

References (39)

1. Community grids managed by BOINC. http://http://boincstats.com.
2. Condor DAGman. http://www.cs.wisc.edu/condor/dagman.
3. Condor Glidein. http://www.cs.wisc.edu/condor/glidein.
4. EDGeS project. http://www.edges-grid.eu/.
5. The enabling grids for e-science. http://www.eu-egee.org.
6. GridBot monitoring. http://cbl-boinc-server2.cs. technion.ac.il/ superlinkattechnion/stripcharts.php.
7. The open science grid. http://www.opensciencegrid.org.
8. Superlink-online genetic linkage analysis portal. http://bioinfo.cs. technion.ac.il/superlink-online.
9. Superlink@Technion community grid. http://cbl-boinc-server2.cs.technion. ac.il/ superlinkattechnion.
10. J. H. Abawajy. Fault-tolerant scheduling policy for grid computing systems. In IPDPS, pages 238+, 2004.
11. D. Abramson, C. Enticott, and I. Altinas. Nimrod/k: towards massively parallel dynamic grid workflows. In SC '08, pages 1-11, 2008.
12. D. Abramson, J. Giddy, and L. Kotler. High performance parametric modeling with Nimrod/G: Killer application for the global grid? In IPDPS, pages 520-528, 2000.
13. D. P. Anderson, E. Korpela, and R. Walton. High-performance task distribution for volunteer computing. In e-Science, pages 196-203, 2005.
14. C. Anglano, J. Brevik, M. Canonico, D. Nurmi, and R. Wolski. Fault-aware scheduling for bag-of-tasks applications on desktop grids. In GRID, pages 56-63, 2006.
15. C. Anglano and M. Canonico. Scheduling algorithms for multiple bag-of-task applications on desktop grids: A knowledge-free approach. In IPDPS, pages 1-8, 2008.
16. F. Cappello, S. Djilali, G. Fedak, T. Hérault, F. Magniette, V. Néri, and O. Lodygensky. Computing on large-scale distributed systems: Xtremweb architecture, programming models, security, tests and convergence with grid. Future Generation Comp. Syst., 21(3):417-437, 2005.
17. H. Casanova and F. Berman. Parameter sweeps on the grid with APST. In F. Berman, G. Fox, and T. Hey, editors, Grid Computing: Making the Global Infrastructure a Reality, chapter 26. 2003.
18. W. Cirne, D. Paranhos, L. Costa, E. Santos-Neto, F. Brasileiro, J. Sauve, F. A. B. Silva, C. O. Barros, C. Silveira, and C. Silveira. In ICPP, pages 407-416, 2003.
19. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, K. Blackburn, A. Lazzarini, A. Arbree, R. Cavanaugh, and S. Koranda. Mapping abstract complex workflows onto grid environments. Journal of Grid Computing, V1(1):25-39, March 2003.
20. J.-P. Goux, S. Kulkarni, J. Linderoth, and M. Yoder. An enabling framework for master-worker applications on the computational grid. In HPDC, pages 43-50, 2000.
21. A. Iosup, O. O. Sonmez, S. Anoep, and D. H. J. Epema. The performance of bags-of-tasks in large-scale distributed systems. In HPDC, pages 97-108, 2008.
22. G. Juve and E. Deelman. Resource provisioning options for large-scale scientific workflows. pages 608-613, Dec. 2008.
23. D. Kondo. Scheduling task parallel applications for rapid turnaround on desktop grids. PhD thesis, 2005.
24. D. Kondo, F. Araujo, P. Malecot, P. Domingues, L. M. Silva, G. Fedak, and F. Cappello. Characterizing result errors in Internet desktop grids. In Euro-Par, pages 361-371, 2007.
25. D. Kondo, A. A. Chien, and H. Casanova. Resource management for rapid application turnaround on enterprise desktop grids. In SC '04, page 17, 2004.
26. G. Koole and R. Righter. Resource allocation in grid computing. J. Scheduling, 11(3):163-173, 2008.
27. D. Lingrand, J. Montagnat, and T. Glatard. Estimating the execution context for refining submission strategies on production grids. Technical Report I3S/RR-2007-22-FR, I3S laboratory, Sophia Antipolis, Nov. 2007.
28. R. Medeiros, W. Cirne, F. V. Brasileiro, and J. P. Sauvé. Faults in grids: Why are they so bad and what can be done about it? In GRID, pages 18-24, 2003.
29. I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde. Falkon: a fast and light-weight task execution framework. In SC '07, pages 1-12, 2007.
30. R. Raman. Matchmaking frameworks for distributed resource management. PhD thesis, 2000.
31. M. Silberstein, D. Geiger, A. Schuster, and M. Livny. Scheduling mixed workloads in multi-grids: The grid execution hierarchy. In HPDC, pages 291-302, 2006.
32. M. Silberstein, A. Schuster, D. Geiger, A. Patney, and J. D. Owens. Efficient computation of sum-products on GPUs through software-managed cache. In ICS, pages 309-318, June 2008.
33. M. Silberstein, A. Tzemach, N. Dovgolevskiy, M. Fishelson, A. Schuster, and D. Geiger. On-line system for faster linkage analysis via parallel execution on thousands of personal computers. American Journal of Human Genetics, 78(6):922-935, 2006.
34. G. Singh, M.-H. Su, K. Vahi, E. Deelman, B. Berriman, J. Good, D. S. Katz, and G. Mehta. Workflow task clustering for best effort systems with pegasus. In MG '08, pages 1-8, 2008.
35. Y. suk Kee, C. Kesselman, D. Nurmi, and R. Wolski. Enabling personal clusters on demand for batch resources using commodity software. In IPDPS, pages 1-7, 2008.
36. D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the Condor experience. Concurrency - Practice and Experience, 17(2-4):323-356, 2005.
37. E. Walker, J. P. Gardner, V. Litvin, and E. L. Turner. Personal adaptive clusters as containers for scientific jobs. Cluster Computing, 10(3):339-350, 2007.
38. M. Zaharia, A. Konwinski, A. Joseph, R. Katz, and I. Stoica. Improving mapreduce performance in heterogeneous environments. pages 29-42, San Diego, CA, 12/2008 2008. USENIX Association.
39. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, and M. Wilde. Swift: Fast, reliable, loosely coupled parallel computation. In Services 2007, pages 199-206, 2007.