Building an online domain-specific computing service over non-dedicated grid and cloud resources: The superlink-online experience

Proceedings - 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011

Volumn , Issue , 2011, Pages 174-183

  Silberstein, Mark ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Cloud computing; Grid; online computing services; Volunteer grids

Indexed keywords

COMPLEX DISEASE; COMPUTING SERVICES; COST-EFFICIENT; CPU TIME; DOMAIN SPECIFIC; GENETIC DATA; GENETIC DISEASE; GENETIC LINKAGE; GRID; INTERNET ACCESS; LINKAGE ANALYSIS; MULTI-GRID; ON-LINE SERVICE; ONLINE COMPUTING; SAMPLING DENSITIES; TECHNION; VIRTUAL GRIDS; VOLUNTEER GRIDS;

CLOUDS; CLUSTER COMPUTING; COMPUTER AIDED NETWORK ANALYSIS; DYNAMIC LOADS; GENES; GRID COMPUTING; LAKES; PROGRAM PROCESSORS; SUPERCOMPUTERS;

CLOUD COMPUTING;

EID: 79961156353     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2011.46     Document Type: Conference Paper

References (35)

1. S. Dwarkadas, A. Schäffer, R. Cottingham, A. Cox, P. Kele-her, and W. Zwaenepoel, "Parallelization of general linkage analysis problems," Human Heredity, vol. 44, pp. 127-141, 1994.
2. G. Conant, S. Plimpton, W. Old, A. Wagner, P. Fain, T. Pacheco, and G. Heffelfinger, "Parallel Genehunter: implementation of a linkage analysis package for distributed- memory architectures." Journal of Parallel and Distributed Computing, vol. 63, no. 7-8, pp. 674-682, 2003.
3. "Superlink-online genetic linkage analysis portal," http://bioinfo.cs.technion.ac.il/superlink-online.
4. M. Silberstein, A. Tzemach, N. Dovgolevsky, M. Fishelson, A. Schuster, and D. Geiger, "On-line system for faster linkage analysis via parallel execution on thousands of personal computers," Americal Journal of Human Genetics, 2006.
5. M. Silberstein, D. Geiger, A. Schuster, and M. Livny, "Scheduling of mixed workloads in multi-grids: The grid execution hierarchy," in 15th IEEE International Symposium on High Performance Distributed Computing (HPDC-15 2006), 2006.
6. D. P. Anderson, E. Korpela, and R. Walton, "High-performance task distribution for volunteer computing," in e-Science, 2005, pp. 196-203.
7. M. Silberstein, A. Sharov, D. Geiger, and A. Schuster, "Gridbot, execution of bags of tasks in multiple grids," in SC '09, 2009.
8. N. Friedman, D. Geiger, and N. Lotner, "Likelihood computation with value abstraction." in 16th Conference on Uncertainty in Artificial Intelligence (UAI'00). Morgan Kaufmann, 2000, pp. 192-200.
9. G. Cooper, "The computational complexity of probabilistic inference using bayesian belief networks," Artificial Intelligence, vol. 42, pp. 393-405, 1990.
10. R. Dechter, "Bucket elimination: A unifying framework for probabilistic inference." in Learning in Graphical Models, J. M. I. (Ed.), Ed. Kluwer Academic Press., 1998, pp. 75- 104.
11. S. Arnborg, D. G. Corneil, and A. Proskurowski, "Complexity of finding embeddings in a k-tree." SIAM Journal of Algorithms and Discrete Methods, vol. 8, pp. 277-284, 1987.
12. M. Fishelson, N. Dovgolevsky, and D. Geiger, "Maximum likelihood haplotyping for general pedigrees," Human Heredity, vol. 59, pp. 41-60, 2005.
13. M. Silberstein, A. Tzemach, N. Dovgolevskiy, M. Fishelson, A. Schuster, and D. Geiger, "On-line system for faster linkage analysis via parallel execution on thousands of personal computers," American Journal of Human Genetics, vol. 78, no. 6, pp. 922-935, 2006.
14. H. Casanova and F. Berman, "Parameter sweeps on the grid with APST," in Grid Computing: Making the Global Infrastructure a Reality, F. Berman, G. Fox, and T. Hey, Eds., 2003, ch. 26.
15. D. Abramson, J. Giddy, and L. Kotler, "High performance parametric modeling with Nimrod/G: Killer application for the global grid?" in IPDPS, 2000, pp. 520-528.
16. J.-P. Goux, S. Kulkarni, J. Linderoth, and M. Yoder, "An enabling framework for master-worker applications on the computational grid," in HPDC, 2000, pp. 43-50.
17. "Condor Glidein," http://www.cs.wisc.edu/condor/glidein.
18. I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde, "Falkon: a fast and light-weight task execution framework," in SC '07, 2007, pp. 1-12.
19. G. Juve and E. Deelman, "Resource provisioning options for large-scale scientific workflows," Dec. 2008, pp. 608-613.
20. E. Walker, J. P. Gardner, V. Litvin, and E. L. Turner, "Personal adaptive clusters as containers for scientific jobs," Cluster Computing, vol. 10, no. 3, pp. 339-350, 2007.
21. Y. suk Kee, C. Kesselman, D. Nurmi, and R. Wolski, "Enabling personal clusters on demand for batch resources using commodity software," in IPDPS, 2008, pp. 1-7.
22. G. Koole and R. Righter, "Resource allocation in grid computing," J. Scheduling, vol. 11, no. 3, pp. 163-173, 2008.
23. J. H. Abawajy, "Fault-tolerant scheduling policy for grid computing systems," in IPDPS, 2004, pp. 238+.
24. M. Zaharia, A. Konwinski, A. Joseph, R. Katz, and I. Stoica, "Improving mapreduce performance in heterogeneous environments." San Diego, CA: USENIX Association, 12/2008 2008, pp. 29-42.
25. D. Kondo, "Scheduling task parallel applications for rapid turnaround on desktop grids," Ph.D. dissertation, 2005.
26. C. Anglano, J. Brevik, M. Canonico, D. Nurmi, and R. Wol-ski, "Fault-aware scheduling for bag-of-tasks applications on desktop grids," in GRID, 2006, pp. 56-63.
27. W. Cirne, D. Paranhos, L. Costa, E. Santos-Neto, F. Brasileiro, J. Sauve, F. A. B. Silva, C. O. Barros, C. Silveira, and C. Silveira, in ICPP, 2003, pp. 407-416.
28. F. Cappello, S. Djilali, G. Fedak, T. Hérault, F. Magniette, V. Néri, and O. Lodygensky, "Computing on large-scale distributed systems: Xtremweb architecture, programming models, security, tests and convergence with grid," Future Generation Comp. Syst., vol. 21, no. 3, pp. 417-437, 2005.
29. "EDGeS project," http://www.edges-grid.eu/.
30. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good, "The cost of doing science on the cloud: The montage example," in SC08, 2008, pp. 1 -12.
31. D. Kondo, B. Javadi, P. Malecot, F. Cappello, and D. P. Anderson, "Cost-benefit analysis of cloud computing versus desktop grids," in IPDPS, 2009, pp. 1-12.
32. D. Thain, T. Tannenbaum, and M. Livny, "Distributed computing in practice: the Condor experience." Concurrency - Practice and Experience, vol. 17, no. 2-4, pp. 323-356, 2005.
33. "Sun grid engine," http://gridengine.sunsource.net/.
34. "Index of BLAST online services," http://www.cgl.ucsf.edu/home/ meng/sources.html.
35. W. Lu, J. Jackson, and R. Barga, "Azureblast: a case study of developing science applications on the cloud," in HPDC, 2010, pp. 413-420.