Applying twister to scientific applications

Proceedings - 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010

Volumn , Issue , 2010, Pages 25-32

  Zhang, Bingjing ^a,b   Ruan, Yang ^a,b   Wu, Tak Lon ^a   Qiu, Judy ^a,b   Hughes, Adam ^b   Fox, Geoffrey ^a,b  

^a INDIANA UNIVERSITY   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Cloud; Iterative MapReduce; Scientific applications; Twister

Indexed keywords

DATA PARALLEL; EM ALGORITHMS; ITERATIVE MAPREDUCE; MAP-REDUCE; NON-ITERATIVE; PROGRAMMING MODELS; SCIENTIFIC APPLICATIONS; TWISTER; UNIFIED APPROACH;

ALGORITHMS; COMPUTER SYSTEMS; INTERPOLATION;

CLOUD COMPUTING;

EID: 79952417253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2010.37     Document Type: Conference Paper

References (40)

1. J. Dean and S. Ghemawat, MapReduce: simplified data processing on large clusters. Commun. ACM, 2008. 51(1): p. 107-113.
2. J.Ekanayake, et al., Twister: A Runtime for iterative MapReduce, in Proceedings of the First International Workshop on MapReduce and its Applications of ACM HPDC 2010 conference June 20-25, 2010. 2010, ACM: Chicago, Illinois.
3. Apache, Apache Hadoop, Retrieved April 20, 2010, from ASF: http://hadoop.apache.org/core/.http://hadoop.apache.org/core/.
4. Amazon, Amazon Web Services.http://aws.amazon.com/.
5. J. B. MacQueen. Some Methods for classification and Analysis of Multivariate Observations. in 5-th Berkeley Symposium on Mathematical Statistics and Probability: University of California Press.
6. S. Brin and L. Page. The Anatomy of a Large-Scale Hypertextual Web Search Engine; Available from: http://infolab.stanford.edu/~backrub/google.html.
7. NaradaBrokering. Scalable Publish Subscribe System, 2010 [accessed 2010 May]; Available from: http://www.naradabrokering.org/.
8. Apache, "ActiveMQ," http://activemq.apache.org/, 2009.
9. NCBI. BLAST, 2010; Available from: http://blast.ncbi.nlm.nih.gov/Blast. cgi?CMD=Web&PAGE-TYPE=BlastNews#1.
10. NCBI. BLAST Command Line Applications User Manual, 2010; Available from: http://www.ncbi.nlm.nih.gov/bookshelf/br.fcgi?book=helpblast&part= CmdLineAppsManual.
11. C. Camacho, et al., BLAST+: architecture and applications. BMC Bioinformatics 2009, 10:421, 2009.
12. PolarGrid. Cyberinfrastructure for Polar Expeditions, 2010 [accessed 2010 January]; Available from: http://www.polargrid.org/polargrid/index.php/Main- Page.
13. NCBI. Databases available for BLAST search; Available from: http://www.ncbi.nlm.nih.gov/blast/blast-databases.shtml.
14. A. Darling, L. Carey, and W. Feng, The Design, Implementation, and Evaluation of mpiBLAST. In: Proc ClusterWorld, 2003. 2003.
15. A. Matsunaga, M. Tsugawa, and J. Fortes. CloudBLAST: Combining MapReduce and Virtualization on Distributed Resources for Bioinformatics Applications. in IEEE Fourth International Conference on eScience (eScience '08). 2008. Indianapolis, IN.
16. W. Lu, J. Jackson, and R. Barga, AzureBlast: A Case Study of Developing Science Applications on the Cloud, in ScienceCloud: 1st Workshop on Scientific Cloud Computing co-located with HPDC 2010 (High Performance Distributed Computing). 2010, ACM: Chicago, IL.
17. "MPI," Message Passing Interface, http://wwwunix.mcs.anl.gov/ mpi/, 2009.
18. NCBI, NCBI Toolkit.http://www.ncbi.nlm.nih.gov/BLAST/developer.shtml
19. H. Lin, et al., Massively Parallel Genomic Sequence Search on the Blue Gene/P Architecture, in SC2008. 2008.
20. Hadoop Distributed File System HDFS, 2009 [accessed 2009 December]; Available from: http://hadoop.apache.org/hdfs/.
21. Windows Azure Platform, Retrieved April 20, 2010, from Microsoft: http://www.microsoft.com/windowsazure/.http://www.microsoft.com/windowsazure/.
22. ElimDupes; Available from: http://hcv.lanl.gov/content/sequence/ ELIMDUPES/elimdupes.html.
23. geneious; Available from: http://www.geneious.com/default,1266,new- features.sm.
24. V. Seguritan and F. Rohwer, FastGroup: A program to dereplicate libraries of 16S rDNA sequences. BMC Bioinformatics, 2001. 2:9.http://www.ncbi.nlm.nih. gov/pmc/articles/PMC59723/
25. D. Kerk, et al., The Complement of Protein Phosphatase Catalytic Subunits Encoded in the Genome of Arabidopsis. Plant Physiology, 2002. 129: p. 908-925.
26. S. Drabenstot, et al., FELINES: a utility for extracting and examining EST-defined introns and exons. Nucleic Acids Research, 2003. 31.
27. Center for Genomics and Bioinformatics; Available from: http://cgb.indiana.edu/.
28. J. Kruskal and M. Wish, Multidimensional Scaling. 1978: Sage Publications Inc.
29. M. Trosset and C. Priebe, The Out-of-Sample Problem for Classical Multidimensional Scaling. 2006, Bloomington, IN: Indiana University.
30. I. Borg and P. Groenen, Modern Multidimensional Scaling: Theory and Applications. 2005: Springer.
31. J. Choi, S. Bae, J. Qiu, G. Fox, Dimension Reduction and Visualization of Large High-dimensional Data via Interpolation, in HPDC'10 2010: Chicago, Illinois USA.
32. T. Gunarathne, T. Wu, J. Qiu, and G. Fox, Cloud Computing Paradigms for Pleasingly Parallel Biomedical Applications, in Proceedings of the Emerging Computational Methods for the Life Sciences Workshop of ACM HPDC 2010 conference. 2010: Chicago, Illinois.
33. Indiana University Bloomington Open Sysem Lab. MPI.NET, 2008; Available from: http://osl.iu.edu/research/mpi.net/.
34. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, Dryad: Distributed data-parallel programs from sequential building blocks, in ACM SIGOPS Operating Systems Review. 2007, ACM Press. p. 59-72.
35. NCBI. PubChem; Available from: http://pubchem.ncbi.nlm.nih.gov/.
36. C. Bishop, M. Svensén, and C. Williams, GTM: The generative topographic mapping. Neural computation, 1998. 10: p. 215--234.
37. M. Carreira-Perpinan and Z. Lu. The Laplacian eigenmaps latent variable model. in 11th Int. Workshop on Artifical Intelligence and Statistics. 2007.
38. A. Kaban. A scalable generative topographic mapping for sparse data sequences. in the International Conference on Information Technology: Coding and Computing. 2005.
39. F. Nie S. Xiang, Y. Song, C. Zhang and C. Zhang, Embedding new data points for manifold learning via coordinate propagation. Knowledge and Information Systems, 2009. 19(2): p. 159-184.
40. J. Kruskal, Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika, 1964. 29: p. 1-27.