A case study of parallel I/O for biological sequence search on Linux clusters

International Journal of High Performance Computing and Networking

Volumn 1, Issue 4, 2004, Pages 214-222

  Zhu, Yifeng ^a   Jiang, Hong ^b   Qin, Xiao ^c   Swanson, David ^b  

^a University of Maine   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^c NEW MEXICO INSTITUTE OF MINING AND TECHNOLOGY   (United States)

Author keywords

bioinformatics; BLAST; CEFT PVFS; cluster computing; parallel I O; PVFS; sequence comparison

Indexed keywords

EID: 30644459480     PISSN: 17400562     EISSN: 17400570     Source Type: Journal    
DOI: 10.1504/IJHPCN.2004.008350     Document Type: Article

References (36)

1. Altschul, S.F., Gish, W., Miller, W., Myers, E. and Lipman, D. (1990) ‘Basic local alignment search tool’, Journal of Molecular Biology, Vol. 215, pp.403–410.
2. Altschul, S.F., Madden, T.L., Schaffer, A.A., Zhang, J., Zhang, Z., Miller W. and Lipman, D.J. (1997) ‘Gapped BLAST and PSI-BLAST: a new generation of protein database search programs’, Nucleic Acids Research, Vol. 25, pp.3389–3402.
3. Bennett, R., Bryant, K., Sussman, A., Das, R. and Jovian, J.S. (1994) ‘A framework for optimising parallel I/O’, in Proceedings of the Scalable Parallel Libraries Conference.
4. Bjornson, R., Sherman, A., Weston, S., Willard, N. and Wing, J. (2002) ‘Turboblast: a parallel implementation of blast based on the turbohub process integration architecture’, in IPDPS 2002 Workshops, April 2002.
5. Bonnie, (2004) Available at: http://www.textuality.com/bonnie.
6. Carns, P.H., Ligon III, W.B., Ross, R.B. and Thakur, R. (2000) ‘PVFS: a parallel file system for Linux clusters’, in Proceedings of the Fourth Annual Linux Showcase and Conference, Atlanta, GA, October, pp.317–327.
7. Carey, L., Darling, A.E. and Feng, W. (2004) ‘Takeoff with mpiBLAST: parallel searching’, in Proceedings of Cluster World Conference & Expo, San Jose, California, April.
8. Cristaldi, R., Iannello G. and Delfino, F. (2002) ‘The cluster file system: Integration of high performance communication and I/O in clusters’, in Proceedings of the Second IEEE/ACM International Symposium on Cluster Computing and the Grid, Berlin, Germany, May.
9. Costa, R.L.d.C, and Lifschitz, S. (2003) ‘Database allocation strategies for parallel BLAST evaluation on clusters’, Distributed and Parallel Databases, Vol. 13, pp.99–127.
10. Darling, A.E., Carey, L. and Feng, W. (2003) ‘The design, implementation and evaluation of mpiBLAST’, in Proceedings of Cluster World Conference & Expo, San Jose, California, June.
11. DNA Data Bank of Japan (2004) Available at: http://www.ddbj.nig.ac.jp.
12. Garg, S. and Mache, J. (2001) ‘Performance evaluation of parallel file systems for PC clusters and ASCI red’, in Proceedings of 2001 IEEE International Conference on Cluster Computing, pp.172–177.
13. Isaila, F. and Tichy, W.F. (2001) ‘Clusterfile: a flexible physical layout parallel file system’, in Proceedings of 2001 IEEE International Conference on Cluster Computing, pp.37–44.
14. Kurata, K-i. Breton, V. and Nakamura, H. (2003) ‘A method to find unique sequences on distributed genomic databases’, in Proceedings of Third IEEE/ACM International Symposium on Cluster Computing and the Grid, pp.62–69.
15. Ligon III, W.B. (2002) ‘Research directions in parallel I/O for clusters’, keynote speech, in Proceedings of 2002 IEEE International Conference on Cluster Computing, September.
16. Li, J., Liao, W., Choudhary A. and Taylor, V. (2002) ‘I/O analysis and optimisation for an AMR cosmology application’, in Proceedings of IEEE International Conference on Cluster Computing, pp.119–126.
17. Moyer, S.A. and Sunderam, V.S. (1994) ‘PIOUS: a scalable parallel I/O system for distributed computing environments’, in Proceedings of the Scalable High-Performance Computing Conference, pp.71–78.
18. Myrinet. (2004) Available at: http://www.myrinet.com.
19. National Center for Biotechnology Information (NCBI) (2004) Available at: ftp://ftp.ncbi.nih.gov/.
20. Netperf. (2004) Available at: http://www.netperf.org.
21. Pedretti, K.T., Casavant, T.L., Braun, R.C., Scheetz, T.E., Birkett C.L. and Roberts, C.A. (1999) ‘Three complementary approaches to parallelization of local BLAST service on workstation clusters’, in Proceeding of Fifth International Conference on Parallel Computing technologies, Springer-Verlag in Lecture Notes in Computer Science Series, Vol. 1662.
22. Prairiefire Cluster at University of Nebraska-Lincoln (2003) Available at: http://rcf.unl.edu.
23. Purakayastha, A., Ellis, C.S., Kotz, D., Nieuwejaar N. and Best, M. (1995) ‘Characterizing parallel file-access patterns on a large-scale multiprocessor’, in Proceedings of the Ninth International Parallel Processing Symposium, April, pp.165–172.
24. Ross, R., Nurmi, D., Cheng, A. and Zingale, M., (2001) ‘A case study in application I/O on Linux clusters’, in Proceeding of Supercomputer, Denver, November.
25. Smirni, E. and Reed, D.A. (1997) ‘Workload characterisation of input/output intensive parallel applications’, in Proceedings of the Conference on Modeling Techniques and Tools for Computer Performance Evaluation, Springer-Verlag Lecture Notes in Computer Science, June, Vol. 1245, pp.169–180.
26. Smirni, E. and Reed, D.A. (1998) ‘Lessons from characterizing the input/output behavior of parallel scientific applications’, Performance Evaluation, Vol. 33, pp.27–44.
27. Simitci, H. and Reed, D.A. (1998) ‘A comparison of logical and physical parallel I/O patterns’, International Journal of High Performance Computing Applications, special issue (I/O in Parallel Applications), Vol. 12, No. 3, pp.364–380.
28. Taki, H. and Utard, G. (1999) ‘MPI-IO on a parallel file system for cluster of workstations’, in Proceedings of the IEEE Computer Society International Workshop on Cluster Computing, Melbourne, Australia, pp.150–157.
29. Taiji, M., Narumi, T., Ohno, Y., Futatsugi, N., Suenaga, A., Takada, N. and Konagaya, A. (2003) ‘Protein explorer: a petaflops special-purpose computer system for molecular dynamics simulations’, in Proceedings of the ACM/IEEE Supercomputing Conference.
30. Vilayannur, M., Kandemir, M. and Sivasubramaniam, A. (2002) ‘Kernel-level caching for optimising I/O by exploiting interapplication data sharing’, in Proceedings of 2002 IEEE International Conference on Cluster Computing, pp.425–432.
31. Williams, H.E. and Zobel, J. (2002) ‘Indexing and retrieval for genomic databases’, IEEE transactions on Knowledge and Data Engineering, Vol. 14, No. 1, pp.63–78.
32. WU-BLAST. (2003) Available at: http://blast.wustl.edu/.
33. Zhu, Y., Jiang, H., Qin, X., Feng, D. and Swanson, D. (2003a) ‘Improved read performance in a cost-effective, fault-tolerant parallel virtual file system (CEFT-PVFS)’, in Proceedings of the Third IEEE/ACM International Symposium on Cluster Computing and the Grid, Parallel I/O in Cluster Computing and Computational Grids Workshop, May, pp.730–735.
34. Zhu, Y., Jiang, H., Qin, X., Feng, D. and Swanson, D. (2003b) ‘Scheduling for improved write performance in a cost-effective, fault-tolerant parallel virtual file system (CEFT-PVFS)’, in Proceedings of Cluster World Conference & Expo, San Jose, California, June.
35. Zhu, Y., Jiang, H., Qin, X., Feng D. and Swanson, D. (2003c) ‘Design, implementation and performance evaluation of a cost-effective fault-tolerant parallel virtual file system’, International Workshop on Storage Network Architecture and Parallel I/Os, in conjunctions with 12th IEEE International Conference on Parallel Architectures and Compilation Techniques, September 27-October 1, New Orleans, LA.
36. Zdobnov, E.M., Lopez, R., Apweiler, R. and Etzold, T. (2002) ‘The EBI SRS server new features’, Bioinformatics, August, Vol. 18, No. 8, pp.1149–1150.