A case study of parallel I/O for biological sequence search on Linux clusters

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn 2003-January, Issue , 2003, Pages 308-315

  Zhu, Yifeng ^a   Jiang, Hong ^a   Qin, Xiao ^a   Swanson, David ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

BLAST; CEFT PVFS; Parallel I O; PVFS

Indexed keywords

BLASTING; CLUSTER COMPUTING; COMPUTER ARCHITECTURE; COMPUTER OPERATING SYSTEMS; COST EFFECTIVENESS; DIGITAL STORAGE; LINUX; SEARCH ENGINES; VIRTUAL STORAGE;

BIOLOGICAL SEQUENCES; CEFT-PVFS; DEGREE OF PARALLELISM; MULTIPLE APPLICATIONS; PARALLEL I/O; PARALLEL VIRTUAL FILE SYSTEMS; PERFORMANCE DEGRADATION; PVFS;

BENCHMARKING;

EID: 84906484524     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2003.1253329     Document Type: Conference Paper

References (30)

1. E. M. Zdobnov, R. Lopez, R. Apweiler, and T. Etzold, "The EBI SRS server - new features," Bioinformatics, 18(8):1149-1150, Aug. 2002.
2. National Center for Biotechnology Information (NCBI), ftp://ftp.ncbi.nih.gov/, 2003.
3. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur, "PVFS: A parallel file system for Linux clusters," in Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, Oct. 2000, pp. 317-327.
4. W. B. Ligon III, "Research directions in parallel I/O for clusters," keynote speech, in Proceedings of 2002 IEEE International Conference on Cluster Computing, Sept. 2002.
5. Y. Zhu, H. Jiang, X. Qin, D. Feng, and D. Swanson, "Design, implementation, and performance evaluation of a cost-effective fault-tolerant parallel virtual file system," International Workshop on Storage Network Architecture and Parallel I/Os, in conjunctions with 12th IEEE International Conference on Parallel Architectures and Compilation Techniques, New Orleans, LA, Sept. 2003.
6. rd IEEE/ACM International Symposium on Cluster Computing and the Grid, Parallel I/O in Cluster Computing and Computational Grids Workshop, May 2003, pp. 730-735.
7. Y. Zhu, H. Jiang, X. Qin, D. Feng, and D. Swanson, "Scheduling for improved write performance in a cost-effective, fault-tolerant parallel virtual file system (CEFT-PVFS)," in Proceedings of Cluster World Conference & Expo, San Jose, California, June 2003.
8. S. F. Altschul, W. Gish, W. Miller, E. Myers, and D. Lipman, "Basic local alignment search tool," Journal of Molecular Biology, 215:403-410, 1990.
9. S. F. Altschul, T.L. Madden, A. A. Schaffer, J. Zhang, Z. Zhang, W. Miller, and D. J. Lipman, "Gapped BLAST and PSI-BLAST: a new generation of protein database search programs," Nucleic Acids Res., 25:3389-3402, 1997.
10. A. E. Darling, L. Carey, and W. Feng, "The design, implementation, and evaluation of mpiBLAST," in Proceedings of Cluster World Conference & Expo, San Jose, California, June 2003.
11. R. Bjornson, A. Sherman, S. Weston, N. Willard, and J. Wing, "Turboblast: A parallel implementation of blast based on the turbohub process integration architecture," in IPDPS 2002 Workshops, April 2002.
12. WU-BLAST, http://blast.wustl.edu/, 2003.
13. K. T. Pedretti, T. L. Casavant, R. C. Braun, T. E. Scheetz, C. L. Birkett, and C. A. Roberts, "Three complementary approaches to parallelization of local BLAST service on workstation clusters," in Proceeding of Fifth International Conference on Parallel Computing Technologies, 1999, Springer Verlag in Lecture Notes in Computer Science Series, Vol. 1662.
14. Prairiefire Cluster at University of Nebraska - Lincoln, http://rcf.unl.edu, 2003.
15. Myrinet, http://www.myrinet.com, 2003.
16. Netperf, http://www.netperf.org, 2003.
17. Bonnie, http://www.textuality.com/bonnie, 2003.
18. H. Taki and G. Utard, "MPI-IO on a parallel file system for cluster of workstations," in Proceedings of the IEEE Computer Society International Workshop on Cluster Computing, Melbourne, Australia, 1999, pp. 150-157.
19. R. Cristaldi, G. Iannello, and F. Delfino, "The cluster file system: Integration of high performance communication and I/O in clusters," in Proceeding of the 2nd IEEE/ACM international symposium on Cluster computing and the grid, Berlin, Germany, May 2002.
20. S. A. Moyer and V. S. Sunderam, "PIOUS: A scalable parallel I/O system for distributed computing environments," in Proceedings of the Scalable HighPerformance Computing Conference, 1994, pp. 71-78.
21. F. Isaila and W. F. Tichy, "Clusterfile: A flexible physical layout parallel file system," in Proceedings of 2001 IEEE International Conference on Cluster Computing, 2001, pp. 37-44.
22. S. Garg and J. Mache, "Performance evaluation of parallel file systems for PC clusters and ASCI red," in Proceedings of 2001 IEEE International Conference on Cluster Computing, 2001, pp 172-177.
23. M. Vilayannur, M. Kandemir, and A. Sivasubramaniam, "Kernel-level caching for optimizing I/O by exploiting inter-application data sharing," in Proceedings of 2002 IEEE International Conference on Cluster Computing, 2002, pp. 425-432.
24. R. Ross, D. Nurmi, A. Cheng, and M. Zingale, "A case study in application I/O on Linux clusters," in Proceeding of Supercomputer, Denver, Nov. 2001.
25. J. Li, W. Liao, A. Choudhary, and V. Taylor, "I/O analysis and optimization for an AMR cosmology application," in Proceedings of IEEE International Conference on Cluster Computing, pp. 119-126, 2002.
26. A. Purakayastha, C. S. Ellis, D. Kotz, N. Nieuwejaar, and M. Best, "Characterizing Parallel File-Access Patterns on a Large-Scale Multiprocessor," in Proceedings of the Ninth International Parallel Processing Symposium, April, 1995, pp. 165-172.
27. E. Smirni and D. A. Reed, "Lessons from characterizing the input/output behavior of parallel scientific applications," Performance Evaluation, 1998, Vol. 33, pp. 27-44.
28. E. Smirni and D. A. Reed, "Workload characterization of input/output intensive parallel applications," in Proceedings of the Conference on Modeling Techniques and Tools for Computer Performance Evaluation, Springer-Verlag Lecture Notes in Computer Science, June 1997, Vol. 1245, pp. 169-180.
29. H. Simitci and D. A. Reed, "A comparison of logical and physical parallel I/O patterns," International Journal of High Performance Computing Applications, special issue (I/O in Parallel Applications), 1998, Vol. 12, No. 3, pp. 364-380.
30. R. Bennett, K. Bryant, A. Sussman, R. Das, and J. S. Jovian, "A framework for optimizing parallel I/O," in Proceedings of the Scalable Parallel Libraries Conference, 1994.