Access-pattern and bandwidth aware file replication algorithm in a grid environment

Proceedings - IEEE/ACM International Workshop on Grid Computing

Volumn , Issue , 2008, Pages 250-257

  Sato, Hitoshi ^a   Matsuoka, Satoshi ^a,b   Endo, Toshio ^a   Maruyama, Naoya ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATICS   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS PATTERNS; ACCESS TIMES; ALGORITHM MODELS; ALGORITHMIC OPTIMIZATIONS; AUTOMATED ALGORITHMS; AUTOMATIC DETERMINATIONS; COMBINATORIAL OPTIMIZATION PROBLEMS; FILE ACCESSES; FILE REPLICATION ALGORITHMS; FILE REPLICATIONS; GRID APPLICATIONS; GRID ENVIRONMENTS; GRID FILE SYSTEMS; I/O PERFORMANCES; NETWORK THROUGHPUTS; OBJECTIVE FUNCTIONS; OPTIMIZATION PROBLEMS; PARAMETER SPACES; REPLICA PLACEMENTS; REPLICATION ALGORITHMS; RUNNING APPLICATIONS; SPACE OVERHEADS; SYSTEM PARAMETERS; TIME THRESHOLDS;

APPLICATIONS; COMBINATORIAL MATHEMATICS; COMBINATORIAL OPTIMIZATION; DATA STORAGE EQUIPMENT; MATHEMATICAL MODELS; OPTIMIZATION; REAL TIME SYSTEMS; THROUGHPUT;

GRID COMPUTING;

EID: 57849085790     PISSN: 15505510     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GRID.2008.4662806     Document Type: Conference Paper

References (21)

1. Gfarm. http://datafarm.apgrid.org.
2. GLPK. http://www.gnu.org/software/glpk/.
3. Hadoop. http://hadoop.apache.org/.
4. Lustre. http://www.lustre.org.
5. NCBI BLAST. http://www.ncbi.nlm.nih.gov/BLAST.
6. XtreemFS. http://www.xtreemfs.com.
7. J. Bent, D. Thain, A. Arpaci-Dusseau, R. Arpaci-Dusseau, and M. Livny. Explicit Control in a Batch Aware Distributed File System. In Proceedings of the 1st Conference on Networked Systems Design and Implementation, March 2004.
8. B. Callaghan, D. Robinson, R. Thurlow, C. Beame, M. Eisler, and D. Noveck. Network File System (NFS) version 4 protocol, April 2003. RFC 3530.
9. P. H. Carns, W. B. L. III, R. B. Ross, and R. Thakur. PVFS: A Parallel File System for Linux Clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317-327, 2000.
10. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google File System. In Proceedings of the 19th ACM Symposium on Operating Systems Principles, pages 96-108, October 2003.
11. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and Performance in a Distributed File System. ACM Transactions on Computer Systems (TOCS), 6(1):51-81, 1988.
12. D. Maziéres. Self-certifying File System. PhD thesis, Massachusetts Institute of Technology, May 2000.
13. A. Ramakrishnan, G. Singh, H. Zhao, E. Deelman, R. Sakellariou, K. Vahi, K. Blackburn, D. Meyers, and M. Samidi. Scheduling Data-Intensive Workflows onto Storage-Constrained Distributed Resources. In Proceedings of the 7th International Symposium on Cluster Computing and the Grid, pages 401-409, 2007.
14. Ranganathan and I. Foster. Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications. In Proceedings of the 11th International Symposium on High Performance Distributed Computing, pages 352-358, 2002.
15. K. B. Rashedur M. Rahman and R. Alhajj. Study of Different Replica Placement and Maintenance Strategies in Data Grid. In Proceedings of the 7th International Symposium on Cluster Computing and the Grid, pages 171-178, 2007.
16. S. Shankar and D. J. DeWitt. Data Driven Workflow Planning in Cluster Management Systems. In Proceedings of the 16th International Symposium on High Performance Distributed Computing, pages 127-136, 2007.
17. T. Shirai, H. Saito, and K. Taura. A Fast Topology Inference - A building block for network-aware parallel computing. In Proceedings of the 16th International Symposium on High Performance Distributed Computing, pages 11-21, 2007.
18. H. Tang, A. Gulbeden, J. Zhou, W. Strathearn, T. Yang, and L. Chu. A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications. In Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, page 52, 2004.
19. O. Tatebe, Y. Morita, S. Matsuoka, N. Soda, and S. Sekiguchi. Grid Datafarm Architecture for Petascale Data Intensive Computing. In Proceedings of the 2nd International Symposium on Cluster Computing and the Grid, pages 102-110, 2002.
20. Y. Wang and D. Kaeli. Load Balancing using Grid-based Peer-to-Peer Parallel I/O. In Proceedings of the 2005 International Conference on Cluster Computing, pages 1-10, 2005.
21. Q. Xu and J. Subhlok. Automatic Clustering of Grid Nodes. In Proceedings of the 6th International Workshop on Grid Computing, pages 227-233, 2005.