File clustering based replication algorithm in a grid environment

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009

Volumn , Issue , 2009, Pages 204-211

  Sato, Hitoshi ^a   Matsuoka, Satoshi ^a,b   Endo, Toshio ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATICS   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER SIZES; DATA-INTENSIVE APPLICATION; GRID ENVIRONMENTS; GRID FILE SYSTEMS; I/O PERFORMANCE; REPLICA MANAGEMENT; REPLICATION ALGORITHM; REPLICATION TECHNIQUES; RUNNING APPLICATIONS; STORAGE CAPACITY; STORAGE NODES;

CLUSTER COMPUTING; COMPUTER SCIENCE; GRID COMPUTING;

CLUSTERING ALGORITHMS;

EID: 70349742361     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2009.73     Document Type: Conference Paper

References (23)

1. Gfarm. http://datafarm.apgrid.org.
2. GLPK (GNU Linear Programming Kit). http://www.gnu.org/software/glpk.
3. Hadoop. http://hadoop.apache.org/.
4. ILOG CPLEX. http://www.ilog.com/products/cplex/.
5. InTrigger. http://www.intrigger.jp.
6. METIS. http://glaros.dtc.umn.edu/gkhome/views/metis.
7. NCBI BLAST. http://www.ncbi.nlm.nih.gov/BLAST.
8. The DZero Experiment. http://www-d0.fnal.gov.
9. XtreemFS. http://www.xtreemfs.com.
10. A. Amer, D. D. E. Long, and R. C. Burns. Group-based management of distributed file caches. In Proceedings of the 22nd International Conference on Distributed Computing Systems, pages 525-534, 2002.
11. J. Bent, D. Thain, A. Arpaci-Dusseau, R. Arpaci-Dusseau, and M. Livny. Explicit control in a batch aware distributed file system. In Proceedings of the 1st USENIX/ACM Conference on Networked Systems Design and Implementation, San Francisco, CA, March 2004.
12. B. Callaghan, D. Robinson, R. Thurlow, C. Beame, M. Eisler, and D. Noveck. Network file system (nfs) version 4 protocol, April 2003. RFC 3530.
13. S. Doraimani and A. Iamnitchi. File grouping for scientific data management: lessons from experimenting with real traces. In Proceedings of the 17th international symposium on High performance distributed computing, pages 153-164, 2008.
14. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles, pages 96-108, Bolton Landing, NewYork, October 2003.
15. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51-81, 1988.
16. G. H. Kuenning and G. J. Popek. Automated hoarding for mobile computers. In Proceedings of the 16th ACM Symposium on Operating Systems Principles, volume 31, pages 264 - 275, December 1997.
17. Ranganathan and I. Foster. Decoupling computation and data scheduling in distributed data-intensive applications. In Proceedings of th 11th IEEE International Symposium on High Performance Distributed Computing, pages 352-358, 2002.
18. K. B. Rashedur M. Rahman and R. Alhajj. Study of different replica placement and maintenance strategies in data grid. In Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pages 171-178, 2007.
19. H. Sato, S. Matsuoka, T. Endo, and N. Maruyama. Accesspattern and bandwidth aware file replication algorithm in a grid environment. In Proceedings of the 9th IEEE/ACM International Conference on Grid Computing, pages 250-257, Tsukuba, September 2008.
20. S. Shankar and D. J. DeWitt. Data driven workflow planning in cluster management systems. In Proceedings of the 16th IEEE International Symposium on High Performance Distributed Computing, pages 127-136, New York, NY, USA, 2007.
21. O. Tatebe, Y. Morita, S. Matsuoka, N. Soda, and S. Sekiguchi. Grid datafarm architecture for petascale data intensive computing. In Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, pages 102 - 110, 2002.
22. S. Venugopal, R. Buyya, and K. Ramamohanarao. A taxonomy of data grids for distributed data sharing, management, and processing. ACM Computing Surveys, 38(1):3, 2006.
23. Y. Wang and D. Kaeli. Load balancing using grid-based peer-to-peer parallel I/O. In In Proceedings of IEEE International Conference on Cluster Computing, pages 1 - 10, 2005.