A file assignment strategy independent of workload characteristic assumptions

ACM Transactions on Storage

Volumn 5, Issue 3, 2009, Pages

  Xie, Tao ^a   Sun, Yao ^b  

^a San Diego State University   (United States)

^b TERADATA CORPORATION   (United States)

Author keywords

File assignment; Load balancing; Parallel I O; Workload characteristics; Zipfian distribution

Indexed keywords

ASSIGNMENT ALGORITHMS; ASSIGNMENT STRATEGIES; FILE ACCESS; FILE SIZES; INVERSE CORRELATION; LOAD-BALANCING; MEAN RESPONSE TIME; PARALLEL I/O; PARALLEL I/O SYSTEMS; ROUND ROBIN; WEB PROXY; WORKLOAD CHARACTERISTICS;

INTERNET SERVICE PROVIDERS;

EID: 72449150673     PISSN: 15533077     EISSN: 15533093     Source Type: Journal    
DOI: 10.1145/1629075.1629079     Document Type: Article

References (34)

1. ALMEDA, V., CESARIO, M., FONSECA, R.,MEIRA, W. JR., ANDMURTA, C. 1998. Analyzing the behaviour of a proxy server. In Proceedings of the 3rd International Caching Workshop.
2. ALVAREZ, G. A., BOROWSKY, E., GO, S., ROMER, T. H., BECKER-SZENDY, R., GOLDING, R., MERCHANT, A., SPASOJEVIC, M., VEITCH, A., AND WILKES, J. 2001. Minerva: An automated resource provisioning tool for large-scale storage systems. ACM Trans. Comput. Syst. 19, 4, 483-518.
3. ANDERSON, E., SPENCE, S., SWAMINATHAN, R., KALLAHALLA, M., AND WANG, Q. 2005. Quickly finding near-optimal storage designs. ACM Trans. Comput. Syst. 23, 4, 337-374.
4. ARLITT, M. AND JIN, T. 1999. Workload characterization of the 1998 World Cup Web site. Tech. rep., HPL-1999-35R1, HP Labs.
5. BRESLAU, L. CAO, P., FAN, L., PHILLIPS, G., AND SHENKER, S. 1999. Web caching and Zip-like distributions: Evidence and implications. In Proceedings of the 18th Conference on Computer Communications. 126-134.
6. BUCHHOLZ, S. AND BUCHHOLZ, T. 2004. Replica placement in adaptive content distribution networks. In Proceedings of the ACM Symposium on Applied Computing. 1705-1710.
7. CARRERA, E. V., PINHEIRO, E., AND BIANCHINI, R. 2003. Conserving disk energy in network servers. In Proceedings of the 17th Annual International Conference on Supercomputing. 86-97.
8. CHEN, P. M., LEE, E. K., GIBSON, G. A., KATZ, R. H., AND PATTERSON, D. A. 1994. RAID: Highperformance, reliable secondary storage. ACM Comput. Surv. 26, 2, 145-185.
9. CHU, W. Optimal file allocation in a multiple computer system. IEEE Trans. Comput. 18, 10, 885-889.
10. CUNHA, C., BESTAVROS, A., AND CROVELLA, M. 1995. Characteristics of WWW client-based traces. Tech. rep., 1995-2010, Boston University.
11. DOWDY, W. AND FOSTER, D. 1982. Comparative models of the file assignment problem. ACM Comput. Surv. 14, 2, 287-313.
12. FOSTER, I. 2004. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, Los Altos, CA.
13. GLASSMAN, S. 1994. A caching relay for the World Wide Web. In Proceedings of the 1st International Conference on the World-Wide Web. 165-173.
14. GRAHAM, R. L. 1969. Bounds on multiprocessing timing anomalies. SIAM J. Appl. Math. 7, 2, 416-429.
15. HSU, W. W., SMITH, A. J., AND YOUNG, H. C. 2005. The automatic improvement of locality in storage systems. ACM Trans. Comput. Syst. 23, 4, 424-473.
16. HUANG, H., HUNG, W., AND SHIN, K. G. 2005. FS2: dynamic data replication in free disk space for improving disk performance and energy consumption. In Proceedings of the 12th ACM Symposium on Operating Systems Principles. 263-276.
17. KANGASHARJU, J., ROBERTS, J., AND ROSS, K. 2002. Object replication strategies in content distribution networks. Comput. Comm. 25, 4, 367-383.
18. KARLSSON, M. AND KARAMANOLIS, C. 2004. Choosing replica placement heuristics for wide-area systems. In Proceedings of the 24th International Conference on Distributed Computing Systems. 350-359.
19. KWAN, T.,MCGRATH, R., AND REED, D. 1995. Ncsas world wide web server design and performance. Comput. 28, 11, 67-74.
20. LEE, L. W., SCHEUERMANN, P., AND VINGRALEK, R. 2000. File assignment in parallel I/O systems with minimal variance of service time. IEEE Trans. Comput. 49, 2, 127-140.
21. LOUKOPOULOS, T. AND AHMAD, I. 2000. Static and adaptive data replication algorithms for fast information access in large distributed systems. In Proceedings of the 20th International Conference on Distributed Computing Systems. 385-392.
22. LOUKOPOULOS, T., LAMPSAS, P., AND AHMAD, I. 2005. Continuous replica placement schemes in distributed systems. In Proceedings of the 19th Annual International Conference on Supercomputing. 284-292.
23. MERIALDO, P., ATZENI, P., AND MECCA, G. 2003. Design and development of data-intensive web sites: The Araneus approach. ACM Trans. Inter. Tech. 3, 1, 49-92.
24. NISHIKAWA,N.,HOSOKAWA, T.,MORI, Y., YOSHIDA, K., AND TSUJI,H. 1998. Memory-based architecture for distributedWWWcaching proxy. In Proceedings of the 7th International Conference on World Wide Web. 205-214.
25. PATTIPATI, K. R. AND WOLF, J. L. 1990. A file assignment problem model for extended local area network environments. In Proceedings of the 10th International Conference on Distributed Computing Systems. 554-561.
26. QIU, L., PADMANABHAN, V. N., AND VOELKER, G. M. 2001. On the placement of web server replicas. In Proceedings of the 21th Annual Joint Conference on Computer and Communications. 1587-1596.
27. SCHEUERMANN, P., WEIKUM, G., AND ZABBACK, P. 1998. Data partitioning and load balancing in parallel disk systems. VLDB 7, 1, 48-66.
28. TANG, X. AND XU, J. 2004. On replica placement for QoS-aware content distribution. In Proceedings of the 23rd Annual Joint Conference on Computer and Communications. 806-815.
29. TEWARI, R. 1992. Distributed file allocation with consistency constraints. In Proceedings of the 12th International Conference on Distributed Computing Systems. 408-415.
30. TRIANTAFILLOU, P., CHRISTODOULAKIS, S., AND GEORGIADIS, C. 2000. Optimal data placement on disks: A comprehensive solution for different technologies. IEEE Trans. Knowl. Data Engin. 12, 2, 324-330.
31. WEIL, S. A., BRANDT, S. A., MILLER, E. L., AND MALTZAHN, C. 2006. CRUSH: Controlled, scalable, decentralized placement of replicated data. In Proceedings of the ACM/IEEE Conference on Supercomputing. 122.
32. WOLFSON,O., JAJODIA, S., ANDHUANG,Y. 1997. An adaptive data replication algorithm.ACMTrans. Datab. Syst. 22, 4, 255-314.
33. XIE, T. 2007. SOR: A static file assignment strategy immune to workload characteristic assumptions in parallel I/O systems. In Proceedings of the 36th International Conference on Parallel Processing (ICPP).
34. XIE, T. 2008. SEA: A striping-based energy-aware strategy for data placement in RAIDstructured storage systems. IEEE Trans. Comput. 57, 6, 748-761.