DRAW: A new data-grouping-aware data placement scheme for data intensive applications with interest locality

IEEE Transactions on Magnetics

Volumn 49, Issue 6, 2013, Pages 2514-2520

  Wang, Jun ^a   Xiao, Qiangju ^a   Yin, Jiangling ^a   Shang, Pengju ^a  

^a University of Central Florida   (United States)

Author keywords

Data intensive; data layout; Hadoop; MapReduce

Indexed keywords

DATA INTENSIVE; DATA LAYOUTS; DATA PARALLEL COMPUTING; DATA PLACEMENT; DATA-INTENSIVE APPLICATION; HADOOP; MAP-REDUCE; RANDOM PLACEMENT;

EQUIPMENT TESTING; INTERCONNECTION NETWORKS; PARALLEL ARCHITECTURES; SEMANTICS;

DIGITAL STORAGE;

EID: 84878770725     PISSN: 00189464     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMAG.2013.2251613     Document Type: Article

References (25)

1. [Online]. Available: http://aws.amazon.com/s3/
2. [Online]. Available: http://bowtie-bio.sourceforge.net/index.shtml
3. [Online]. Available: http://developer.yahoo.com/hadoop/tutorial/module1. html
4. [Online]. Available: http://genome.ucsc.edu/
5. [Online]. Available: http://hadoop.apache.org/common/docs/r0.18.3/hdfs\- design.html
6. [Online]. Available: http://michael.dipperstein.com/bwt/
7. [Online]. Available: http://sector.sourceforge.net/benchmark.html
8. [Online].Available:https://issues.apache.org/jira/browse/hadoop-2559
9. [Online]. Available: http://t8web.lanl.gov/people/heitmann/arxiv/
10. A. Amer,D.D. E. Long, and R. C.Burns, "Group-basedmanagement of distributed file caches," in Proc. 22nd Int. Conf. Distrib. Comput. Syst. (ICDCS'02),Washington,DC, USA, 2002, p. 525, IEEEComputer Soc.
11. A. Dumitriu, "X and y (number 5)," in Proc. ACM SIGGRAPH 2004 Art Gallery SIGGRAPH'04, New York, NY, USA, 2004, p. 28, ACM.
12. G. Ganger and M. Frans Kaashoek, "Embedded inodes and explicit grouping: Exploiting disk bandwidth for small files," in Proc. 1997 USENIX Technol. Conf., 1997, pp. 1-17.
13. N. Gorla and K. Zhang, "Deriving program physical structures using bond energy algorithm," in Proc. 6th Asia Pacific Software Eng. Conf. APSEC'99,Washington, DC, USA, 1999, p. 359, IEEE Computer Soc.
14. Y. Hahn and B. Lee, "Identification of nine human-specific frameshift mutations by comparative analysis of the human and the chimpanzee genome sequences," Bioinformatics, vol. 21, pp. 186-194, Jan. 2005.
15. X. Jiong, Y. Shu, R. Xiaojun, D. Zhiyang, T. Yun, J. Majors, A. Manzanares, and Q. Xiao, "Improving mapreduce performance through data placement in heterogeneous hadoop clusters," Apr. 2010.
16. G. H.Kuenning andG. J. Popek, "Automated hoarding for mobile computers," in Proc. 16th ACM Symp. Operat. Syst. Principles, SOSP'97, New York, 1997, pp. 264-275, ACM. (Pubitemid 127466044)
17. J. G. Liu, M. Ghanem, V. Curcin, C. Haselwimmer, Y. Guo, G. Morgan, and K. Mish, "Achievements and experiences from a grid-based earthquake analysis and modelling study," in Proc. 2nd IEEE Int. Conf. e-Science and Grid Computing, E-SCIENCE'06, Washington, DC, USA, 2006, p. 35-, IEEE Computer Soc.
18. M. T. Özsu and P. Valduriez, Principles of Distributed Database Systems , 2nd ed. Upper Saddle River, NJ, USA: Prentice-Hall, 1999.
19. M. Rodriguez-Martinez, J. Seguel, and M. Greer, "Open source cloud computing tools: A case study with a weather application," in Proc. 2010 IEEE 3rd Int. Conf. Cloud Comput. CLOUD'10, Washington, DC, USA, 2010, pp. 443-449, IEEE Computer Soc.
20. M. C. Schatz, "Cloudburst," Bioinformatics, vol. 25, pp. 1363-1369, Jun. 2009.
21. S. Sehrish, G. Mackey, J. Wang, and J. Bent, "Mrap: A novel mapreduce-based framework to support HPC analytics applications with access patterns," in Proc. 19th ACM Int. Symp. High Perform. Distrib. Comput. HPDC'10, New York, NY, USA, 2010, pp. 107-118, ACM.
22. M.Specht, R. Lebrun, andC. P. E. Zollikofer, "Visualizing shape transformation between chimpanzee and human braincases," Vis. Comput., vol. 23, pp. 743-751, Aug. 2007. (Pubitemid 350092391)
23. S. Tripathi and R. S. Govindaraju, "Change detection in rainfall and temperature patterns over india," in Proc. 3rd Int. Workshop on Knowledge Discov. Sens. Data, SensorKDD'09, New York, NY, USA, 2009, pp. 133-141, ACM.
24. D. Yuan, Y. Yang, X. Liu, and J. Chen, "A data placement strategy in scientific cloud workflows," Future Gener. Comput. Syst., vol. 26, pp. 1200-1214, Oct. 2010.
25. B. Zhang, N. Zhang, H. Li, F. Liu, and K. Miao, "An efficient cloud computing-based architecture for freight system application in china railway," in Proc. 1st Int. Conf. Cloud Comput. CloudCom'09, Berlin, Germany, 2009, pp. 359-368, Springer-Verlag