Performance evaluation of HDFS in big data management

2014 International Conference on High Performance Computing and Applications, ICHPCA 2014

Volumn , Issue , 2015, Pages

  Dev, Dipayan ^a   Patgiri, Ripon ^a  

^a NATIONAL INSTITUTE OF TECHNOLOGY SILCHAR   (India)

Author keywords

DataNode; HDFS; JobTracker; Metadata; NameNode

Indexed keywords

FILE ORGANIZATION; INFORMATION MANAGEMENT; LARGE DATASET; METADATA; OPEN SOURCE SOFTWARE;

DATA-INTENSIVE COMPUTATION; DATANODE; DISTRIBUTED FILE SYSTEMS; HADOOP DISTRIBUTED FILE SYSTEM (HDFS); HDFS; JOBTRACKER; NAMENODE; OPEN SOURCE IMPLEMENTATION;

DATA HANDLING;

EID: 84925398192     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICHPCA.2014.7045330     Document Type: Conference Paper

References (16)

1. Manghui Tu, Peng Li, I-Ling Yen, Bhavani Thuraisingham, Latifur Khan.Secure Data Objects Replication in Data Grid., IEEE Transactions on Dependable and Secure computing, Vol. 7, No. 1, 2010
2. Apache Hadoop, http://hadoop.apache.org/
3. P. H. Cams, W. B. Ligon III, R. B. Ross, and R. Thakur, PVFS: A parallel file system for Linux clusters, in Proc. of 4th Annual Linux Showcase and Conference, 2000, pp. 317327.
4. Hong Sha, Yang Shenyuan, Key technology of cloud computing and research on cloud computing model based on Hadoop, Software Guide, 2010, 9(9): 9 I I.
5. Xie Guilan, Luo shengxian, Research on applications based on Hadoop MapReduce model, Microcomputer & its applications, 2010, (8): 4 7.
6. Jeflrey Shafer, Scott Rixner, and Alan L. Cox., The Hadoop Distributed Filesystem: Balancing Portability and Performance., Performance Analysis of Systems & Software (ISPASS), 2010 122 133.
7. Xin Daxin, Liu Fei, Research on optimization techniques for Hadoop cluster performance., Computer Knowledge and Technology, 2011, 8(7):5484 5486.
8. Lu Huang;Hai-Shan Chen;Ting-Ting Hu, Research on Hadoop Cloud Computing Model and its Applications., Networking and Distributed Computing (ICNDC), 2012, 59 63
9. S. Ghemawat, H. Gobioff, S. Leung, The Googlefile system., In Proc. Of ACM Symposium on Operating Systems Principles, Lake George, NY, Oct 2003, pp 2943.
10. w. Tantisiriroj, S. Patil, G. Gibson, Data-intensive file systems for Internet services: A rose by any other name., Technical Report CMUPDL-08-114, Parallel Data Laboratory, Carnegie Mellon University, Pittsburgh, PA, October 2008
11. Lustre File System. http://www.lustre.org
12. K. V. ShvachkoHDFS Scalability: The limits to growth., login:. April 2010, pp. 616
13. M. K. McKusick, S. Quinlan.GFS: Evolution on Fast-fonvard., ACM Queue, vol. 7, no. 7, New York, NY. August 2009
14. Shvachko, K.; Hairong Kuang; Radia, S.; Chansler, R.The Hadoop Distributed File System., Mass Storage Systems and Technologies (MSST), 2010 IEEE 26th Symposium on, vol no. pp.l, IO, 3-7 May 2010
15. Bhandarkar, M.MapReduce programming with apache Hadoop. Parallel & Distributed Processing (IPDPS), 2010 IEEE International Symposium on, vol., no., pp.l, I, 19-23 April 2010
16. Jinshuang Yan; Xiaoliang Yang; Rong Gu; Chunfeng Yuan; Yihua Huang.Peiformance Optimization for Short MapReduce Job Execution in Hadoop., Cloud and Green Computing (CGC), 2012 Second International Conference on, vol no., pp.688, 694, 1-3 Nov. 2012