CFP last date
20 May 2024
Reseach Article

Improving Data Transfer Rate and Throughput of HDFS using Efficient Replica Placement

by Neha M Patel, Narendra M Patel, Mosin I Hasan, Mayur M Patel
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 86 - Number 2
Year of Publication: 2014
Authors: Neha M Patel, Narendra M Patel, Mosin I Hasan, Mayur M Patel
10.5120/14955-3121

Neha M Patel, Narendra M Patel, Mosin I Hasan, Mayur M Patel . Improving Data Transfer Rate and Throughput of HDFS using Efficient Replica Placement. International Journal of Computer Applications. 86, 2 ( January 2014), 4-7. DOI=10.5120/14955-3121

@article{ 10.5120/14955-3121,
author = { Neha M Patel, Narendra M Patel, Mosin I Hasan, Mayur M Patel },
title = { Improving Data Transfer Rate and Throughput of HDFS using Efficient Replica Placement },
journal = { International Journal of Computer Applications },
issue_date = { January 2014 },
volume = { 86 },
number = { 2 },
month = { January },
year = { 2014 },
issn = { 0975-8887 },
pages = { 4-7 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume86/number2/14955-3121/ },
doi = { 10.5120/14955-3121 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:03:08.924917+05:30
%A Neha M Patel
%A Narendra M Patel
%A Mosin I Hasan
%A Mayur M Patel
%T Improving Data Transfer Rate and Throughput of HDFS using Efficient Replica Placement
%J International Journal of Computer Applications
%@ 0975-8887
%V 86
%N 2
%P 4-7
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

In last half decade, there is tremendous growth in the network applications; we are experiencing an information explosion era. Due to which large amount of distributed data being managed and stored. To handle these types of data, application uses distributed file system. Advantages of DFS are increased availability and efficiency. Generally some parameters like scalability, reliability, transparency, fault tolerance and security are considered while making DFS. Some open challenges are still there in DFS like fault tolerance in various conditions, optimized architecture of DFS, Synchronization, consistency and replications. Goal of this paper is study evolution of DFS from the history; current state of the art design & implementation of the DFS and propose new approach for efficient replica placement in Hadoop DFS which can improve throughput and data transfer rate.

References
  1. Lin Weiwei, Liang Chen and Liu Bo. A Hadoop-based Efficient Economic Cloud Storage System. PACCS at Wuhan, China - July 2011. IEEE Conference Publication.
  2. Mahesh Maurya, Chitvan Oza and Prof. Ketan Shah. A Review of Distributed File System. ICAET at Nagapattinam, India – May 2011. CiiT International Journals Conference Publication.
  3. MARTIN PLACEK and RAJKUMAR BUYYA. Taxonomy of Distributed Storage Systems. The Cloud Computing and Distributed Systems (CLOUDS) Laboratory, University of Melbourne- July 2006.
  4. Tran Doan Thanh, Subaji Mohan, Eunmi Choi, SangBum Kim, Pilsung Kim. A Taxonomy and Survey on Distributed File Systems. NCM at Geongju, Korea - September 2008. IEEE Conference Publication.
  5. Song Guang hua, Chuai Jun na, Yang Bo Wei, Zheng Yao. QDFS – A Quality Aware Distributed File Storage Service Based on HDFS. IEEE-CSAE at Shanghai, China - June 2011. IEEE Conference Publication.
  6. Debessay Fesehaye, Rahul Malik, Klara Nahrstedt. EDFS - A Semi- Centralized Efficient Distributed File System. Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware Article No. 28 Springer – Verlag, New York, USA – 2009.
  7. Fabio Kon. Distribute File Systems Past, Present and Future A Distributed File System for 2006. March 1996.
  8. M Satyanarayanan. A Survey of Distributed File Systems. February 1989. Tech. Rep. CMU-CS-89-116, Pittsburgh, Pennsylvania.
  9. John H. Howard, Michael L. Kazar, Sherri G. Menees, David A. Nichols, M. Satyanarayanan, Robert N. Sidebotham, and Michael J. West. Scale and performance in adistributed file system. ACM Transactions on Computer Systems, 6:51–81, 1988.
  10. Design and Implementation or the Sun Network Filesystem by Russel Sandberg , David Goldberg , Steve Kleiman , Dan Walsh , Bob Lyon.
  11. Debessay Fesehaye, Rahul Malik, Klara Nahrstedt. A Scalable Distributed File System for Cloud Computing.
  12. K. Shvachko, Hairong Kuang, S. Radia, and R. Chansler, "The Hadoop Distributed File System," , Incline Village, NV, 2010, pp. 1-10.
  13. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung, "The Google file system," in SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles, New York, NY, USA, 2003, pp. 29-43.
  14. Philippas Tsigas, "AFS Report," Department of Computing Science, Chalmers University of Technology, Göteborg, Sweden, Lecture 2010.
  15. John H. Howard, "An Overview of the Andrew File System," in Proceedings of the USENIX Winter Technical Conference, Dallas TX, 1988.
  16. http://www. openafs. org/
  17. http://research. google. com/gfs. html
  18. http://www. xtreemfs. org/
  19. http://hadoop. apache. org/
Index Terms

Computer Science
Information Sciences

Keywords

NFS AFS GFS XtreemFS HDFS.