Paper Title

Scheduling Techniques for Workload Distribution in YARN Containers

Authors

  • Rajneesh Kumar
  • Dr. S.Govindarajan

Keywords

Hadoop, HDFS, MapReduce, Schedulers, YARN

Abstract

Big Data, the analysis of large quantities of data to gain new insight has become a ubiquitous phrase in recent years. Day by day the data is growing at a staggering rate. One of the efficient technologies that deal with the Big Data is Hadoop, which will be discussed in this paper. Hadoop, for processing large data volume jobs uses MapReduce programming model. Hadoop makes use of different schedulers for executing the jobs in parallel. The default scheduler is FIFO (First In First Out) Scheduler. Other schedulers with priority, pre-emption and non-pre-emption options have also been developed. As the time has passed the MapReduce has reached few of its limitations. So in order to overcome the limitations of MapReduce, the next generation of MapReduce has been developed called as YARN (Yet Another Resource Negotiator). So, this paper provides a survey on Hadoop, few scheduling methods it uses and a brief introduction to YARN.

Article Type

Published

How To Cite

Rajneesh Kumar, Dr. S.Govindarajan. "Scheduling Techniques for Workload Distribution in YARN Containers".INTERNATIONAL JOURNAL OF ENGINEERING DEVELOPMENT AND RESEARCH ISSN:2321-9939, Vol.3, Issue 2, pp.66-70, URL :https://rjwave.org/ijedr/papers/IJEDR1502013.pdf

Issue

Volume 3 Issue 2 

Pages. 66-70

Article Preview