5. YARN Administration | YARN Essentials

YARN scheduling policies

The YARN architecture has pluggable scheduling policies that depend on the application's requirements and the use case defined for the running application. You can find the YARN scheduling configurations in the yarn-site.xml file. Here, you can specify the scheduling system as either FIFO, capacity, or fair scheduling as per the application's needs. You can also find the running application scheduling information in the ResourceManager UI. Many components of the scheduling system are defined briefly there.

As already mentioned, there are three type of scheduling policies that the YARN scheduler follows:

FIFO scheduler
Capacity scheduler
Fair scheduler

The FIFO (First In First Out) scheduler

This is the scheduling policy introduced into the system from Hadoop 1.0. The JobTracker was used to be FIFO scheduling policies. As the name indicates, FIFO means First in First Out, that is, the job submitted first will execute first. The FIFO scheduler policy does not follow any...

Tech Concepts

Programming languages

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

YARN Essentials

By : Fasale, Nirmal Kumar

YARN Essentials

By: Fasale, Nirmal Kumar

Overview of this book

YARN scheduling policies

The FIFO (First In First Out) scheduler

YARN Essentials

By : Fasale, Nirmal Kumar

YARN Essentials

By: Fasale, Nirmal Kumar

Overview of this book

YARN scheduling policies

The FIFO (First In First Out) scheduler

Confirmation

Buy this book with your credits?

Submit Your Feedback

Create a Free Account To Continue Reading

Sign in to activate your 7-day free access