Book Image

YARN Essentials

Book Image

YARN Essentials

Overview of this book

Table of Contents (17 chapters)
YARN Essentials
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Free Chapter
1
Need for YARN
9
YARN – Alternative Solutions
Index

Container configurations


Here are the some important configurations related to resource containers that are used to control containers.

To control the memory allocation to a container, the administrator needs to set the following three parameters in the yarn-site.xml configuration file:

Parameter

Description

yarn.nodemanager.resource.memory-mb

This is the amount of memory in MBs that the NodeManager can use for the containers.

yarn.scheduler.minimum-allocation-mb

This is the smallest amount of memory in MBs allocated to the container by the ResourceManager. The default value is 1024 MB.

yarn.scheduler.maximum-allocation-mb

This is the largest amount of memory in MBs allocated to the container by the ResourceManager. The default value is 8192 MB.

The CPU core allocations to the container are controlled by setting the following properties in the yarn-site.xml configuration file:

Parameter

Description

yarn.scheduler.minimum-allocation-vcores

This is the minimum number of CPU...