As the Hadoop and YARN frameworks use commodity hardware for the cluster setup and scaling from several nodes to several thousand nodes, all the components of Hadoop or YARN are designed on the assumption that hardware failures are very common. Therefore, these failures would be automatically handled by the framework so that important data is not lost because of them. For this, Hadoop provides data replication across the nodes/racks so that even if the whole rack fails, data would be recovered from another node on another rack, and jobs would be restarted over another replica dataset to compute the results.
YARN Essentials
YARN Essentials
Overview of this book
Table of Contents (17 chapters)
YARN Essentials
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
YARN Architecture
YARN Installation
YARN and Hadoop Ecosystems
YARN Administration
Developing and Running a Simple YARN Application
YARN Frameworks
Failures in YARN
YARN – Alternative Solutions
YARN – Future and Support
Index
Customer Reviews