Book Image

YARN Essentials

Book Image

YARN Essentials

Overview of this book

Table of Contents (17 chapters)
YARN Essentials
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Free Chapter
1
Need for YARN
9
YARN – Alternative Solutions
Index

Backward compatibility of MRv2 APIs


This section discusses the scope and level of backward compatibility supported in Apache Hadoop MapReduce 2.x (MRv2).

Binary compatibility of org.apache.hadoop.mapred APIs

Binary compatibility here means that the compiled binaries should be able to run without any modification on the new framework.

For those Hadoop 1.x users who use the org.apache.hadoop.mapred APIs, they can simply run their MapReduce jobs on YARN just by pointing them to their Apache Hadoop 2.x cluster via the configuration settings.

They will not need any recompilation. All they will need to do is point their application to the YARN installation and point HADOOP_CONF_DIR to the corresponding configuration directory. The yarn-site.xml (configuration for YARN) and mapred-site.xml files (configuration for MapReduce apps) are present in the conf directory.

Also, mapred.job.tracker in mapred-site.xml is no longer necessary in Apache Hadoop 2.x. Instead, the following property needs to be added...