Hadoop on Mesos (https://github.com/mesos/hadoop) relies on the extension to Mesos, such as the Mesos executor to execute TaskTrackers and Hadoop JobTracker Mesos Scheduler to run Hadoop on a Mesos framework. We will run Hadoop 1.x on Mesos:
Install and run Mesos by following the instructions in Chapter 1, Running Mesos.
We need to compile Hadoop on the Mesos library. Hadoop on Mesos uses Maven to manage dependencies, which we will need to install along with Java and Git:
ubuntu@master:~ $ sudo apt-get install maven openjdk-7-jdk git
Let's clone Hadoop on the Mesos source code from https://github.com/mesos/hadoop, and navigate to it using the following command:
ubuntu@master:~ $ git clone https://github.com/mesos/hadoop/ ubuntu@master:~ $ cd hadoop
Build Hadoop on the Mesos binaries from the code using the following command. By default, it will build the latest version of Mesos and Hadoop. If required, we can adjust the versions in the
pom.xml
file:ubuntu@master:~ $...