The rhdfs
package is the interface between R and HDFS, which allows users to access HDFS from an R console. Similar to rmr2
, one should install rhdfs
on every task node, so that one can access HDFS resources through R. In this recipe, we will introduce how to install rhdfs
on the Cloudera QuickStart VM.
Ensure that you have completed the previous recipe by starting the Cloudera QuickStart VM and connecting the VM to the Internet, so that you can proceed with downloading and installing the rhdfs
package.
Perform the following steps to install rhdfs
:
First, you can download
rhdfs 1.0.8
from GitHub. You may need to update the link if Revolution Analytics upgrades the version ofrhdfs
:$wget --no-check-certificate https://raw.github.com/RevolutionAnalytics/rhdfs/master/build/rhdfs_1.0.8.tar.gz
Next, you can install
rhdfs
under the command-line mode:$ sudo HADOOP_CMD=/usr/bin/hadoop R CMD INSTALL rhdfs_1.0.8.tar.gz
You can then set up
JAVA_HOME
. The...