The rhdfs
package is the interface between R and HDFS, which allows users to access HDFS from an R console. Similar to rmr2
, one should install rhdfs
on every task node, so that one can access HDFS resources through R. In this recipe, we will look at how to install rhdfs
on the Cloudera QuickStart VM.
Ensure that you have completed the previous recipe by starting the Cloudera QuickStart VM and connecting the VM to the internet, so that you can proceed with downloading and installing the rhdfs
package.
Perform the following steps to install rhdfs
:
- First, you can download
rhdfs 1.0.8
from GitHub. You may need to update the link if Revolution Analytics upgrades the version ofrhdfs
:
$wget --no-check-certificate
https://raw.github.com/RevolutionAnalytics/rhdfs/master/
build/rhdfs_1.0.8.tar.gz
- Next, you can install
rhdfs
under the command-line mode:
$ sudo HADOOP_CMD=/usr/bin/hadoop R CMD INSTALL
rhdfs_1.0.8.tar.gz
- You can then set...