Book Image

Cloudera Administration Handbook

By : Rohit Menon
Book Image

Cloudera Administration Handbook

By: Rohit Menon

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Cloudera Administration Handbook
Rohit Menon
Jul, 2014 | 254 pages
No titles found
Table of Contents (17 chapters)
Cloudera Administration Handbook
Cloudera Administration Handbook
Credits
Credits
Notice
Notice
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Getting Started with Apache Hadoop
Getting Started with Apache Hadoop
History of Apache Hadoop and its trends
Components of Apache Hadoop
Understanding the Apache Hadoop daemons
Introducing Cloudera
Introducing CDH
Responsibilities of a Hadoop administrator
Summary
2
HDFS and MapReduce
HDFS and MapReduce
Essentials of HDFS
The read/write operational flow in HDFS
Understanding the namenode UI
Understanding the secondary namenode UI
Exploring HDFS commands
Getting acquainted with MapReduce
Summary
3
Cloudera's Distribution Including Apache Hadoop
Cloudera's Distribution Including Apache Hadoop
Getting started with CDH
Understanding the CDH components
Installing CDH
Installing the CDH components
Summary
4
Exploring HDFS Federation and Its High Availability
Exploring HDFS Federation and Its High Availability
Implementing HDFS Federation
Implementing HDFS High Availability
Jobtracker high availability
Summary
5
Using Cloudera Manager
Using Cloudera Manager
Introducing Cloudera Manager
Understanding the Cloudera Manager architecture
Installing Cloudera Manager
Navigating the Cloudera Manager Web console
Configuring High Availability using Cloudera Manager
Summary
6
Implementing Security Using Kerberos
Implementing Security Using Kerberos
Understanding authentication and authorization
Introducing Kerberos
Understanding the Kerberos Architecture
Installing Kerberos
Configuring Kerberos for Apache Hadoop
Authorization in Apache Hadoop
Summary
7
Managing an Apache Hadoop Cluster
Managing an Apache Hadoop Cluster
Configuring Hadoop services using Cloudera Manager
Role management in Cloudera Manager
Managing hosts using Cloudera Manager
Managing multiple clusters with Cloudera Manager
Rebalancing a Hadoop cluster from Cloudera Manager
Summary
8
Cluster Monitoring Using Events and Alerts
Cluster Monitoring Using Events and Alerts
Monitoring Hadoop services from Cloudera Manager
Understanding events and alerts
Summary
9
Configuring Backups
Configuring Backups
Understanding backups
Understanding HDFS backups
Using the distributed copy (DistCp)
Configuring backups using Cloudera Manager
Summary
Index
Index

Installing Cloudera Manager

Cloudera Manager can be installed using the following two methods:

  • Automatic installation

  • Manual installation

In this section, we will walk through the steps for automatic installation as most of the configurations are handled efficiently by Cloudera Manager itself.

For this demonstration, we will be using the following machine configuration for the Cloudera Manager Server:

  • Operating system: CentOS 6.4

  • RAM: 4 GB

  • CPU: 4 CPU cores

  • Disk space: 50 GB

For the machines running the Cloudera Manager Agents, we will use the following configuration:

  • Operating system: CentOS 6.4

  • RAM: 4 GB

  • CPU: 4 CPU cores

  • Disk space: This will depend on the volume of data you want to store in your cluster

Note

For a complete list of all the hardware and software requirements, visit the following Cloudera website:

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/latest/Cloudera-Manager-Installation-Guide/cmig_cm_requirements.html

The following are the steps to install Cloudera...

Previous Section
End of Section 4
Next Section