Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Cloudera Administration Handbook
  • Table Of Contents Toc
Cloudera Administration Handbook

Cloudera Administration Handbook

By : Menon
3.5 (10)
Buy this Book
close
close
Cloudera Administration Handbook

Cloudera Administration Handbook

3.5 (10)
By: Menon
Buy this Book

Overview of this book

An easy-to-follow Apache Hadoop administrator’s guide filled with practical screenshots and explanations for each step and configuration. This book is great for administrators interested in setting up and managing a large Hadoop cluster. If you are an administrator, or want to be an administrator, and you are ready to build and maintain a production-level cluster running CDH5, then this book is for you.
Table of Contents (11 chapters)
close
close
close
Preface
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Lock Free Chapter
1
1. Getting Started with Apache Hadoop
Icon
1. Getting Started with Apache Hadoop
Icon
History of Apache Hadoop and its trends
Icon
Components of Apache Hadoop
Icon
Understanding the Apache Hadoop daemons
Icon
Introducing Cloudera
Icon
Introducing CDH
Icon
Responsibilities of a Hadoop administrator
Icon
Summary
2
2. HDFS and MapReduce
Icon
2. HDFS and MapReduce
Icon
Essentials of HDFS
Icon
The read/write operational flow in HDFS
Icon
Understanding the namenode UI
Icon
Understanding the secondary namenode UI
Icon
Exploring HDFS commands
Icon
Getting acquainted with MapReduce
Icon
Summary
3
3. Cloudera's Distribution Including Apache Hadoop
Icon
3. Cloudera's Distribution Including Apache Hadoop
Icon
Getting started with CDH
Icon
Understanding the CDH components
Icon
Installing CDH
Icon
Installing the CDH components
Icon
Summary
4
4. Exploring HDFS Federation and Its High Availability
Icon
4. Exploring HDFS Federation and Its High Availability
Icon
Implementing HDFS Federation
Icon
Implementing HDFS High Availability
Icon
Jobtracker high availability
Icon
Summary
5
5. Using Cloudera Manager
Icon
5. Using Cloudera Manager
Icon
Introducing Cloudera Manager
Icon
Understanding the Cloudera Manager architecture
Icon
Installing Cloudera Manager
Icon
Navigating the Cloudera Manager Web console
Icon
Configuring High Availability using Cloudera Manager
Icon
Summary
6
6. Implementing Security Using Kerberos
Icon
6. Implementing Security Using Kerberos
Icon
Understanding authentication and authorization
Icon
Introducing Kerberos
Icon
Understanding the Kerberos Architecture
Icon
Installing Kerberos
Icon
Configuring Kerberos for Apache Hadoop
Icon
Authorization in Apache Hadoop
Icon
Summary
7
7. Managing an Apache Hadoop Cluster
Icon
7. Managing an Apache Hadoop Cluster
Icon
Configuring Hadoop services using Cloudera Manager
Icon
Role management in Cloudera Manager
Icon
Managing hosts using Cloudera Manager
Icon
Managing multiple clusters with Cloudera Manager
Icon
Rebalancing a Hadoop cluster from Cloudera Manager
Icon
Summary
8
8. Cluster Monitoring Using Events and Alerts
Icon
8. Cluster Monitoring Using Events and Alerts
Icon
Monitoring Hadoop services from Cloudera Manager
Icon
Understanding events and alerts
Icon
Summary
9
9. Configuring Backups
chevron up
Icon
9. Configuring Backups
Icon
Understanding backups
Icon
Understanding HDFS backups
Icon
Using the distributed copy (DistCp)
Icon
Configuring backups using Cloudera Manager
Icon
Summary
10
Index
Icon
Index

Using the distributed copy (DistCp)

Distributed copy (DistCp) is a Hadoop utility used to copy data in parallel within and between clusters. It uses Hadoop's MapReduce to perform the copy operation. DistCp is the most widely used data transfer tool in Hadoop clusters. For example:

$ hadoop distcp hdfs://namenode1/src hdfs://namenode2/dest

The preceding command would copy the src folder and all its contents from the cluster managed by namenode1 to the cluster managed by namenode2 as the dest folder. DistCp, by default, does not overwrite the files at the target location and skips copying them if the files already exists. However, files can be forced to be overwritten using the overwrite flag.

There are several options that can be used along with the Hadoop distcp command and the details of these options can be found at http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_distcp_data_cluster_migrate.html.

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Cloudera Administration Handbook
End of Section 9
Next Section
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options
font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon