Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Cloudera Administration Handbook
  • Table Of Contents Toc
  • Feedback & Rating feedback
Cloudera Administration Handbook

Cloudera Administration Handbook

By : Menon
3.5 (10)
Buy this Book
close
close
Cloudera Administration Handbook

Cloudera Administration Handbook

3.5 (10)
By: Menon
Buy this Book

Overview of this book

An easy-to-follow Apache Hadoop administrator’s guide filled with practical screenshots and explanations for each step and configuration. This book is great for administrators interested in setting up and managing a large Hadoop cluster. If you are an administrator, or want to be an administrator, and you are ready to build and maintain a production-level cluster running CDH5, then this book is for you.
Table of Contents (11 chapters)
close
close
close
Preface
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Lock Free Chapter
1
1. Getting Started with Apache Hadoop
Icon
1. Getting Started with Apache Hadoop
Icon
History of Apache Hadoop and its trends
Icon
Components of Apache Hadoop
Icon
Understanding the Apache Hadoop daemons
Icon
Introducing Cloudera
Icon
Introducing CDH
Icon
Responsibilities of a Hadoop administrator
Icon
Summary
2
2. HDFS and MapReduce
chevron up
Icon
2. HDFS and MapReduce
Icon
Essentials of HDFS
Icon
The read/write operational flow in HDFS
Icon
Understanding the namenode UI
Icon
Understanding the secondary namenode UI
Icon
Exploring HDFS commands
Icon
Getting acquainted with MapReduce
Icon
Summary
3
3. Cloudera's Distribution Including Apache Hadoop
Icon
3. Cloudera's Distribution Including Apache Hadoop
Icon
Getting started with CDH
Icon
Understanding the CDH components
Icon
Installing CDH
Icon
Installing the CDH components
Icon
Summary
4
4. Exploring HDFS Federation and Its High Availability
Icon
4. Exploring HDFS Federation and Its High Availability
Icon
Implementing HDFS Federation
Icon
Implementing HDFS High Availability
Icon
Jobtracker high availability
Icon
Summary
5
5. Using Cloudera Manager
Icon
5. Using Cloudera Manager
Icon
Introducing Cloudera Manager
Icon
Understanding the Cloudera Manager architecture
Icon
Installing Cloudera Manager
Icon
Navigating the Cloudera Manager Web console
Icon
Configuring High Availability using Cloudera Manager
Icon
Summary
6
6. Implementing Security Using Kerberos
Icon
6. Implementing Security Using Kerberos
Icon
Understanding authentication and authorization
Icon
Introducing Kerberos
Icon
Understanding the Kerberos Architecture
Icon
Installing Kerberos
Icon
Configuring Kerberos for Apache Hadoop
Icon
Authorization in Apache Hadoop
Icon
Summary
7
7. Managing an Apache Hadoop Cluster
Icon
7. Managing an Apache Hadoop Cluster
Icon
Configuring Hadoop services using Cloudera Manager
Icon
Role management in Cloudera Manager
Icon
Managing hosts using Cloudera Manager
Icon
Managing multiple clusters with Cloudera Manager
Icon
Rebalancing a Hadoop cluster from Cloudera Manager
Icon
Summary
8
8. Cluster Monitoring Using Events and Alerts
Icon
8. Cluster Monitoring Using Events and Alerts
Icon
Monitoring Hadoop services from Cloudera Manager
Icon
Understanding events and alerts
Icon
Summary
9
9. Configuring Backups
Icon
9. Configuring Backups
Icon
Understanding backups
Icon
Understanding HDFS backups
Icon
Using the distributed copy (DistCp)
Icon
Configuring backups using Cloudera Manager
Icon
Summary
10
Index
Icon
Index

Exploring HDFS commands

To perform filesystem related tasks, the commands begin with hdfs dfs. The filesystem commands have been designed to behave similarly to the corresponding Unix/Linux filesystem commands.

What is a URI? URI stands for Uniform Resource Identifier. In the commands that are listed as follows, you will observe the use of URI for file locations. The URI syntax to access a file in HDFS is hdfs://namenodehost/parent/child/<file>.

Commonly used HDFS commands

The following are some of the most commonly used HDFS commands:

  • ls: This command lists files in HDFS.

    The syntax of the ls command is hdfs dfs -ls <args>. The following is the screenshot showing an example of the ls command:

    Commonly used HDFS commands
  • cat: This command displays the contents of file/files in the terminal.

    The syntax of the cat command is hdfs dfs -cat URI [URI …]. The following is a sample output of the cat command:

    Commonly used HDFS commands
  • copyFromLocal: This command copies a file/files from the local filesystem to HDFS.

    The syntax of the copyFromLocal...

Visually different images
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Cloudera Administration Handbook
End of Section 2
Next Section
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options
font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon