Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Cloudera Administration Handbook
  • Table Of Contents Toc
Cloudera Administration Handbook

Cloudera Administration Handbook

By : Menon
3.5 (10)
Buy this Book
close
close
Cloudera Administration Handbook

Cloudera Administration Handbook

3.5 (10)
By: Menon
Buy this Book

Overview of this book

An easy-to-follow Apache Hadoop administrator’s guide filled with practical screenshots and explanations for each step and configuration. This book is great for administrators interested in setting up and managing a large Hadoop cluster. If you are an administrator, or want to be an administrator, and you are ready to build and maintain a production-level cluster running CDH5, then this book is for you.
Table of Contents (11 chapters)
close
close
close
Preface
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Lock Free Chapter
1
1. Getting Started with Apache Hadoop
Icon
1. Getting Started with Apache Hadoop
Icon
History of Apache Hadoop and its trends
Icon
Components of Apache Hadoop
Icon
Understanding the Apache Hadoop daemons
Icon
Introducing Cloudera
Icon
Introducing CDH
Icon
Responsibilities of a Hadoop administrator
Icon
Summary
2
2. HDFS and MapReduce
chevron up
Icon
2. HDFS and MapReduce
Icon
Essentials of HDFS
Icon
The read/write operational flow in HDFS
Icon
Understanding the namenode UI
Icon
Understanding the secondary namenode UI
Icon
Exploring HDFS commands
Icon
Getting acquainted with MapReduce
Icon
Summary
3
3. Cloudera's Distribution Including Apache Hadoop
Icon
3. Cloudera's Distribution Including Apache Hadoop
Icon
Getting started with CDH
Icon
Understanding the CDH components
Icon
Installing CDH
Icon
Installing the CDH components
Icon
Summary
4
4. Exploring HDFS Federation and Its High Availability
Icon
4. Exploring HDFS Federation and Its High Availability
Icon
Implementing HDFS Federation
Icon
Implementing HDFS High Availability
Icon
Jobtracker high availability
Icon
Summary
5
5. Using Cloudera Manager
Icon
5. Using Cloudera Manager
Icon
Introducing Cloudera Manager
Icon
Understanding the Cloudera Manager architecture
Icon
Installing Cloudera Manager
Icon
Navigating the Cloudera Manager Web console
Icon
Configuring High Availability using Cloudera Manager
Icon
Summary
6
6. Implementing Security Using Kerberos
Icon
6. Implementing Security Using Kerberos
Icon
Understanding authentication and authorization
Icon
Introducing Kerberos
Icon
Understanding the Kerberos Architecture
Icon
Installing Kerberos
Icon
Configuring Kerberos for Apache Hadoop
Icon
Authorization in Apache Hadoop
Icon
Summary
7
7. Managing an Apache Hadoop Cluster
Icon
7. Managing an Apache Hadoop Cluster
Icon
Configuring Hadoop services using Cloudera Manager
Icon
Role management in Cloudera Manager
Icon
Managing hosts using Cloudera Manager
Icon
Managing multiple clusters with Cloudera Manager
Icon
Rebalancing a Hadoop cluster from Cloudera Manager
Icon
Summary
8
8. Cluster Monitoring Using Events and Alerts
Icon
8. Cluster Monitoring Using Events and Alerts
Icon
Monitoring Hadoop services from Cloudera Manager
Icon
Understanding events and alerts
Icon
Summary
9
9. Configuring Backups
Icon
9. Configuring Backups
Icon
Understanding backups
Icon
Understanding HDFS backups
Icon
Using the distributed copy (DistCp)
Icon
Configuring backups using Cloudera Manager
Icon
Summary
10
Index
Icon
Index

The read/write operational flow in HDFS

To get a better understanding of HDFS, we need to understand the flow of operations for the following two scenarios:

  • A file is written to HDFS

  • A file is read from HDFS

HDFS uses a single-write, multiple-read model, where the files are written once and read several times. The data cannot be altered once written. However, data can be appended to the file by reopening it. All files in the HDFS are saved as data blocks.

Writing files in HDFS

The following sequence of steps occur when a client tries to write a file to HDFS:

  1. The client informs the namenode daemon that it wants to write a file. The namenode daemon checks to see whether the file already exists.

  2. If it exists, an appropriate message is sent back to the client. If it does not exist, the namenode daemon makes a metadata entry for the new file.

  3. The file to be written is split into data packets at the client end and a data queue is built. The packets in the queue are then streamed to the datanodes in the...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Cloudera Administration Handbook
End of Chapter 2
Next Chapter
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options
font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon