5. The Storage, Structure Layout, and Data Model of HBase | Learning Hbase

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Learning Hbase

By : Shashwat Shriparv

4.1 (8)

Learning Hbase

4.1 (8)

By: Shashwat Shriparv

Overview of this book

If you are an administrator or developer who wants to enter the world of Big Data and BigTables and would like to learn about HBase, this is the book for you.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

1. Understanding the HBase Ecosystem

1. Understanding the HBase Ecosystem

HBase layout on top of Hadoop

Comparing architectural differences between RDBMs and HBase

HBase features

HBase in the Hadoop ecosystem

Comparing functional differences between RDBMs and HBase

About the internal storage architecture of HBase

Getting started with HBase

Applications of HBase

HBase pros and cons

Summary

2. Let's Begin with HBase

2. Let's Begin with HBase

Understanding HBase components in detail

Reading and writing cycle

HBase housekeeping

The HBase delete request

List of available HBase distributions

Prerequisites and capacity planning for HBase

Summary

3. Let's Start Building It

3. Let's Start Building It

Downloading Java on Ubuntu

Considering host configurations

Installing and configuring SSH

Installing and configuring NTP

Performing capacity planning

Installing and configuring Hadoop

Hadoop start up steps

Configuring Apache HBase

Installing and configuring ZooKeeper

Installing Cloudera Hadoop and HBase

Installing the Hadoop and MapReduce packages

Installing Hadoop on Windows

Summary

4. Optimizing the HBase/Hadoop Cluster

4. Optimizing the HBase/Hadoop Cluster

Setup types for Hadoop and HBase clusters

Recommendations for CDH cluster configuration

Capacity planning

Hadoop optimization

Optimizing HBase

Optimizing ZooKeeper

Important files in Hadoop

Important files in HBase

Summary

5. The Storage, Structure Layout, and Data Model of HBase

5. The Storage, Structure Layout, and Data Model of HBase

Data types in HBase

Storing data in HBase – logical view versus actual physical view

Services of HBase

Data model operations

Versioning and why

Deciding the number of the version

Schema designing

Calculating the data size stored in HBase

Summary

6. HBase Cluster Maintenance and Troubleshooting

6. HBase Cluster Maintenance and Troubleshooting

Hadoop shell commands

HBase shell commands

HBase administration tools

Writing HBase shell scripts

Using the Hadoop tool or JARs for HBase

Connecting HBase with Hive

HBase region management

HBase node management

Implementing security

Troubleshooting the most frequent HBase errors and their explanations

Summary

7. Scripting in HBase

7. Scripting in HBase

HBase backup and restore techniques

HBase on Windows

Scripting in HBase

Contributing to HBase

Summary

8. Coding HBase in Java

8. Coding HBase in Java

Setting up the environment for development

Data types

Data model Java operations

HBase filters

Client APIs

Summary

9. Advance Coding in Java for HBase

9. Advance Coding in Java for HBase

Interfaces, classes, and exceptions

Code related to administrative tasks

Data operation code

MapReduce and HBase

RESTful services and Thrift services interface

Coding for HDFS operations

Some advance topics in brief

Summary

10. HBase Use Cases

10. HBase Use Cases

HBase in industry today

The future of HBase against relational databases

Some real-world project examples' use cases

Useful links and references

Summary

Index

Index

Storing data in HBase – logical view versus actual physical view

At a conceptual level, an HBase table can be seen as a sparse set of rows, but in actual storage, it is stored as per a column family. While defining a table, columns can be added or specified on the run in a column family. We must decide the number and name of the column family at the time of table creation, but columns can be added as required at any point in time while storing the data, and this is the beauty of schema-free when we use HBase.

The following is the logical view of how data is stored in HBase, but in actual these are stored separately with column families:

Row keys	Time_Stamp	Column family 1 (CF1)		Column family 2 (CF2)
		CF1:Col 1	CF1:Col 2	CF2:Col 3	CF2:Col4	CF2:Col 5
Row1	Time stamp 1			Value 3	Value 4	Value 5
Row2	Time stamp 2	Value 6	Value 7	Value 8	Value 9	Value 10
Row2	Time stamp 3	Value 11	Value 12	Value 13

So, in physical storage, this table will be stored in two parts...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Learning Hbase

Search

Your notes and bookmarks