Setting Up the Hive Environment | Apache Hive Essentials

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Apache Hive Essentials

By : Dayong Du

4 (2)

Apache Hive Essentials

4 (2)

By: Dayong Du

Overview of this book

If you are a data analyst, developer, or simply someone who wants to use Hive to explore and analyze data in Hadoop, this is the book for you. Whether you are new to big data or an expert, with this book, you will be able to master both the basic and the advanced features of Hive. Since Hive is an SQL-like language, some previous experience with the SQL language and databases is useful to have a better understanding of this book.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

Overview of Big Data and Hive

Overview of Big Data and Hive

A short history

Introducing big data

The relational and NoSQL databases versus Hadoop

Batch, real-time, and stream processing

Overview of the Hadoop ecosystem

Hive overview

Summary

Setting Up the Hive Environment

Setting Up the Hive Environment

Installing Hive from Apache

Installing Hive from vendors

Using Hive in the cloud

Using the Hive command

Using the Hive IDE

Summary

Data Definition and Description

Data Definition and Description

Understanding data types

Data type conversions

Data Definition Language

Database

Tables

Partitions

Buckets

Views

Summary

Data Correlation and Scope

Data Correlation and Scope

Project data with SELECT

Filtering data with conditions

Linking data with JOIN

Combining data with UNION

Summary

Data Manipulation

Data Manipulation

Data exchanging with LOAD

Data exchange with INSERT

Data exchange with [EX|IM]PORT

Data sorting

Functions

Transactions and locks

Summary

Data Aggregation and Sampling

Data Aggregation and Sampling

Basic aggregation

Enhanced aggregation

Aggregation condition

Window functions

Sampling

Summary

Performance Considerations

Performance Considerations

Performance utilities

Design optimization

Data optimization

Job optimization

Summary

Extensibility Considerations

Extensibility Considerations

User-defined functions

HPL/SQL

Streaming

SerDe

Summary

Security Considerations

Security Considerations

Authentication

Authorization

Mask and encryption

Summary

Working with Other Tools

Working with Other Tools

The JDBC/ODBC connector

NoSQL

The Hue/Ambari Hive view

HCatalog

Oozie

Spark

Hivemall

Summary

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Installing Hive from Apache

To introduce the Hive installation, we use Hive version 1.0.0 as an example. The pre-installation requirements for this installation are as follows:

JDK 1.7.0_51
Hadoop 0.20.x, 0.23.x.y, 1.x.y, or 2.x.y
Ubuntu 14.04/CentOS 6.2
Note
Since we focus on Hive in this book, the installation steps for Java and Hadoop are not provided here. For steps on installing them, please refer to https://www.java.com/en/download/help/download_options.xml and http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html.

The following steps describe how to install Hive from Apache through the Linux command line:

Download Hive from Apache Hive and unpack it:

bash-4.1$ wget http://apache.mirror.rafal.ca/hive/hive-1.0.0/apache-hive-1.0.0-bin.tar.gz
bash-4.1$ tar -zxvf apache-hive-1.0.0-bin.tar.gz

Add Hive to the system path by opening /etc/profile or ~/.bashrc and add the following two rows:
```
export HIVE_HOME=/home/hivebooks/apache-hive-1.0.0-bin
export PATH=$PATH...
```

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Apache Hive Essentials

Search

Your notes and bookmarks