Book Image

Apache Hive Essentials. - Second Edition

By : Dayong Du
Book Image

Apache Hive Essentials. - Second Edition

By: Dayong Du

Overview of this book

In this book, we prepare you for your journey into big data by frstly introducing you to backgrounds in the big data domain, alongwith the process of setting up and getting familiar with your Hive working environment. Next, the book guides you through discovering and transforming the values of big data with the help of examples. It also hones your skills in using the Hive language in an effcient manner. Toward the end, the book focuses on advanced topics, such as performance, security, and extensions in Hive, which will guide you on exciting adventures on this worthwhile big data journey. By the end of the book, you will be familiar with Hive and able to work effeciently to find solutions to big data problems

Related Content you might be interested in

Current Title:

Small book image
Apache Hive Essentials. - Second Edition
Dayong Du
Jun, 2018 | 210 pages
Small book image
Modern Big Data Processing with Hadoop
V Naresh Kumar | Prashant Shindgikar
Mar, 2018 | 394 pages
Small book image
Apache Hadoop 3 Quick Start Guide
Hrishikesh Vijay Karambelkar
Oct, 2018 | 220 pages
Small book image
Mastering Hadoop 3
Manish Kumar | Chanchal Singh
Feb, 2019 | 544 pages
Table of Contents (12 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Overview of Big Data and Hive
Overview of Big Data and Hive
A short history
Introducing big data
The relational and NoSQL databases versus Hadoop
Batch, real-time, and stream processing
Overview of the Hadoop ecosystem
Hive overview
Summary
2
Setting Up the Hive Environment
Setting Up the Hive Environment
Installing Hive from Apache
Installing Hive from vendors
Using Hive in the cloud
Using the Hive command
Using the Hive IDE
Summary
3
Data Definition and Description
Data Definition and Description
Understanding data types
Data type conversions
Data Definition Language
Database
Tables
Partitions
Buckets
Views
Summary
4
Data Correlation and Scope
Data Correlation and Scope
Project data with SELECT
Filtering data with conditions
Linking data with JOIN
Combining data with UNION
Summary
5
Data Manipulation
Data Manipulation
Data exchanging with LOAD
Data exchange with INSERT
Data exchange with [EX|IM]PORT
Data sorting
Functions
Transactions and locks
Summary
6
Data Aggregation and Sampling
Data Aggregation and Sampling
Basic aggregation
Enhanced aggregation
Aggregation condition
Window functions
Sampling
Summary
7
Performance Considerations
Performance Considerations
Performance utilities
Design optimization
Data optimization
Job optimization
Summary
8
Extensibility Considerations
Extensibility Considerations
User-defined functions
HPL/SQL
Streaming
SerDe
Summary
9
Security Considerations
Security Considerations
Authentication
Authorization
Mask and encryption
Summary
10
Working with Other Tools
Working with Other Tools
The JDBC/ODBC connector
NoSQL
The Hue/Ambari Hive view
HCatalog
Oozie
Spark
Hivemall
Summary
11
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Installing Hive from Apache

To introduce the Hive installation, we will use Hive version 2.3.3 as an example. The pre-installation requirements for this installation are as follows:

  • JDK 1.8
  • Hadoop 2.x.y
  • Ubuntu 16.04/CentOS 7
Since we focus on Hive in this book, the installation steps for Java and Hadoop are not provided here. For steps on installing them, please refer to https://www.java.com/en/download/help/download_options.xml and http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html.

The following steps describe how to install Apache Hive in the command-line environment:

  1. Download Hive from Apache Hive and unpack it:
      $cd /opt
      $wget https://archive.apache.org/dist/hive/hive-2.3.3/apache-
      hive-2.3.3-bin.tar.gz
      $tar -zxvf apache-hive-2.3.3-bin.tar.gz
      $ln -sfn /opt/apache-hive-2.3.3 /opt/hive
  1. Add the necessary system...
Previous Section
End of Section 2
Next Section