Book Image

Apache Hive Essentials

By : Dayong Du
Book Image

Apache Hive Essentials

By: Dayong Du

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Apache Hive Essentials
Dayong Du
Feb, 2015 | 208 pages
No titles found
Table of Contents (17 chapters)
Apache Hive Essentials
Apache Hive Essentials
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Overview of Big Data and Hive
Overview of Big Data and Hive
A short history
Introducing big data
Relational and NoSQL database versus Hadoop
Batch, real-time, and stream processing
Overview of the Hadoop ecosystem
Hive overview
Summary
2
Setting Up the Hive Environment
Setting Up the Hive Environment
Installing Hive from Apache
Installing Hive from vendor packages
Starting Hive in the cloud
Using the Hive command line and Beeline
The Hive-integrated development environment
Summary
3
Data Definition and Description
Data Definition and Description
Understanding Hive data types
Data type conversions
Hive Data Definition Language
Hive database
Hive internal and external tables
Hive partitions
Hive buckets
Hive views
Summary
4
Data Selection and Scope
Data Selection and Scope
The SELECT statement
The INNER JOIN statement
The OUTER JOIN and CROSS JOIN statements
Special JOIN – MAPJOIN
Set operation – UNION ALL
Summary
5
Data Manipulation
Data Manipulation
Data exchange – LOAD
Data exchange – INSERT
Data exchange – EXPORT and IMPORT
ORDER and SORT
Operators and functions
Transactions
Summary
6
Data Aggregation and Sampling
Data Aggregation and Sampling
Basic aggregation – GROUP BY
Advanced aggregation – GROUPING SETS
Advanced aggregation – ROLLUP and CUBE
Aggregation condition – HAVING
Analytic functions
Sampling
Summary
7
Performance Considerations
Performance Considerations
Performance utilities
Design optimization
Data file optimization
Job and query optimization
Summary
8
Extensibility Considerations
Extensibility Considerations
User-defined functions
Streaming
SerDe
Summary
9
Security Considerations
Security Considerations
Authentication
Authorization
Encryption
Summary
10
Working with Other Tools
Working with Other Tools
JDBC / ODBC connector
HBase
Hue
HCatalog
ZooKeeper
Oozie
Hive roadmap
Summary
Index
Index

Hive roadmap

As it is the end of this chapter as well as of this book, the highlight of each Hive release milestone and future features expected are summarized as follows along with best wishes to the Hive communities for growing bigger and better in the near future:

  • December 2011 – Hive 0.8.0

    • Added Bitmap indexes

    • Added the TIMESTAMP data type

    • Added the Hive Plugin Developer Kit to make plugin building and testing easier

    • Improved JDBC Driver and bug fixes

  • April 2012 – Hive 0.9.0

    • Added the CREATE OR REPLACE VIEW statement

    • Added NOT IN and NOT LIKE support

    • Added the BETWEEN and NULL safe equality operator

    • Added printf(), sort_array(), and concat_ws() functions

    • Added a filter push-down from Hive into HBase for the key column

    • Combined multiple UNION ALL statements in one MapReduce job

    • Combined multiple GROUP BY statements on the same data with the same keys in one MapReduce job

  • January 2013 – Hive 0.10.0

    • Added the CUBE and ROLLUP statements

    • Added better support for YARN

    • Added more information in the EXPLAIN...

Previous Section
End of Section 8
Next Section