Book Image

Apache Hive Cookbook

Book Image

Apache Hive Cookbook

Overview of this book

Hive was developed by Facebook and later open sourced in Apache community. Hive provides SQL like interface to run queries on Big Data frameworks. Hive provides SQL like syntax also called as HiveQL that includes all SQL capabilities like analytical functions which are the need of the hour in today’s Big Data world. This book provides you easy installation steps with different types of metastores supported by Hive. This book has simple and easy to learn recipes for configuring Hive clients and services. You would also learn different Hive optimizations including Partitions and Bucketing. The book also covers the source code explanation of latest Hive version. Hive Query Language is being used by other frameworks including spark. Towards the end you will cover integration of Hive with these frameworks.
Table of Contents (19 chapters)
Apache Hive Cookbook
Credits
About the Authors
About the Reviewer
www.PacktPub.com
Preface
Index

Sampling


In this recipe, you will learn how to sample data in Hive.

Getting ready

Sampling in Hive is a way to write queries on a small chunk of data instead of the entire table. This is required when you have a large dataset and you want to work on a small piece of that dataset. Sampling queries are most efficient when they are performed on bucketed column. Sampling is required when you just need to run queries on a smaller set of data instead of accuracy of the result set of the entire data. That is, it is mostly required for testing purposes. Sampling is most efficient when it is used for auditing purposes. In auditing, sampling can be used to pick a random set of rows or data with respect to the entire data that is huge in number.

Another use case is where you need to perform some aggregation-like average on a sample of data or smaller set of data, keeping aside the accuracy of the data.

To use this sampling feature in Hive, you need to use the TABLESAMPLE clause, which helps in writing...