Book Image

Apache Hive Essentials - Second Edition

By : Dayong Du
Book Image

Apache Hive Essentials - Second Edition

By: Dayong Du

Overview of this book

In this book, we prepare you for your journey into big data by frstly introducing you to backgrounds in the big data domain, alongwith the process of setting up and getting familiar with your Hive working environment. Next, the book guides you through discovering and transforming the values of big data with the help of examples. It also hones your skills in using the Hive language in an effcient manner. Toward the end, the book focuses on advanced topics, such as performance, security, and extensions in Hive, which will guide you on exciting adventures on this worthwhile big data journey. By the end of the book, you will be familiar with Hive and able to work effeciently to find solutions to big data problems
Table of Contents (12 chapters)

Oozie

Oozie (http://oozie.apache.org/) is an open source workflow coordination and schedule service to manage data-processing jobs. Oozie workflow jobs are defined in a series of nodes in a Directed Acyclical Graph (DAG). Acyclical here means that there are no loops in the graph and all nodes in the graph flow in one direction without going back. Oozie workflows contain either the control-flow node or the action node:

  • Control-flow node: This either defines the start, end, and failed node in a workflow, or controls the workflow execution path, such as decision, fork, and join nodes
  • Action node: This defines the core data-processing action job, such as MapReduce, Hadoop filesystem, Hive, Pig, Spark, Java, Shell, Email, and Oozie sub-workflows. Additional types of actions are also supported by customized extensions

Oozie is a scalable, reliable, and extensible system. It can be...