Book Image

Learning Hunk

By : Dmitry Anoshin, Sergey Sheypak
Book Image

Learning Hunk

By: Dmitry Anoshin, Sergey Sheypak

Overview of this book

Hunk is the big data analytics platform that lets you rapidly explore, analyse, and visualize data in Hadoop and NoSQL data stores. It provides a single, fluid user experience, designed to show you insights from your big data without the need for specialized skills, fixed schemas, or months of development. Hunk goes beyond typical data analysis methods and gives you the power to rapidly detect patterns and find anomalies across petabytes of raw data. This book focuses on exploring, analysing, and visualizing big data in Hadoop and NoSQL data stores with this powerful full-featured big data analytics platform. You will begin by learning the Hunk architecture and Hunk Virtual Index before moving on to how to easily analyze and visualize data using Splunk Search Language (SPL). Next you will meet Hunk Apps which can easy integrate with NoSQL data stores such as MongoDB or Sqqrl. You will also discover Hunk knowledge objects, build a semantic layer on top of Hadoop, and explore data using the friendly user-interface of Hunk Pivot. You will connect MongoDB and explore data in the data store. Finally, you will go through report acceleration techniques and analyze data in the AWS Cloud.

Related Content you might be interested in

Current Title:

Small book image
Learning Hunk
Dmitry Anoshin | Sergey Sheypak
Dec, 2015 | 156 pages
No titles found
Table of Contents (14 chapters)
Learning Hunk
Learning Hunk
Credits
Credits
About the Authors
About the Authors
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Meet Hunk
Meet Hunk
Big data analytics
The big problem
The elegant solution
Getting to know Hunk
Hunk architecture
Setting up Hadoop
Starting the VM and cluster in VirtualBox
Big data use case
Summary
2
Explore Hadoop Data with Hunk
Explore Hadoop Data with Hunk
Setting up Hunk
Exploring data
Controlling security with Hunk
Summary
3
Meeting Hunk Features
Meeting Hunk Features
Knowledge objects
Introducing Pivot
Summary
4
Adding Speed to Reports
Adding Speed to Reports
Big data performance issues
Hunk report acceleration
Hunk accelerations limits
Summary
5
Customizing Hunk
Customizing Hunk
What we are going to do with the Splunk SDK
Dashboard customization using Splunk Web Framework
A description of time-series aggregated CDR data
Implementation
Custom map components
The final result
Summary
6
Discovering Hunk Integration Apps
Discovering Hunk Integration Apps
What is Mongo?
Counting by shop in a single collection
Counting events in all collections
Summary
7
Exploring Data in the Cloud
Exploring Data in the Cloud
An introduction to Amazon EMR and S3
Integrating Hunk with EMR and S3
Converting Hunk from an hourly rate to a license
Summary
Index
Index

Setting up Hunk

In order to start exploring Hadoop data, we have to install Hunk on top of our Hadoop Cluster. Hunk is easy to install and configure. Let's learn how to deploy Hunk version 6.2.1 on top of an existing CDH cluster. It's assumed that your VM is up and running.

Extracting Hunk to a VM

  1. Open the console application.

  2. Run ls -la to see the list of files in your home directory:

    [cloudera@quickstart ~]$ cd ~
[cloudera@quickstart ~]$ ls -la | grep hunk
-rw-r--r--   1 root     root     113913609 Mar 23 04:09 hunk-6.2.1-249325-Linux-x86_64.tgz

  3. Unpack the archive:

    cd /opt
sudo tar xvzf /home/cloudera/hunk-6.2.1-249325-Linux-x86_64.tgz -C /opt

Setting up Hunk variables and configuration files

  1. It's time to set the SPLUNK_HOME environment variable. This variable has already been added to the profile:

    export SPLUNK_HOME=/opt/hunk

  2. Use the default splunk-launch.conf. This is the basic properties file used by the Hunk service. We don't have to change anything special, so let's use the default settings...

Previous Section
End of Section 2
Next Section