Book Image

MySQL 8 for Big Data

By : Shabbir Challawala, Chintan Mehta, Kandarp Patel, Jaydip Lakhatariya
Book Image

MySQL 8 for Big Data

By: Shabbir Challawala, Chintan Mehta, Kandarp Patel, Jaydip Lakhatariya

Overview of this book

With organizations handling large amounts of data on a regular basis, MySQL has become a popular solution to handle this structured Big Data. In this book, you will see how DBAs can use MySQL 8 to handle billions of records, and load and retrieve data with performance comparable or superior to commercial DB solutions with higher costs. Many organizations today depend on MySQL for their websites and a Big Data solution for their data archiving, storage, and analysis needs. However, integrating them can be challenging. This book will show you how to implement a successful Big Data strategy with Apache Hadoop and MySQL 8. It will cover real-time use case scenario to explain integration and achieve Big Data solutions using technologies such as Apache Hadoop, Apache Sqoop, and MySQL Applier. Also, the book includes case studies on Apache Sqoop and real-time event processing. By the end of this book, you will know how to efficiently use MySQL 8 to manage data for your Big Data applications.

Related Content you might be interested in

Current Title:

Small book image
MySQL 8 for Big Data
Shabbir Challawala | Chintan Mehta | Kandarp Patel | Jaydip Lakhatariya
Oct, 2017 | 296 pages
Small book image
MySQL 8 Administrator's Guide
Hetal Oza | Chintan Mehta | Ankit K Bhavsar | Subhash Shah
Feb, 2018 | 510 pages
Small book image
Advanced MySQL 8
Eric Vanier | Tejaswi Malepati | Birju Shah
Jan, 2019 | 286 pages
Small book image
MySQL 8 Cookbook
Karthik Appigatla
Jan, 2018 | 446 pages
Table of Contents (17 chapters)
Title Page
Title Page
Credits
Credits
About the Authors
About the Authors
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
Introduction to Big Data and MySQL 8
Introduction to Big Data and MySQL 8
The importance of Big Data
The life cycle of Big Data
Structured databases
Basics of MySQL
New features in MySQL 8
Benefits of using MySQL
Installing MySQL 8
Evolution of MySQL for Big Data
Summary
2
Data Query Techniques in MySQL 8
Data Query Techniques in MySQL 8
Overview of SQL
Database storage engines and types
Select statement in MySQL 8
Insert, replace, and update statements in MySQL 8
Transactions in MySQL 8
Aggregating data in MySQL 8
JSON
Summary
3
Indexing your data for High-Performing Queries
Indexing your data for High-Performing Queries
MySQL indexing
MySQL 8 index types
Indexing JSON data
Summary
4
Using Memcached with MySQL 8
Using Memcached with MySQL 8
Overview of Memcached
Setting up Memcached
Using of Memcached
Analyzing data stored in Memcached
Memcached replication configuration
Memcached APIs for different technologies
Summary
5
Partitioning High Volume Data
Partitioning High Volume Data
Partitioning in MySQL 8
Horizontal partitioning in MySQL 8
Vertical partitioning
Pruning partitions in MySQL
Querying on partitioned data
Summary
6
Replication for building highly available solutions
Replication for building highly available solutions
High availability
Replication with MySQL
Group replication
Summary
7
MySQL 8 Best Practices
MySQL 8 Best Practices
MySQL benchmarks and configurations
Best practices for MySQL queries
Best practices for the Memcached configuration
Best practices for replication
Summary
8
NoSQL API for Integrating with Big Data Solutions
NoSQL API for Integrating with Big Data Solutions
NoSQL overview
NoSQL versus SQL
Implementing NoSQL APIs
Summary
9
Case study: Part I - Apache Sqoop for exchanging data between MySQL and Hadoop
Case study: Part I - Apache Sqoop for exchanging data between MySQL and Hadoop
Case study for log analysis
Apache Sqoop overview
Integrating Apache Sqoop with MySQL and Hadoop
Importing unstructured data to Hadoop HDFS from MySQL
Loading structured data to MySQL using Apache Sqoop
Summary
10
Case study: Part II - Real time event processing using MySQL applier
Case study: Part II - Real time event processing using MySQL applier
Case study overview
MySQL Applier overview
Real-time integration with MySQL Applier
Organizing and analyzing data in Hadoop
Summary

Horizontal partitioning in MySQL 8

As mentioned, horizontal partitioning will create more than one partition of the data. Each partition will have the same number of columns. Different partitioning techniques are used to divide the page into multiple partitions. Consider the following figure for horizontal partitioning:

The following is the list of partitioning types supported in MySQL 8:

  • Range partitioning
  • List partitioning
  • Hash partitioning
  • Columns partitioning
  • Key partitioning
  • Sub partitioning

Let's understand each partitioning type in detail.

Range partitioning

When partitioning is done based on expressions that contain contiguous non-repetitive values of ranges, it is known as range partitioning. The expression for range partitioning contains the key VALUE LESS THAN operator.

There are multiple data types, based on which we can partition the table:

CREATE TABLE access_log ( 
log_id INT NOT NULL, 
type VARCHAR(100), 
access_url VARCHAR(100), 
access_date TIMESTAMP NOT NULL, 
response_time INT NOT...
Previous Section
End of Section 3
Next Section