Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Hands-On Big Data Modeling

By : Lee, Wei, Kumar Mukhiya

2.3 (4)

Hands-On Big Data Modeling

2.3 (4)

By: Lee, Wei, Kumar Mukhiya

Overview of this book

Modeling and managing data is a central focus of all big data projects. In fact, a database is considered to be effective only if you have a logical and sophisticated data model. This book will help you develop practical skills in modeling your own big data projects and improve the performance of analytical queries for your specific business requirements. To start with, you’ll get a quick introduction to big data and understand the different data modeling and data management platforms for big data. Then you’ll work with structured and semi-structured data with the help of real-life examples. Once you’ve got to grips with the basics, you’ll use the SQL Developer Data Modeler to create your own data models containing different file types such as CSV, XML, and JSON. You’ll also learn to create graph data models and explore data modeling with streaming data using real-world datasets. By the end of this book, you’ll be able to design and develop efficient data models for varying data sizes easily and efficiently.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

Introduction to Big Data and Data Management

Introduction to Big Data and Data Management

The concept of big data

Sources and types of big data

Introduction to big data modeling

Introduction to managing big data

Importance and implications of big data modeling and management

Setting up big data modeling platforms

Summary

Further reading

Data Modeling and Management Platforms

Data Modeling and Management Platforms

Big data management

Big data management services

Big data management vendors

Big data storage and data models

Big data programming models

Getting started with Python and R

Summary

Further reading

Defining Data Models

Defining Data Models

Data model structures

Data operations

Data constraints

A unified approach to big data modeling and data management

Summary

Further reading

Categorizing Data Models

Categorizing Data Models

Levels of data modeling

Types of data model

Summary

Further reading

Structures of Data Models

Structures of Data Models

Semi-structured data models

VSM with Lucene

Graph-data models

Summary

Further reading

Modeling Structured Data

Modeling Structured Data

Getting started with structured data

Modeling structured data using Python

Summary

Further reading

Modeling with Unstructured Data

Modeling with Unstructured Data

Getting started with unstructured data

Tools for analyzing unstructured data

Summary

Further reading

Modeling with Streaming Data

Modeling with Streaming Data

Data stream and data model versus data format

Why is streaming data different?

Importance and implications of streaming data

Exploring streaming sensor data from the Twitter API

Summary

Further reading

Streaming Sensor Data

Streaming Sensor Data

Sensor data

Data lakes

Exploring streaming sensor data from a weather station

Summary

Further study

Concept and Approaches of Big-Data Management

Concept and Approaches of Big-Data Management

Non-DBMS-based approach to big data

DBMS-based approach to big data

Parallel and distributed DBMS

DBMS and MapReduce-style systems

Summary

Further reading

DBMS to BDMS

DBMS to BDMS

Characteristics of BDMS

Exploring data management with Redis

Aerospike

AsterixDB

Summary

Further reading

Modeling Bitcoin Data Points with Python

Modeling Bitcoin Data Points with Python

Introduction to Bitcoin data

Theory

Importing Bitcoin data into iPython

Preprocessing and model creation

Predicting Bitcoin price using Recurrent Neural Network

Summary

Further reading

Modeling Twitter Feeds Using Python

Modeling Twitter Feeds Using Python

Importing Twitter feed data

Modeling Twitter feeds

Summary

Further reading

Modeling Weather Data Points with Python

Modeling Weather Data Points with Python

Introduction to weather data

Importing data

Modeling with data

Summary

Further reading

Modeling IMDb Data Points with Python

Modeling IMDb Data Points with Python

Introduction to IMDb data

Theory

Modeling with the IMDb dataset

Summary

Further reading

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Modeling Twitter Feeds Using Python

Twitter data is used in both academic and enterprise research to extract business intelligence from tweets of particular people or organizations. This chapter uses Twitter feeds as big data and uses it in Python to model it according to tips and tricks learned in this book. This book tries to consume the data in a raw format, transform it into the correct format, model it using Python, and interpret the model thus produced. By the end of this chapter, you will know how to do the following:

Discover the nature of Twitter feed data
Model Twitter data with Python
Explore more about pandas, NumPy, and other Python libraries

Visually different images

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Hands-On Big Data Modeling

Search

Your notes and bookmarks