Book Image

The Artificial Intelligence Infrastructure Workshop

By : Chinmay Arankalle, Gareth Dwyer, Bas Geerdink, Kunal Gera, Kevin Liao, Anand N.S.
Book Image

The Artificial Intelligence Infrastructure Workshop

By: Chinmay Arankalle, Gareth Dwyer, Bas Geerdink, Kunal Gera, Kevin Liao, Anand N.S.

Overview of this book

Social networking sites see an average of 350 million uploads daily - a quantity impossible for humans to scan and analyze. Only AI can do this job at the required speed, and to leverage an AI application at its full potential, you need an efficient and scalable data storage pipeline. The Artificial Intelligence Infrastructure Workshop will teach you how to build and manage one. The Artificial Intelligence Infrastructure Workshop begins taking you through some real-world applications of AI. You’ll explore the layers of a data lake and get to grips with security, scalability, and maintainability. With the help of hands-on exercises, you’ll learn how to define the requirements for AI applications in your organization. This AI book will show you how to select a database for your system and run common queries on databases such as MySQL, MongoDB, and Cassandra. You’ll also design your own AI trading system to get a feel of the pipeline-based architecture. As you learn to implement a deep Q-learning algorithm to play the CartPole game, you’ll gain hands-on experience with PyTorch. Finally, you’ll explore ways to run machine learning models in production as part of an AI application. By the end of the book, you’ll have learned how to build and deploy your own AI software at scale, using various tools, API frameworks, and serialization methods.

Related Content you might be interested in

Current Title:

Small book image
The Artificial Intelligence Infrastructure Workshop
Chinmay Arankalle | Gareth Dwyer | Bas Geerdink | Kunal Gera | Kevin Liao | Anand N.S.
Aug, 2020 | 732 pages
No titles found
Table of Contents (14 chapters)
Preface
About the Book
1
1. Data Storage Fundamentals
1. Data Storage Fundamentals
Introduction
Problems Solved by Machine Learning
Optimizing the Storing and Processing of Data for Machine Learning Problems
Diving into Text Classification
Looking at Terminology in Text Classification Tasks
Designing for Scale – Choosing the Right Architecture and Hardware
Using Vectorized Operations to Analyze Data Fast
Summary
Free Chapter
2
2. Artificial Intelligence Storage Requirements
2. Artificial Intelligence Storage Requirements
Introduction
Storage Requirements
Data Layers
Raw Data
Historical Data
Streaming Data
Analytics Data
Model Development and Training
Summary
3
3. Data Preparation
3. Data Preparation
Introduction
ETL
Data Processing Techniques
Streaming Data
Summary
4
4. The Ethics of AI Data Storage
4. The Ethics of AI Data Storage
Introduction
Summary
5
5. Data Stores: SQL and NoSQL Databases
5. Data Stores: SQL and NoSQL Databases
Introduction
Database Components
SQL Databases
MySQL
NoSQL Databases
MongoDB
Cassandra
Exploring the Collective Knowledge of Databases
Summary
6
6. Big Data File Formats
6. Big Data File Formats
Introduction
Common Input Files
Choosing the Right Format for Your Data
Introduction to File Formats
Summary
7
7. Introduction to Analytics Engine (Spark) for Big Data
7. Introduction to Analytics Engine (Spark) for Big Data
Introduction
Apache Spark
Apache Spark and Databricks
Understanding Various Spark Transformations
Understanding Various Spark Actions
Best Practices
Summary
8
8. Data System Design Examples
8. Data System Design Examples
Introduction
The Importance of System Design
Components to Consider in System Design
Examining a Pipeline Design for an AI System
Making a Pipeline System Highly Available
Summary
9
9. Workflow Management for AI
9. Workflow Management for AI
Introduction
Creating Your Data Pipeline
Challenges in Managing Processes in the Real World
Automating a Data Pipeline
Automating Asynchronous Data Pipelines
Workflow Management with Airflow
Summary
10
10. Introduction to Data Storage on Cloud Services (AWS)
10. Introduction to Data Storage on Cloud Services (AWS)
Introduction
Interacting with Cloud Storage
Getting Started with Cloud Relational Databases
Introduction to NoSQL Data Stores on the Cloud
Data in Document Format
Summary
11
11. Building an Artificial Intelligence Algorithm
11. Building an Artificial Intelligence Algorithm
Introduction
Machine Learning Algorithms
Model Training
Gradient Descent
Getting Started with PyTorch
Mini-Batch SGD with PyTorch
Summary
12
12. Productionizing Your AI Applications
12. Productionizing Your AI Applications
Introduction
pickle and Flask
Deploying Models to Production
Model Execution in Streaming Data Applications
Summary
Appendix
1. Data Storage Fundamentals
2. Artificial Intelligence Storage Requirements
3. Data Preparation
4. Ethics of AI Data Storage
5. Data Stores: SQL and NoSQL Databases
6. Big Data File Formats
7. Introduction to Analytics Engine (Spark) for Big Data
8. Data System Design Examples
9. Workflow Management for AI
10. Introduction to Data Storage on Cloud Services (AWS)
11. Building an Artificial Intelligence Algorithm
12. Productionizing Your AI Applications

11. Building an Artificial Intelligence Algorithm

Activity 11.01: Implementing a Double Deep Q-Learning Algorithm to Solve the Cart Pole Problem

Solution

  1. In the Chapter11 directory, launch a Jupyter Notebook in your Terminal (macOS or Linux) or Command Prompt window (Windows).
  2. After the Jupyter Notebook is launched, create a new directory named Activity11.01. Inside the Activity11.01 directory, create a Python 3 notebook.
  3. Inside the Python 3 notebook, import all necessary modules and seed the environment as shown in the following code:
    # import module
import random
import numpy as np
from itertools import count
from collections import deque
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim
import gym
# make game
env = gym.make('CartPole-v1')
# seed the experiment
env.seed(9)
np.random.seed(9)
random.seed(9)
torch.manual_seed(9)
  4. Let's define our DQN as shown in the following code:
    # define our policy...
Previous Section
End of Section
Next Section