Book Image

The Artificial Intelligence Infrastructure Workshop

By : Chinmay Arankalle, Gareth Dwyer, Bas Geerdink, Kunal Gera, Kevin Liao, Anand N.S.
Book Image

The Artificial Intelligence Infrastructure Workshop

By: Chinmay Arankalle, Gareth Dwyer, Bas Geerdink, Kunal Gera, Kevin Liao, Anand N.S.

Overview of this book

Social networking sites see an average of 350 million uploads daily - a quantity impossible for humans to scan and analyze. Only AI can do this job at the required speed, and to leverage an AI application at its full potential, you need an efficient and scalable data storage pipeline. The Artificial Intelligence Infrastructure Workshop will teach you how to build and manage one. The Artificial Intelligence Infrastructure Workshop begins taking you through some real-world applications of AI. You’ll explore the layers of a data lake and get to grips with security, scalability, and maintainability. With the help of hands-on exercises, you’ll learn how to define the requirements for AI applications in your organization. This AI book will show you how to select a database for your system and run common queries on databases such as MySQL, MongoDB, and Cassandra. You’ll also design your own AI trading system to get a feel of the pipeline-based architecture. As you learn to implement a deep Q-learning algorithm to play the CartPole game, you’ll gain hands-on experience with PyTorch. Finally, you’ll explore ways to run machine learning models in production as part of an AI application. By the end of the book, you’ll have learned how to build and deploy your own AI software at scale, using various tools, API frameworks, and serialization methods.

Related Content you might be interested in

Current Title:

Small book image
The Artificial Intelligence Infrastructure Workshop
Chinmay Arankalle | Gareth Dwyer | Bas Geerdink | Kunal Gera | Kevin Liao | Anand N.S.
Aug, 2020 | 732 pages
No titles found
Table of Contents (14 chapters)
Preface
About the Book
1
1. Data Storage Fundamentals
1. Data Storage Fundamentals
Introduction
Problems Solved by Machine Learning
Optimizing the Storing and Processing of Data for Machine Learning Problems
Diving into Text Classification
Looking at Terminology in Text Classification Tasks
Designing for Scale – Choosing the Right Architecture and Hardware
Using Vectorized Operations to Analyze Data Fast
Summary
Free Chapter
2
2. Artificial Intelligence Storage Requirements
2. Artificial Intelligence Storage Requirements
Introduction
Storage Requirements
Data Layers
Raw Data
Historical Data
Streaming Data
Analytics Data
Model Development and Training
Summary
3
3. Data Preparation
3. Data Preparation
Introduction
ETL
Data Processing Techniques
Streaming Data
Summary
4
4. The Ethics of AI Data Storage
4. The Ethics of AI Data Storage
Introduction
Summary
5
5. Data Stores: SQL and NoSQL Databases
5. Data Stores: SQL and NoSQL Databases
Introduction
Database Components
SQL Databases
MySQL
NoSQL Databases
MongoDB
Cassandra
Exploring the Collective Knowledge of Databases
Summary
6
6. Big Data File Formats
6. Big Data File Formats
Introduction
Common Input Files
Choosing the Right Format for Your Data
Introduction to File Formats
Summary
7
7. Introduction to Analytics Engine (Spark) for Big Data
7. Introduction to Analytics Engine (Spark) for Big Data
Introduction
Apache Spark
Apache Spark and Databricks
Understanding Various Spark Transformations
Understanding Various Spark Actions
Best Practices
Summary
8
8. Data System Design Examples
8. Data System Design Examples
Introduction
The Importance of System Design
Components to Consider in System Design
Examining a Pipeline Design for an AI System
Making a Pipeline System Highly Available
Summary
9
9. Workflow Management for AI
9. Workflow Management for AI
Introduction
Creating Your Data Pipeline
Challenges in Managing Processes in the Real World
Automating a Data Pipeline
Automating Asynchronous Data Pipelines
Workflow Management with Airflow
Summary
10
10. Introduction to Data Storage on Cloud Services (AWS)
10. Introduction to Data Storage on Cloud Services (AWS)
Introduction
Interacting with Cloud Storage
Getting Started with Cloud Relational Databases
Introduction to NoSQL Data Stores on the Cloud
Data in Document Format
Summary
11
11. Building an Artificial Intelligence Algorithm
11. Building an Artificial Intelligence Algorithm
Introduction
Machine Learning Algorithms
Model Training
Gradient Descent
Getting Started with PyTorch
Mini-Batch SGD with PyTorch
Summary
12
12. Productionizing Your AI Applications
12. Productionizing Your AI Applications
Introduction
pickle and Flask
Deploying Models to Production
Model Execution in Streaming Data Applications
Summary
Appendix
1. Data Storage Fundamentals
2. Artificial Intelligence Storage Requirements
3. Data Preparation
4. Ethics of AI Data Storage
5. Data Stores: SQL and NoSQL Databases
6. Big Data File Formats
7. Introduction to Analytics Engine (Spark) for Big Data
8. Data System Design Examples
9. Workflow Management for AI
10. Introduction to Data Storage on Cloud Services (AWS)
11. Building an Artificial Intelligence Algorithm
12. Productionizing Your AI Applications

Mini-Batch SGD with PyTorch

Let's recap what we have learned so far. We started by implementing a gradient descent algorithm in NumPy. Then we were introduced to PyTorch, a modern deep learning library. We implemented an improved version of the gradient descent algorithm in PyTorch in the last exercise. Now let's dig into more details about gradient descent.

There are three types of gradient descent algorithms:

  • Batch gradient descent
  • Stochastic gradient descent
  • Mini-batch stochastic gradient descent

While batch gradient descent computes model parameter' gradients using the entire dataset, stochastic gradient descent computes model parameter' gradients using a single sample in the dataset. But using a single sample to compute gradients is very unreliable and the estimated gradients are extremely noisy. So, most applications of stochastic gradient descent use more than one sample, or a mini-batch of a handful of samples, to compute gradients...

Previous Section
End of Section 7
Next Section