Book Image

Hands-On Deep Learning with Go

By : Gareth Seneque, Darrell Chua
Book Image

Hands-On Deep Learning with Go

By: Gareth Seneque, Darrell Chua

Overview of this book

Go is an open source programming language designed by Google for handling large-scale projects efficiently. The Go ecosystem comprises some really powerful deep learning tools such as DQN and CUDA. With this book, you'll be able to use these tools to train and deploy scalable deep learning models from scratch. This deep learning book begins by introducing you to a variety of tools and libraries available in Go. It then takes you through building neural networks, including activation functions and the learning algorithms that make neural networks tick. In addition to this, you'll learn how to build advanced architectures such as autoencoders, restricted Boltzmann machines (RBMs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), and more. You'll also understand how you can scale model deployments on the AWS cloud infrastructure for training and inference. By the end of this book, you'll have mastered the art of building, training, and deploying deep learning models in Go to solve real-world problems.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Deep Learning with Go
Gareth Seneque | Darrell Chua
Aug, 2019 | 242 pages
Small book image
Go Machine Learning Projects
Xuanyi Chew
Nov, 2018 | 348 pages
Small book image
Machine Learning With Go
Richard Townsend | Daniel Whitenack
Sep, 2017 | 304 pages
Small book image
Hands-On Deep Learning with R
Rodger Devine | Michael Pawlus
Apr, 2020 | 330 pages
Table of Contents (15 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Deep Learning in Go, Neural Networks, and How to Train Them
Section 1: Deep Learning in Go, Neural Networks, and How to Train Them
2
Introduction to Deep Learning in Go
Introduction to Deep Learning in Go
Introducing DL
Overview of ML in Go
Using Gorgonia
Summary
3
What Is a Neural Network and How Do I Train One?
What Is a Neural Network and How Do I Train One?
A basic neural network
Activation functions
Gradient descent and backpropagation
Advanced gradient descent algorithms
Summary
4
Beyond Basic Neural Networks - Autoencoders and RBMs
Beyond Basic Neural Networks - Autoencoders and RBMs
Loading data – MNIST
Building a neural network for handwriting recognition
Building an autoencoder – generating MNIST digits
Building an RBM for Netflix-style collaborative filtering
Summary
Further reading
5
CUDA - GPU-Accelerated Training
CUDA - GPU-Accelerated Training
CPUs versus GPUs
Understanding Gorgonia and CUDA
Building a model in Gorgonia with CUDA support
Performance benchmarking of CPU versus GPU models for training and inference
Summary
6
Section 2: Implementing Deep Neural Network Architectures
Section 2: Implementing Deep Neural Network Architectures
7
Next Word Prediction with Recurrent Neural Networks
Next Word Prediction with Recurrent Neural Networks
Vanilla RNNs
Training RNNs
RNNs and vanishing gradients
Augmenting your RNN with GRU/LSTM units
Building an LSTM in Gorgonia
Summary
8
Object Recognition with Convolutional Neural Networks
Object Recognition with Convolutional Neural Networks
Introduction to CNNs
Building an example CNN
Assessing the results
Summary
Further reading
9
Maze Solving with Deep Q-Networks
Maze Solving with Deep Q-Networks
What is a DQN?
Solving a maze using a DQN in Gorgonia
Summary
Further reading
10
Generative Models with Variational Autoencoders
Generative Models with Variational Autoencoders
Introduction to VAEs
Building a VAE on MNIST
Assessing the results
Summary
Further reading
11
Section 3: Pipeline, Deployment, and Beyond!
Section 3: Pipeline, Deployment, and Beyond!
12
Building a Deep Learning Pipeline
Building a Deep Learning Pipeline
Exploring Pachyderm
Integrating our CNN
Summary
13
Scaling Deployment
Scaling Deployment
Lost (and found) in the cloud
Building deployment templates
Running a model on a K8s cluster
Summary
14
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Scaling Deployment

Now that we've been introduced to a tool that manages data pipelines, it's time to peer completely under the hood. Our models ultimately run on the kinds of hardware we talked about in Chapter 5, Next Word Prediction with Recurrent Neural Networks, abstracted through many layers of software until we get to the point where we can use code such as go build --tags=cuda.

Our deployment of the image recognition pipeline built on top of Pachyderm was local. We did it in a way that was functionally identical to deploying it to cloud resources, without getting into the detail of what that would look like. This detail will now be our focus.

By the end of this chapter, you should be able to do the following:

  • Identify and understand cloud resources, including those specific to our platform example (AWS)
  • Know how to migrate your local deployment to the cloud
    • ...
Previous Section
End of Section 1
Next Section