Book Image

Hands-On Deep Learning with Go

By : Gareth Seneque, Darrell Chua
Book Image

Hands-On Deep Learning with Go

By: Gareth Seneque, Darrell Chua

Overview of this book

Go is an open source programming language designed by Google for handling large-scale projects efficiently. The Go ecosystem comprises some really powerful deep learning tools such as DQN and CUDA. With this book, you'll be able to use these tools to train and deploy scalable deep learning models from scratch. This deep learning book begins by introducing you to a variety of tools and libraries available in Go. It then takes you through building neural networks, including activation functions and the learning algorithms that make neural networks tick. In addition to this, you'll learn how to build advanced architectures such as autoencoders, restricted Boltzmann machines (RBMs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), and more. You'll also understand how you can scale model deployments on the AWS cloud infrastructure for training and inference. By the end of this book, you'll have mastered the art of building, training, and deploying deep learning models in Go to solve real-world problems.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Deep Learning with Go
Gareth Seneque | Darrell Chua
Aug, 2019 | 242 pages
Small book image
Go Machine Learning Projects
Xuanyi Chew
Nov, 2018 | 348 pages
Small book image
Machine Learning With Go
Daniel Whitenack
Sep, 2017 | 304 pages
Small book image
Hands-On Mathematics for Deep Learning
Jay Dawani
Jun, 2020 | 364 pages
Table of Contents (15 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Deep Learning in Go, Neural Networks, and How to Train Them
Section 1: Deep Learning in Go, Neural Networks, and How to Train Them
2
Introduction to Deep Learning in Go
Introduction to Deep Learning in Go
Introducing DL
Overview of ML in Go
Using Gorgonia
Summary
3
What Is a Neural Network and How Do I Train One?
What Is a Neural Network and How Do I Train One?
A basic neural network
Activation functions
Gradient descent and backpropagation
Advanced gradient descent algorithms
Summary
4
Beyond Basic Neural Networks - Autoencoders and RBMs
Beyond Basic Neural Networks - Autoencoders and RBMs
Loading data – MNIST
Building a neural network for handwriting recognition
Building an autoencoder – generating MNIST digits
Building an RBM for Netflix-style collaborative filtering
Summary
Further reading
5
CUDA - GPU-Accelerated Training
CUDA - GPU-Accelerated Training
CPUs versus GPUs
Understanding Gorgonia and CUDA
Building a model in Gorgonia with CUDA support
Performance benchmarking of CPU versus GPU models for training and inference
Summary
6
Section 2: Implementing Deep Neural Network Architectures
Section 2: Implementing Deep Neural Network Architectures
7
Next Word Prediction with Recurrent Neural Networks
Next Word Prediction with Recurrent Neural Networks
Vanilla RNNs
Training RNNs
RNNs and vanishing gradients
Augmenting your RNN with GRU/LSTM units
Building an LSTM in Gorgonia
Summary
8
Object Recognition with Convolutional Neural Networks
Object Recognition with Convolutional Neural Networks
Introduction to CNNs
Building an example CNN
Assessing the results
Summary
Further reading
9
Maze Solving with Deep Q-Networks
Maze Solving with Deep Q-Networks
What is a DQN?
Solving a maze using a DQN in Gorgonia
Summary
Further reading
10
Generative Models with Variational Autoencoders
Generative Models with Variational Autoencoders
Introduction to VAEs
Building a VAE on MNIST
Assessing the results
Summary
Further reading
11
Section 3: Pipeline, Deployment, and Beyond!
Section 3: Pipeline, Deployment, and Beyond!
12
Building a Deep Learning Pipeline
Building a Deep Learning Pipeline
Exploring Pachyderm
Integrating our CNN
Summary
13
Scaling Deployment
Scaling Deployment
Lost (and found) in the cloud
Building deployment templates
Running a model on a K8s cluster
Summary
14
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Activation functions

Now that you know how to build a basic neural network, let's go through the purpose of some of the elements of your model. One of those elements was the Sigmoid, which is an activation function. Sometimes these are also called transfer functions.

As you have learned previously, a given layer can be simply defined as weights applied to inputs; add some bias and then decide on activation. An activation function decides whether a neuron is fired. We also put this into the network to help to create more complex relationships between input and output. While doing this, we also need it to be a function that works with our backpropagation, so that we can easily optimize our weighs via an optimization method (that is, gradient descent). This means that we need the output of the function to be differentiable.

There are a few things to consider when choosing an...

Previous Section
End of Section 3
Next Section