Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Deep Learning Quick Reference

By : Mike Bernico

4.5 (6)

Deep Learning Quick Reference

4.5 (6)

By: Mike Bernico

Overview of this book

Deep learning has become an essential necessity to enter the world of artificial intelligence. With this book deep learning techniques will become more accessible, practical, and relevant to practicing data scientists. It moves deep learning from academia to the real world through practical examples. You will learn how Tensor Board is used to monitor the training of deep neural networks and solve binary classification problems using deep learning. Readers will then learn to optimize hyperparameters in their deep learning models. The book then takes the readers through the practical implementation of training CNN's, RNN's, and LSTM's with word embeddings and seq2seq models from scratch. Later the book explores advanced topics such as Deep Q Network to solve an autonomous agent problem and how to use two adversarial networks to generate artificial images that appear real. For implementation purposes, we look at popular Python-based deep learning frameworks such as Keras and Tensorflow, Each chapter provides best practices and safe choices to help readers make the right decision while training deep neural networks. By the end of this book, you will be able to solve real-world problems quickly with deep neural networks.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

The Building Blocks of Deep Learning

The Building Blocks of Deep Learning

The deep neural network architectures

Optimization algorithms for deep learning

Deep learning frameworks

Building datasets for deep learning

Summary

Using Deep Learning to Solve Regression Problems

Using Deep Learning to Solve Regression Problems

Regression analysis and deep neural networks

Using deep neural networks for regression

Building an MLP in Keras

Building a deep neural network in Keras

Saving and loading a trained Keras model

Summary

Monitoring Network Training Using TensorBoard

Monitoring Network Training Using TensorBoard

A brief overview of TensorBoard

Setting up TensorBoard

Connecting Keras to TensorBoard

Using TensorBoard

Summary

Using Deep Learning to Solve Binary Classification Problems

Using Deep Learning to Solve Binary Classification Problems

Binary classification and deep neural networks

Case study – epileptic seizure recognition

Building a binary classifier in Keras

Using the checkpoint callback in Keras

Measuring ROC AUC in a custom callback

Measuring precision, recall, and f1-score

Summary

Using Keras to Solve Multiclass Classification Problems

Using Keras to Solve Multiclass Classification Problems

Multiclass classification and deep neural networks

Case study - handwritten digit classification

Building a multiclass classifier in Keras

Controlling variance with dropout

Controlling variance with regularization

Summary

Hyperparameter Optimization

Hyperparameter Optimization

Should network architecture be considered a hyperparameter?

Which hyperparameters should we optimize?

Hyperparameter optimization strategies

Summary

Training a CNN from Scratch

Training a CNN from Scratch

Introducing convolutions

Training a convolutional neural network in Keras

Using data augmentation

Summary

Transfer Learning with Pretrained CNNs

Transfer Learning with Pretrained CNNs

Overview of transfer learning

When transfer learning should be used

The impact of source/target volume and similarity

Transfer learning in Keras

Summary

Training an RNN from scratch

Training an RNN from scratch

Introducing recurrent neural networks

A refresher on time series problems

Using an LSTM for time series prediction

Summary

Training LSTMs with Word Embeddings from Scratch

Training LSTMs with Word Embeddings from Scratch

An introduction to natural language processing

Vectorizing text

Word embedding

Keras embedding layer

1D CNNs for natural language processing

Case studies for document classifications

Summary

Training Seq2Seq Models

Training Seq2Seq Models

Sequence-to-sequence models

Machine translation

Summary

Using Deep Reinforcement Learning

Using Deep Reinforcement Learning

Reinforcement learning overview

The Keras reinforcement learning framework

Building a reinforcement learning agent in Keras

Summary

Generative Adversarial Networks

Generative Adversarial Networks

An overview of the GAN

Deep Convolutional GAN architecture

How GANs can fail

Safe choices for GAN

Generating MNIST images using a Keras GAN

Generating CIFAR-10 images using a Keras GAN

Summary

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Hyperparameter optimization strategies

At this point in the chapter, we've suggested that it is, for the most part, computationally impossible, or at least impractical, to try every single combination of hyperparameters we might want to try. Deep neural networks can certainly take a long time to train. While you can parallelize and throw computational resources at the problem, it's likely that your greatest limiter in searching for hyperparameters will continue to be time.

If time is our greatest constraint, and we can't reasonably explore all possibilities in the time we have, then we will have to create a strategy where we get the most utility in the time we have.

In the remainder of this section, I'll cover some common strategies for hyperparameter optimization and then I'll show you how to optimize hyperparameters in Keras with two of my favorite methods...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Deep Learning Quick Reference

Search

Your notes and bookmarks