Deep Learning from the Basics

By : Koki Saitoh

5 (1)

Buy this Book

Deep Learning from the Basics

5 (1)

By: Koki Saitoh

Buy this Book

Overview of this book

Deep learning is rapidly becoming the most preferred way of solving data problems. This is thanks, in part, to its huge variety of mathematical algorithms and their ability to find patterns that are otherwise invisible to us. Deep Learning from the Basics begins with a fast-paced introduction to deep learning with Python, its definition, characteristics, and applications. You’ll learn how to use the Python interpreter and the script files in your applications, and utilize NumPy and Matplotlib in your deep learning models. As you progress through the book, you’ll discover backpropagation—an efficient way to calculate the gradients of weight parameters—and study multilayer perceptrons and their limitations, before, finally, implementing a three-layer neural network and calculating multidimensional arrays. By the end of the book, you’ll have the knowledge to apply the relevant technologies in deep learning.

Preface

About the Book

Introduction

Concept of this book

Acknowledgments

Free Chapter

1. Introduction to Python

NumPy

Summary

2. Perceptrons

What Is a Perceptron?

Simple Logic Circuits

Implementing Perceptrons

Limitations of Perceptrons

Multilayer Perceptrons

From NAND to a Computer

Summary

3. Neural Networks

From Perceptrons to Neural Networks

Activation Function

Calculating Multidimensional Arrays

Implementing a Three-Layer Neural Network

Designing the Output Layer

Identity Function and Softmax Function

Handwritten Digit Recognition

Summary

4. Neural Network Training

Learning from Data

Loss Function

Numerical Differentiation

Gradient

Implementing a Training Algorithm

Summary

5. Backpropagation

Computational Graphs

Chain Rule

Backward Propagation

Implementing a Simple Layer

Implementing the Activation Function Layer

Implementing the Affine and Softmax Layers

Implementing Backpropagation

Summary

6. Training Techniques

Updating Parameters

Initial Weight Values

Regularization

Validating Hyperparameters

Summary

7. Convolutional Neural Networks

Overall Architecture

The Convolution Layer

The Pooling Layer

Implementing the Convolution and Pooling Layers

Implementing a CNN

Visualizing a CNN

Typical CNNs

Summary

8. Deep Learning

Making a Network Deeper

A Brief History of Deep Learning

Accelerating Deep Learning

Practical Uses of Deep Learning

The Future of Deep Learning

Summary

Appendix A

Computational Graph of the Softmax-with-Loss Layer

Summary

Customer Reviews

5 (1)

5 star

100%

4 star

3 star

2 star

1 star

Visualizing a CNN

What does the convolution layer used in a CNN "see"? Here, we will visualize a convolution layer to explore what happens in a CNN.

Visualizing the Weight of the First Layer

Earlier, we conducted simple CNN training for the MNIST dataset. The shape of the weight of the first (convolution) layer was (30, 1, 5, 5). It was 5x5 in size, had 1 channel, and 30 filters. When the filter is 5x5 in size and has 1 channel, it can be visualized as a one-channel gray image. Now, let's show the filters of the convolution layer (the first layer) as images. Here, we will compare the weights before and after training. Figure 7.24 shows the results (the source code is located at ch07/visualize_filter.py):

Figure 7.24: Weight of the first (convolution) layer before and after training. The elements of the weight are real numbers, but they are normalized between 0 and 255 to show the images so that the smallest value is black (0) and the largest...

Deep Learning from the Basics

By : Koki Saitoh

Deep Learning from the Basics

By: Koki Saitoh

Overview of this book

Related Content you might be interested in

Current Title:

Deep Learning from the Basics

Practical Convolutional Neural Networks

Hands-On Computer Vision with TensorFlow 2

Hands-On Convolutional Neural Networks with TensorFlow

Visualizing a CNN

Visualizing the Weight of the First Layer

Figure 7.24: Weight of the first (convolution) layer before and after training. The elements of the weight are real numbers, but they are normalized between 0 and 255 to show the images so that the smallest value is black (0) and the largest...