Book Image

Deep Learning from the Basics

By : Koki Saitoh
5 (1)
Book Image

Deep Learning from the Basics

5 (1)
By: Koki Saitoh

Overview of this book

Deep learning is rapidly becoming the most preferred way of solving data problems. This is thanks, in part, to its huge variety of mathematical algorithms and their ability to find patterns that are otherwise invisible to us. Deep Learning from the Basics begins with a fast-paced introduction to deep learning with Python, its definition, characteristics, and applications. You’ll learn how to use the Python interpreter and the script files in your applications, and utilize NumPy and Matplotlib in your deep learning models. As you progress through the book, you’ll discover backpropagation—an efficient way to calculate the gradients of weight parameters—and study multilayer perceptrons and their limitations, before, finally, implementing a three-layer neural network and calculating multidimensional arrays. By the end of the book, you’ll have the knowledge to apply the relevant technologies in deep learning.

Related Content you might be interested in

Current Title:

Small book image
Deep Learning from the Basics
Koki Saitoh
Mar, 2021 | 316 pages
Small book image
Practical Convolutional Neural Networks
Mohit Sewak | Md Rezaul Karim | Pradeep Pujari
Feb, 2018 | 218 pages
Small book image
Hands-On Computer Vision with TensorFlow 2
Benjamin Planche | Eliot Andres
May, 2019 | 372 pages
Small book image
Hands-On Convolutional Neural Networks with TensorFlow
Leonardo Araujo | Nimesh Patel | Giounona Tzanidou | Richard Burton | Iffat Zafar
Aug, 2018 | 272 pages
Table of Contents (11 chapters)
Preface
Preface
About the Book
1
Introduction
Introduction
Concept of this book
Acknowledgments
Free Chapter
2
1. Introduction to Python
1. Introduction to Python
What is Python?
Installing Python
Python Interpreter
Python Script Files
NumPy
Matplotlib
Summary
3
2. Perceptrons
2. Perceptrons
What Is a Perceptron?
Simple Logic Circuits
Implementing Perceptrons
Limitations of Perceptrons
Multilayer Perceptrons
From NAND to a Computer
Summary
4
3. Neural Networks
3. Neural Networks
From Perceptrons to Neural Networks
Activation Function
Calculating Multidimensional Arrays
Implementing a Three-Layer Neural Network
Designing the Output Layer
Identity Function and Softmax Function
Handwritten Digit Recognition
Summary
5
4. Neural Network Training
4. Neural Network Training
Learning from Data
Loss Function
Numerical Differentiation
Gradient
Implementing a Training Algorithm
Summary
6
5. Backpropagation
5. Backpropagation
Computational Graphs
Chain Rule
Backward Propagation
Implementing a Simple Layer
Implementing the Activation Function Layer
Implementing the Affine and Softmax Layers
Implementing Backpropagation
Summary
7
6. Training Techniques
6. Training Techniques
Updating Parameters
Initial Weight Values
Regularization
Validating Hyperparameters
Summary
8
7. Convolutional Neural Networks
7. Convolutional Neural Networks
Overall Architecture
The Convolution Layer
The Pooling Layer
Implementing the Convolution and Pooling Layers
Implementing a CNN
Visualizing a CNN
Typical CNNs
Summary
9
8. Deep Learning
8. Deep Learning
Making a Network Deeper
A Brief History of Deep Learning
Accelerating Deep Learning
Practical Uses of Deep Learning
The Future of Deep Learning
Summary
Appendix A
Appendix A
Computational Graph of the Softmax-with-Loss Layer
Summary

About the Book

Deep learning is rapidly becoming the most preferred way of solving data problems. This is thanks, in part, to its huge variety of mathematical algorithms and their ability to find patterns that are otherwise invisible to us.

Deep Learning from the Basics begins with a fast-paced introduction to deep learning with Python, its definition, characteristics, and applications. You'll learn how to use the Python interpreter for the script files. You'll also learn how to utilize NumPy and Matplotlib in your deep learning applications. As you progress through the book, you'll discover backpropagation—an efficient way to calculate the gradients of weight parameters—and study multilayer perceptrons and their limitations before finally implementing a three-layer neural network and calculating multidimensional arrays.

By the end of the book, you'll have the knowledge to apply the relevant technologies in deep learning.

About the Authors

Koki Saitoh was born in Nagasaki, Japan in 1984. He graduated from the engineering department of the Tokyo Institute of Technology and completed a master's course at the Graduate School of Interdisciplinary Information Studies at the University of Tokyo. Currently, he conducts research and development in computer vision and machine learning. He has authored Deep Learning from the Basics series (Vol.1-3), which are published by O'Reilly, Japan.

Learning Objectives

  • Use Python with minimum external libraries to implement deep learning programs
  • Study the various deep learning and neural network theories
  • Learn how to set initial values of weights
  • Implement techniques such as batch normalization, dropout, and Adam
  • Explore applications like automatic driving, image generation, and reinforcement learning

Audience

Deep Learning from the Basics is designed for data scientists, data analysts, and developers who want to use deep learning techniques to develop efficient solutions. This book is ideal for those who want a deeper understanding as well as an overview of the technologies. Some working knowledge of Python is a must. Knowledge of NumPy and pandas will be beneficial but not essential.

Approach

This book takes a practical approach to deep learning. Exploring the concepts through guided practice, you will write code and implement mathematical algorithms from a programmer's point of view.

Previous Section
Next Chapter