Book Image

Python Deep Learning - Third Edition

By : Ivan Vasilev
4 (1)
Book Image

Python Deep Learning - Third Edition

4 (1)
By: Ivan Vasilev

Overview of this book

The field of deep learning has developed rapidly recently and today covers a broad range of applications. This makes it challenging to navigate and hard to understand without solid foundations. This book will guide you from the basics of neural networks to the state-of-the-art large language models in use today. The first part of the book introduces the main machine learning concepts and paradigms. It covers the mathematical foundations, the structure, and the training algorithms of neural networks and dives into the essence of deep learning. The second part of the book introduces convolutional networks for computer vision. We’ll learn how to solve image classification, object detection, instance segmentation, and image generation tasks. The third part focuses on the attention mechanism and transformers – the core network architecture of large language models. We’ll discuss new types of advanced tasks they can solve, such as chatbots and text-to-image generation. By the end of this book, you’ll have a thorough understanding of the inner workings of deep neural networks. You'll have the ability to develop new models and adapt existing ones to solve your tasks. You’ll also have sufficient understanding to continue your research and stay up to date with the latest advancements in the field.
Table of Contents (17 chapters)
1
Part 1:Introduction to Neural Networks
5
Part 2: Deep Neural Networks for Computer Vision
8
Part 3: Natural Language Processing and Transformers
13
Part 4: Developing and Deploying Deep Neural Networks

Index

As this ebook edition doesn't have fixed pagination, the page numbers below are hyperlinked for reference only, based on the printed edition of this book.

Symbols

1×1 convolutions 114

1×1 cross-channel convolution 128

1D convolution 113

2D convolutions 113

3D convolution 113

A

abstract feature 66

activation functions 41, 42, 47-49

activation value 42

Adam optimizer 263, 264

AdamW 264

URL 264

additive attention 216

advanced CNN models 119

architectural principles 119

AI winters

reference link 69

alignment tuning 269

Allen Institute for AI (AI2)

URL 261

AlphaFold 2 model 81

AlphaGo 81

AlphaZero

reference link 81

anchor boxes (priors) 151

artificial intelligence (AI) 4

arXiv

URL 262

attention 168

attention complexity 248, 249

attention mechanism 70, 129, 211, 214

Bahdanau attention 214-216

general attention 218-220

Luong attention 217...