Book Image

Deep Learning with PyTorch Lightning

By : Kunal Sawarkar
3.5 (2)
Book Image

Deep Learning with PyTorch Lightning

3.5 (2)
By: Kunal Sawarkar

Overview of this book

Building and implementing deep learning (DL) is becoming a key skill for those who want to be at the forefront of progress.But with so much information and complex study materials out there, getting started with DL can feel quite overwhelming. Written by an AI thought leader, Deep Learning with PyTorch Lightning helps researchers build their first DL models quickly and easily without getting stuck on the complexities. With its help, you’ll be able to maximize productivity for DL projects while ensuring full flexibility – from model formulation to implementation. Throughout this book, you’ll learn how to configure PyTorch Lightning on a cloud platform, understand the architectural components, and explore how they are configured to build various industry solutions. You’ll build a neural network architecture, deploy an application from scratch, and see how you can expand it based on your specific needs, beyond what the framework can provide. In the later chapters, you’ll also learn how to implement capabilities to build and train various models like Convolutional Neural Nets (CNN), Natural Language Processing (NLP), Time Series, Self-Supervised Learning, Semi-Supervised Learning, Generative Adversarial Network (GAN) using PyTorch Lightning. By the end of this book, you’ll be able to build and deploy DL models with confidence.
Table of Contents (15 chapters)
1
Section 1: Kickstarting with PyTorch Lightning
6
Section 2: Solving using PyTorch Lightning
11
Section 3: Advanced Topics

An image classifier using a pre-trained ResNet-50 architecture

ResNet-50 stands for Residual Network, which is a type of CNN architecture that was first published in a computer vision research paper entitled Deep Residual Learning for Image Recognition, by Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, in 2015.

ResNet is currently the most popular architecture for image-related tasks. While it certainly works great on image classification problems (which we will see as follows), it works equally great as an encoder to learn image representations for more complex tasks such as Self-Supervised Learning. There are multiple variations of ResNet architecture, including ResNet-18, ResNet-34, ResNet-50, and ResNet-152 based on the number of deep layers it has.

The ResNet-50 architecture has 50 deep layers and is trained on the ImageNet dataset, which has 14 million images belonging to 1,000 different classes, including animals, cars, keyboards, mice, pens, and pencils. The...