Book Image

PyTorch Deep Learning Hands-On

By : Sherin Thomas, Sudhanshu Passi
Book Image

PyTorch Deep Learning Hands-On

By: Sherin Thomas, Sudhanshu Passi

Overview of this book

PyTorch Deep Learning Hands-On is a book for engineers who want a fast-paced guide to doing deep learning work with PyTorch. It is not an academic textbook and does not try to teach deep learning principles. The book will help you most if you want to get your hands dirty and put PyTorch to work quickly. PyTorch Deep Learning Hands-On shows how to implement the major deep learning architectures in PyTorch. It covers neural networks, computer vision, CNNs, natural language processing (RNN), GANs, and reinforcement learning. You will also build deep learning workflows with the PyTorch framework, migrate models built in Python to highly efficient TorchScript, and deploy to production using the most sophisticated available tools. Each chapter focuses on a different area of deep learning. Chapters start with a refresher on how the model works, before sharing the code you need to implement it in PyTorch. This book is ideal if you want to rapidly add PyTorch to your deep learning toolset.
Table of Contents (11 chapters)
10
Index

Chapter 5. Sequential Data Processing

The major challenges that neural networks are trying to solve today are processing, understanding, compressing, and generating sequential data. Sequential data can be described vaguely as anything that has a dependency on the previous data point and the next data point. Handling different types of sequential data requires different techniques, although the basic approach can be generalized. We'll explore what the basic building blocks of sequential data processing units are as well as, the common problems and their widely accepted solutions.

In this chapter, we are going to look at sequential data. The canonical data that people use for sequential data processing is natural language, although time series data, music, sound, and others are also considered to be sequential data. Natural language processing (NLP) and understanding has been explored extensively and it's an active field of research right now. The human language...