-
Book Overview & Buying
-
Table Of Contents
Time Series with PyTorch
By :
In this chapter, we have investigated the theories of transformers, built our own transformer using PyTorch, and applied transformer models to the M5 competition dataset. Transformer is a very active area of research in forecasting, and we get new transformer-based models every now and then. However, you can easily catch up with the new research with a good understanding of the vanilla transformer. For example, we briefly mentioned a model called iTransformer whose architecture is almost the same as the vanilla transformer. As long as we have built the big picture of the architecture and understand how the attention mechanism works, iTransformer is intuitive to understand. With both recurrent models and transformers explained and experimented, we will discuss more neural networks that can be used as forecasters in the upcoming chapter.
In the next chapter, we will show you even more neural network models. We will glance over basic neural networks such as MLPs as well as...