-
Book Overview & Buying
-
Table Of Contents
Time Series with PyTorch
By :
“… the Transformer, a model architecture eschewing recurrence and instead relying entirely on an attention mechanism to draw global dependencies between input and output.” From Attention Is All You Need
In this new Generative AI era, most of us have heard about the famous transformer model, or the T in ChatGPT. In the seminal paper Attention is All You Need, the legendary transformer architecture was born (Vaswani et al. 2017). The transformer model was initially invented for language tasks. Since time series data and language are quite similar due to their dependency on sequential positions, models that work on natural language processing are mostly tested on time series forecasting tasks too. In fact, companies such as Zalando already productionized transformers to forecast sales and demand, even before we see any publications about transformers for time series forecasting. We have discussed recurrent neural networks in the previous chapter...