Jay van Zyl @ ecosystem.Ai

Jay van Zyl @ ecosystem.Ai

Inverting Transformers Significantly Improves Time Series Forecasting

Transformers are great at NLP and computer vision tasks, but I was surprised to learn they still lag behind simple linear models at time series forecasting. The issue is how most Transformer architectures treat each timestamp as a token and fuse all th…