<span class="vcard">/u/sjm213</span>
/u/sjm213

How does a 102M-parameter transformer forecast multivariate time series?

I recently worked through the architecture of t0-alpha, a 101.6M-parameter foundation model for time-series forecasting. The design choice I found most interesting is that it separates two kinds of reasoning: Time attention learns how each variable ev…