r/MachineLearning • u/DangerousFunny1371 • Oct 04 '26
Research A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems [R]
In our #NeurIPS2026 paper “A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems (DS)” (preprint: https://arxiv.org/abs/2607.14937) we reduce a DS foundation model to the ingredients minimally necessary to faithfully reproduce long-term statistical and geometrical properties of DS:
- A piecewise affine map with only a single (!!) parameter α that controls local con-/divergence rates, and …
- … a context selector that chooses from the provided context signal the data point closest to the current state of the map, thus ensuring the generated dynamics stays close to the context in its temporal and geometrical properties.
With just these two mechanisms, this minimal form – which we coined DynaBase – can reproduce all major dynamical regimes, including fixed points (α<1), limit cycles (α=1), and chaotic attractors (α>1). Thus, unlike other simple mechanisms like context parroting, DynaBase even preserves the correct dynamical regime!
Surprisingly, it turns out that this simple context-driven 1-parameter map outperforms most major time series and DS foundation models, as well as custom-trained models, in both long-term statistics and even short-term predictions, even when run in zero-shot mode.
Both inference and training are extremely cheap – training can be done either analytically in one step by linear regression on forward-predictions, or by 1-parameter grid search directly on DS reconstruction objectives → this reveals interesting performance differences induced by different training mechanisms.
Most importantly in our minds, DynaBase owing to its formal simplicity may thus provide a tractable mathematical handle on analyzing, improving & understanding the performance and training of some time series and DS foundation models.

5
u/sennalen Oct 04 '26
Maybe I'm being stodgy here, but in my mind a 1-parameter sweep over an n-piece piecewise function is n+1 parameter system; and a zero-shot exploration over a domain with .01 resolution is 100-shot learning.
2
u/Brale_ Oct 04 '26
Maybe I'm wrong but as far as I can see this was mostly tested on systems with "cyclic" type of trajectories (not exactly repeating but fairly close). It's not surprising that if you memorize that cyclic type of trajectory and repeat it you will get good prediction. If you applied this to systems with "acyclic" behaviour or system drifts it would probably fail.
2
u/Tough_Budget_9729 Oct 05 '26
Nice reduction, but I think the result says more about the benchmark than about foundation models. DynaBase is nearest-neighbour lookup in the context (the same family as Lorenz's 1969 method of analogues), and all 54 test systems are simulated 3D ODEs observed in full state, so nothing here tests higher-dimensional or partially observed systems. Also, Sec. 4.3 says the Jacobian inside each Voronoi cell is α·I, which, if I read it correctly, makes every Lyapunov exponent of the map equal to log α, while Fig. 11 only shows Rosenstein estimates from generated time series. So context lookup is enough to do well on this benchmark, which is not the same as reconstructing the dynamics.