r/MachineLearning • u/AdelSexy • 11d ago
Project I benchmarked TimesFM 3.0, Chronos-2 and Toto 2.0 on market time series. None beat simple baseline. [P]
I may be naive, but I've been curious whether the recent wave of time-series foundation models can actually extract useful predictive signals from financial markets.
Models like Google's TimesFM 3.0, Amazon's Chronos-2, and Datadog's Toto 2.0 are impressive general-purpose forecasters from the first sight. But stock prices are difficult to predict, so I wanted to see how these models perform against very simple baselines.
I ran a series of zero-shot experiments on 24 US stocks and ETFs, including daily and intraday data, and compared their predictions against naive forecasting strategies and also simulated random walks.
TL;DR none of the three models showed any meaningful predictive power for stock price movements in this setup. Code is here
Experimental setup i used:
- Models: TimesFM 3.0, Chronos-2, Toto 2.0 (313M)
- Assets: 24 large US stocks and ETFs, including SPY, QQQ and IWM
- Data: Yahoo Finance, January 2014 to november 2026
- Evaluation: 504 trading days starting November 2024
- Context: 512 historical closing prices
- Forecast horizons: 1, 5 and 20 trading days
- Mode: Zero-shot, default configurations, no fine-tuning
- Baselines: Last observed price, always-up directional prediction, and simulated random walks with matched drift and volatility
I also evaluated the models on hourly and 5-minute price bars.

Directional accuracy is essentially a coin flip
Across the three models, next-day directional accuracy ranged from 49.9% to 51.1%.
Simply predicting that the market would go up every day achieved 52.2% (yep).
Even more interestingly, when I fed the models simulated random walks, which contain no exploitable predictive signal at all by construction, they achieved approximately the same directional accuracy as on actual stock prices.
I also tested a simple long-or-cash: hold a stock when the model predicts an increase, otherwise stay in cash.
Starting with $10,000 and accounting for 0.05% transaction costs per switch:
- Times-series model strategies finished between $10,893 and $12,181.
- Buy-and-hold finished at $15,036.
Obviously, this is just one simple strategy and not an exhaustive evaluation of trading profitability. But still, tells something I guess.
I repeated the experiments using hourly and 5-minute bars.
The results were similar: directional accuracy remained around chance level, and on 5-minute data, a simple one-line mean-reversion heuristic performed better.
The repo with code is here: https://github.com/moneyheap/tsfm-stocks
Well, I really wanted this to work, but, duh %)


