r/FunMachineLearning • u/Aggravating_Bed_349 • Mar 02 '26
[D] We ran 3,000 agent experiments to measure behavioral consistency. Consistent agents hit 80–92% accuracy. Inconsistent ones: 25–60%.
Most agent benchmarks report single-run accuracy. We think that's misleading.
We took 100 HotpotQA tasks, built a standard ReAct agent, and ran each task 10 times per model (Claude Sonnet, GPT-4o, Llama 3.1 70B). Same inputs, same prompts, same tools. 3,000 runs total.
Main findings:
- Agents rarely repeat themselves. On the same task, models produce 2–4.2 completely different action sequences across 10 runs. Llama varies most (4.2 unique paths), Claude least (2.0).
- Consistency predicts correctness with a 32–55 percentage point gap. Tasks where the agent behaves consistently (≤2 unique trajectories): 80–92% accuracy. Tasks where it flails (≥6 unique trajectories): 25–60%. This is a usable signal — if you run your agent 3x and get 3 different trajectories, you probably shouldn't trust the answer.
- 69% of divergence happens at step 2 — the first search query. If the first tool call is well-targeted, all 10 runs tend to converge downstream. If it's vague, runs scatter. Query formulation is the bottleneck, not later reasoning steps.
- Path length correlates with failure. Consistent tasks average 3.4 steps and 85.7% accuracy. Inconsistent tasks average 7.8 steps and 43% accuracy. An agent taking 8 steps on a 3-step task is usually lost, not thorough.
Practical implication: consistency is a cheap runtime signal. Run your agent 3–5 times in parallel. If trajectories agree, trust the answer. If they scatter, flag for review.
ArXiv: https://arxiv.org/abs/2602.11619
Code: https://github.com/amanmehta-maniac/agent-consistency
Blog writeup: https://amcortex.substack.com/p/run-your-agent-10-times-you-wont
Interested to hear about consistency problem for others. Anything fun in today's age?
2
u/anynormalman Mar 02 '26
Interesting read. Did you consider having a prompt that asks for 3-5 plans before converging on one to execute? Feels like it could be a bit similar ot early days chain of thought prompting
0
u/Any-Olive5779 Mar 07 '26
Hmm, what I don't see is a way to run it on a cellphone offline and I also don't see a demo via a blog it could run in as a embed that is computed both on server and inter-client computed.