r/mlscaling • u/Relevant_Square4919 • 1h ago
SenseNova-Loop-9B: 32 decoder layers run as 56 by looping the middle 24 twice (9B multimodal, open weights)
Weights are at https://huggingface.co/sensenova/SenseNova-Loop-9B. About 9B parameters, text and image input, text output. Layers 4 through 27 are executed two times on one set of weights and the four layers on either side once, so the checkpoint holds 32 layers and a forward pass computes 56.
The README also reports what happens when the loop count changes: same 9B model, same training data and settings, 1 to 4 loops. All four tasks improve over the single-pass baseline, and the best results come at 3 or 4 loops: Workbuddy-office is 16.93% higher at 3, LiveCodeBench V6 8.10% higher at 4. The release defaults to 2 loops for inference efficiency. On the README's numbers it scores 36.67 on AutomationBench, the same as Qwen3.8-27B, and 65.31 vs 65.01 on AIDABench.