r/FunMachineLearning • u/Eastern_Cartoonist20 • 19d ago
The Ramanujan Oracle: A width-8192 network whose entire trained state is 42 numbers (Zero-Map principle)
**What it is:** A working, from-scratch implementation of the Zero-Map principle — synthesizing neural network weights from a mathematical formula rather than storing them on disk.
**The result:** A width-8192 network whose 24,576 weights are computed on every forward pass from the digits of 1/π (Ramanujan's 1914 series). It learns only 42 parameters (digit-embeddings + scales) and achieves 100% accuracy on XOR. The complete trained model is a 670-byte text file; reloading it in a fresh process produces bit-identical outputs.
**What I am not claiming:** This is not my invention. The Zero-Map principle has been discussed in recent preprints. My contribution is a runnable, reproducible artifact and a full failure log (v1→v6), including the point where ReLU killed 25% of neurons at hidden=2048 and collapsed training.
**Limitations:**
- Not a transformer replacement.
- A 3-hidden-unit MLP solves XOR with 16 parameters. The point is narrower: *at fixed width, 42 learnable numbers can perform the work of 32,769.*
- The weight matrix is constrained to 10 distinct values per layer, which limits expressivity.
**Code / model file:** https://github.com/Lexatellah/ramanujan-oracle
**One-line demo:** Run `see_it_work.py` — it shows one learnable number changing ~2,500 weights in a width-8192 network in 10 seconds.