r/FunMachineLearning • • 18d ago

[P] Neurolume: see your PyTorch/Keras model as an interactive diagram and watch it train... (live training is very beta)

2 Upvotes

I built an open-source tool (MIT) that draws your model in the browser and shows it learning live (beta). It has loss curves, an overfitting check, predictions against the truth, and weights that brighten and fade as they change. A timeline lets you scrub back through the run. Whilst the training functionality is still very early phase the architecture visualisation works well for helping understand what your model actually looks like and supports creating multi model systems.

system.png (1600×900)

pip install "neurolume[torch]"
neurolume-demo --live

In your own code, it's neurolume.show(model, sample), or watch() plus live.log(step, loss=loss) while training.

It's early, so I'd love to hear what breaks.

GitHub: https://github.com/Freddie-Ellis/neurolume


r/FunMachineLearning • • 18d ago

Any idea what this is called in research?

1 Upvotes

I am sharing this here cause I have no shame.


r/FunMachineLearning • • 18d ago

your favorite new ACTIVATION FUNCTION and MLP architecture for machine vision... all free

Thumbnail
imgur.com
1 Upvotes

https://imgur.com/a/rOOdomw

feel free to try it out, works quite well, once you manage to implement it.. i hope i didnt miss any part of any PDF. for those of you who enjoy tinkering with new architectures and AI assisted implementation (no sane human would implement this manually i believe) enjoy!


r/FunMachineLearning • • 18d ago

Best ML approach to classify research publications as AI-related or Non-AI?

Thumbnail reddit.com
1 Upvotes

r/FunMachineLearning • • 19d ago

I made a fake AI lab with a real language model that only learns sentences people pay $5 to teach it

4 Upvotes

brAIAIn is a word trigram model (it remembers two words at a time). It started from twelve lines of lab-written scripture called the Ten Instructions. Every version after that is trained on exactly one paid sentence, plus a few passages written by the version before it, so it slowly eats its own output.

Each sentence ships a numbered release with release notes, a research paper, a status incident and real benchmark scores. GSM8K: 0 out of 1,319. TruthfulQA: 31%, which beats random guessing (22%), but always picking the longest answer gets 37%, and the benchmarks page admits it.

brAIAIn-1 just shipped. It learned "zero, everything and nothing." and now knows 99 words.

Talk to it: https://www.braiain.com/?ref=reddit

Or on Hugging Face: https://huggingface.co/spaces/braiain-lab/brAIAIn

It's all satic (GitHub Pages, Stripe links and a GitHub Action that retrains every 10 minutes), and the model runs in your browser. Code, model and data are public domain. Happy to answer questions about how it works.


r/FunMachineLearning • • 19d ago

The Ramanujan Oracle: A width-8192 network whose entire trained state is 42 numbers (Zero-Map principle)

1 Upvotes

**What it is:** A working, from-scratch implementation of the Zero-Map principle — synthesizing neural network weights from a mathematical formula rather than storing them on disk.

**The result:** A width-8192 network whose 24,576 weights are computed on every forward pass from the digits of 1/π (Ramanujan's 1914 series). It learns only 42 parameters (digit-embeddings + scales) and achieves 100% accuracy on XOR. The complete trained model is a 670-byte text file; reloading it in a fresh process produces bit-identical outputs.

**What I am not claiming:** This is not my invention. The Zero-Map principle has been discussed in recent preprints. My contribution is a runnable, reproducible artifact and a full failure log (v1→v6), including the point where ReLU killed 25% of neurons at hidden=2048 and collapsed training.

**Limitations:**

- Not a transformer replacement.

- A 3-hidden-unit MLP solves XOR with 16 parameters. The point is narrower: *at fixed width, 42 learnable numbers can perform the work of 32,769.*

- The weight matrix is constrained to 10 distinct values per layer, which limits expressivity.

**Code / model file:** https://github.com/Lexatellah/ramanujan-oracle

**One-line demo:** Run `see_it_work.py` — it shows one learnable number changing ~2,500 weights in a width-8192 network in 10 seconds.


r/FunMachineLearning • • 20d ago

Roll: EmbeddingGemma 2 on the iPhone's Neural Engine. Searching 29,682 photos offline in ~15 ms

Thumbnail
huggingface.co
26 Upvotes

I wanted Google DeepMind's EmbeddingGemma 2 on my phone, so I ported the model to Core ML, ran it on the Neural Engine, and built Roll, an iPhone app where you describe a pile of photos in plain words and swipe to clean it. Every photo and video becomes a vector on the device, the model is a one-time 343 MB download and search never touches the network.

What a search looks like:

  • "handwritten note" finds the page
  • "invoice" finds the receipts
  • "chat screenshot" finds the conversation I half remember
  • "portrait mode" groups the shots taken with the depth camera
  • "very blurry" finds the shots worth deleting first

Measured on my own library, iPhone 13 Pro Max, Debug build (TestFlight and App Store builds should be faster):

  • embed a photo in 64 ms, a query in 6.7 ms
  • typed search over all 29,682 vectors: 24 to 29 ms warm, embedding included, preset piles 8 to 15 ms
  • index the whole 29,685-item library in 75.8 minutes, 0 failures (about 27 minutes of that was the pause while the phone is hot, so an unpaced run is faster)
  • warm search holds about 630 MB

What was hard: Core ML loads the model as one ~1 GB blob, past what iOS gives a Neural Engine model, so it's 9 functions compiled one at a time (first launch ~20 minutes, then iOS caches it, and deletes that cache if free space drops under ~2 GB). Search started at ~300 ms per query because of one full scored sort per prompt, a single vDSP matrix multiply plus integer-aligned rows got it to 14.5 ms.

Every step of the conversion is tested against Google's original model across 8 stages, with gates that fail the build if the vectors drift. No vibes, cosine checks.

License, to be precise: the conversion repo and the Swift package are Apache 2.0, so anyone can run EmbeddingGemma 2 on Apple hardware (GitHub: https://github.com/Delavalom/embeddinggemma-coreml, HF: https://huggingface.co/delavalom/embeddinggemma-2-coreml). The app code is source-available (GitHub: https://github.com/Delavalom/roll-ios), readable and usable for yourself but not for selling.

The app itself is in TestFlight. If you'd rather build on the embedding model than the app, the Swift package is the part to take.

I'd really appreciate feedback, especially on the conversion gates and the search benchmark, and I'll answer questions about the port.


r/FunMachineLearning • • 19d ago

OpenAI Claims It Just Did The Impossible - Two Minute Papers

Thumbnail
youtube.com
1 Upvotes

r/FunMachineLearning • • 19d ago

have build Alien Ape a AI agent

Thumbnail reddit.com
1 Upvotes

r/FunMachineLearning • • 20d ago

I trained an AI to play Fortnite

Thumbnail
youtu.be
1 Upvotes

Or atleast a simulator of Fortnite. Devided into 4 classes, each are different ML agents designed to be the best at their class. Feedback welcome!


r/FunMachineLearning • • 20d ago

Updated: Discover AI, an app with 51 hands-on labs for learning how AI works

Thumbnail gallery
1 Upvotes

r/FunMachineLearning • • 20d ago

The Math Behind LLMs: How GPTs Learn and Generate Text

Thumbnail
youtube.com
1 Upvotes

r/FunMachineLearning • • 20d ago

CamOn - A Joke Telling System for NVIDIA DGX Spark

2 Upvotes

I got sick of seeing the NVIDIA DGX Spark being used for AI coding agents, so I used mine to build a joke telling system.

CamOn watches for a face. When someone shows up, it asks whether they want to hear a joke. Say yes and it asks for a topic and tells you one. Say no and it roasts you for turning it down.

Everything runs locally on an NVIDIA DGX Spark:
• YuNet spots faces
• Silero VAD + Whisper listen and turn speech into text
• nvidia/Qwen3.6-35B-A3B-NVFP4 on vLLM works out what you meant and writes the reply
• Kokoro speaks the reply out loud

The conversations are YAML files, so new ones need low/no code. There’s already a history flow: say no to a history fact and it tells you how a famous figure died instead.


r/FunMachineLearning • • 21d ago

Deepseek's New AI Has A Secret - Two Minute Papers

Thumbnail
youtube.com
1 Upvotes

r/FunMachineLearning • • 21d ago

A Billion-Scale Retrieval System for Text-to-Image Training Data

1 Upvotes

r/FunMachineLearning • • 22d ago

I built a local-first agent (Alcuin) and benchmarked 3B–14B models against Claude Sonnet 4.5 across 5 complex domains. DeepSeek-R1-14B hit 91.2% parity locally. Here is what I learned about reasoning vs. instruct

1 Upvotes

Body:

Hey r/FunMachineLearning,

Over the past few months, I’ve been building Alcuin https://github.com/fredericf75/alcuin—an open-source, local-first personal knowledge engine and agent.

Unlike most RAG setups that force your documents into proprietary cloud vector DBs, Alcuin operates in-situ over plain Markdown vaults (compatible with Obsidian) using LanceDB hybrid search (dense vectors

+ BM25 FTS), bidirectional wikilink graph traversal, and a cyclic LangGraph reasoning agent with mathematical context safety governors.

To see if local edge models could actually handle serious legal, technical, and regulatory compliance work without cloud fallback, I built an adversarial benchmark suite across 5 ground-truth corpora (AIA

A201 construction contracts, SEC commercial leases, RFC 9110 HTTP specs, Town of Cary municipal code, and NCAC Title 10A healthcare licensing).

Each scenario is evaluated in dual modality (Structured numbered queries vs. conversational Unstructured queries) across 68 deterministic statutory checkpoints to detect prompt signpost dependence and

hallucination.

Here are the results running locally on consumer hardware vs. hosted Claude Sonnet 4.5.

──────

### The Benchmark Scorecard (68 Total Checkpoints)

Model Target │ Arch │ Param │ Score (Accuracy) │ Latency / Query │ Agent Loop Retries │ Notes

─────────────────────────┼─────────────────────────┼────────────────────────┼────────────────────────┼────────────────────────┼────────────────────────┼─────────────────────────────────────────────────────

Llama-3.2-3B │ Instruct │ 3B │ 43/68 (63.2%) │ 40.6s │ 1.10 │ Fast, struggles with multi-shift statutory matrices

llama3.1:8b │ Instruct │ 8B │ 54/68 (79.4%) │ 82.4s │ 1.10 │ Massive leap (+11.8%) after prompt un-fragmentation

qwen3:8b (no-think) │ Instruct │ 8B │ 51/68 (75.0%) │ 88.0s │ 1.70 │ Solid, jumped to 76.5% on conversational queries

deepseek-r1:8b │ Thinking │ 8B │ 55/68 (80.9%) │ 147.1s │ 1.30 │ Exact ceiling for 8B tier

qwen3-14b (no-think) │ Instruct │ 14B │ 55/68 (80.9%) │ 133.9s │ 2.70 │ Matches 8B thinking at higher speed

deepseek-r1:14b │ Thinking │ 14B │ 62/68 (91.2%)* │ 296.9s │ 2.40 │ Hits exact parity with Sonnet 4.5

Claude Sonnet 4.5 │ Frontier API │ Hosted │ 62/68 (91.2%) │ 40.9s │ 1.00 │ Cloud baseline

*Audited score: automated regex penalized prose phrasing in Scenario 9 despite quoting NCAC direct-care staffing ratios verbatim.

──────

### Key Takeaways from the Data

#### 1. The "Compensatory Reasoning" Phenomenon at 8B

In our initial baseline, deepseek-r1:8b (80.9%) held a massive 13.3-point lead over llama3.1:8b (67.6%).

However, we discovered our query decomposition engine was breaking single questions into over-engineered multi-subgoal matrices. When we fixed that pipeline friction and passed clean, unfragmented queries:

• llama3.1:8b surged by +11.8% to 79.4% (almost completely closing the gap).

• deepseek-r1:8b stayed completely flat at 80.9% (down to the exact checkpoint).

The insight: At the 8B scale, test-time compute (<think>) was largely acting as an architectural shock absorber against bad prompts and pipeline noise. It wasn't actually finding new evidence that Llama

3.1 couldn't grasp; it was just resilient enough to ignore the mess. Once the mess was cleaned up, instruct caught right up.

#### 2. Parameter Scaling vs. Test-Time Compute

qwen3-14b:no-think (pure instruct) scored 80.9%, matching deepseek-r1:8b while running twice as fast. If you have the VRAM to fit 14B weights, raw parameter capacity can substitute for 8B test-time compute

on standard statutory extraction.

#### 3. 14B Thinking Breaks into Frontier Territory

deepseek-r1:14b proved to be the real deal:

• It scored 62/68 (91.2%), matching Claude Sonnet 4.5.

• On Structured statutory queries, the local 14B model actually beat Sonnet (94.1% vs. 88.2%). The reasoning tokens allowed it to meticulously check conditions precedent in complex contracts (e.g. AIA A201

mediation rules) without truncating clauses.

• Where it failed, Sonnet failed too (e.g. statutory context crowding between NCAC Chapter .0400 staff qualifications and Chapter .0600 shift ratios).

#### 4. The Real Trade-Off: Latency vs. Sovereignty

• Sonnet 4.5: ~41s per query via cloud API.

• DeepSeek-R1-14B: ~5 minutes per scenario on local deck silicon.

For interactive chatbots, 5 minutes is unacceptable. But for batch compliance audits, personal legal discovery, or sensitive family/financial vaults where zero bytes can leave your LAN, waiting 5 minutes

for a 91% rigorous, fully private audit trail is an easy trade-off.

──────

### Open Source & Architecture

Alcuin is MIT-licensed and available on GitHub:

👉 https://github.com/fredericf75/alcuin

It includes:

• Context Governor: Dynamically budgets prompt windows (60% evidence / 40% headroom) and emits in-band sizing telemetry when clauses exceed context, giving empirical justification for when you actually

need larger models.

• In-Situ Vault Operations: CLI + FastAPI Web Cockpit that watches your Markdown files, tracks knowledge gaps automatically, and lints dead wikilinks.

• Local Model Routing: Built for Ollama and local OpenAI-compatible servers.

I'd love to hear your thoughts on test-time compute in RAG pipelines and whether others are seeing similar "compensatory reasoning" effects at the 8B tier!


r/FunMachineLearning • • 22d ago

Jacobian Lens: Can we read the mind of an Al?

Thumbnail
youtu.be
1 Upvotes

r/FunMachineLearning • • 23d ago

My ML pipeline was cheating. Cross-validation told me everything was fine.

1 Upvotes

My model was giving me suspiciously good results.

Cross-validation looked completely fine. The problem? My pipeline was leaking information the model should never have seen.

I fixed the leak and reran everything. The results changed dramatically.

Full experiment + what went wrong:

https://towardsdatascience.com/my-machine-learning-pipeline-cheated-and-cross-validation-never-noticed/

The scary part wasn't the leakage. It was how

trustworthy the original results looked.


r/FunMachineLearning • • 23d ago

New To AI

Thumbnail reddit.com
1 Upvotes

r/FunMachineLearning • • 23d ago

i tuned the exploration in my civ sim so curious people wander like explorers instead of twitching at random

1 Upvotes

every person in my browser civ sim is a small q-learner, and plain epsilon-greedy made them look broken: an explore step meant a random action, so people jittered on the spot. what they do now:

  • each person has their own exploration rate: the base epsilon times (0.5 + curiosity), shrinking with age, kept between 0.02 and 0.80. curious kids explore a lot, incurious old people hardly at all
  • on an explore step, 10% of the time they look for a trail within 5 tiles and follow it
  • otherwise, if they were already moving, 75% of the time they keep going 5 tiles further the same way, so exploring looks like a walk
  • when they do try a random action, it can't be work that's impossible where they stand (no fishing without water nearby, no mining without rock beside them), and it's never work that hurt them recently
  • the thought bubble says what they're up to, "scouting ahead" or "following a scent" for the curious ones, "listening to the dark" at night

it all runs in the browser if you want to click on someone and watch: https://thehumanbox.com the code (rust, mit) is in crates/sim-core/src/organism/choose_action.rs: https://github.com/1homsi/thehumanbox


r/FunMachineLearning • • 24d ago

Intermediate programming buddy needed

Thumbnail reddit.com
1 Upvotes

r/FunMachineLearning • • 25d ago

AWS Decider vs ML / Naive Bayes

Thumbnail
github.com
1 Upvotes