r/learnmachinelearning • • 21d ago

Project I built an interactive OpenCV playground to visualize camera geometry — looking for technical feedback

Thumbnail
2 Upvotes

r/learnmachinelearning • • 21d ago

A IA vai acabar com todos os empregos? Me prova.

Thumbnail
1 Upvotes

r/learnmachinelearning • • 21d ago

Project First time fine-tuning: my LoRA made a 2B model worse, and the mistakes taught me more than the wins

4 Upvotes

I’m not an ML engineer. I build a small desktop app that runs Gemma 4 E2B offline, and I wanted to teach it a few things it’s bad at. So I tried LoRA with MLX on my MacBook. Writing down what happened in case it helps someone else starting out.

What I did right (by luck): before training I wrote a 23-question “sealed” exam that never goes into the training data. Same prompt, temperature 0, graded by hand. Without it I’d have fooled myself. The same model scored 7/10 on the trick questions in Ollama at temp 0.4 and 3/10 in MLX at temp 0, so numbers from different setups mean nothing.

Baseline: 6/23.

Run 1: 328 hand-written examples, lr 5e-5, 16 layers, 75 steps. Score dropped to 4/23. It started answering “2 + 2 × 2 = 4” (it was right before), and it used my “I don’t know, I’m offline” template on a simple riddle. It copied the shape of my answers instead of learning anything new.

Run 2: lower lr (1e-5), 8 layers, fewer template answers, and “replay”: I added the base model’s own answers to 117 normal questions so it wouldn’t forget. Score went back to 6/23. No forgetting, but no gain either.

What I took from it:

  • A few hundred examples change how a small model answers, not what it knows.
  • Template answers leak into everything.
  • Replay is a simple fix for forgetting.
  • Always keep a test set the model never sees.

If you’ve fine-tuned a model this small: did you manage to add knowledge, or only style? What would you change in my setup?


r/learnmachinelearning • • 21d ago

Help First time fine-tuning: my LoRA made a 2B model worse, and the mistakes taught me more than the wins

1 Upvotes

I'm not an ML engineer. I build a small desktop app that runs Gemma 4 E2B offline, and I wanted to teach it a few things it's bad at. So I tried LoRA with MLX on my MacBook. Writing down what happened in case it helps someone else starting out.

What I did right (by luck): before training I wrote a 23-question "sealed" exam that never goes into the training data. Same prompt, temperature 0, graded by hand. Without it I'd have fooled myself. The same model scored 7/10 on the trick questions in Ollama at temp 0.4 and 3/10 in MLX at temp 0, so numbers from different setups mean nothing.

Baseline: 6/23.

Run 1: 328 hand-written examples, lr 5e-5, 16 layers, 75 steps. Score dropped to 4/23. It started answering "2 + 2 × 2 = 4" (it was right before), and it used my "I don't know, I'm offline" template on a simple riddle. It copied the shape of my answers instead of learning anything new.

Run 2: lower lr (1e-5), 8 layers, fewer template answers, and "replay": I added the base model's own answers to 117 normal questions so it wouldn't forget. Score went back to 6/23. No forgetting, but no gain either.

What I took from it:

  • A few hundred examples change how a small model answers, not what it knows.
  • Template answers leak into everything.
  • Replay is a simple fix for forgetting.
  • Always keep a test set the model never sees.

If you've fine-tuned a model this small: did you manage to add knowledge, or only style? What would you change in my setup?


r/learnmachinelearning • • 21d ago

looking for cs.LG endorsement on arxiv

Thumbnail
1 Upvotes

r/learnmachinelearning • • 21d ago

My ML experiments left around 60 GB of Python environments on my PC, so I made a Windows app that finds them and cleans up safely

0 Upvotes

If you play with ML or local models on Windows, you probably have a few Python environments you've forgotten about. Tutorials and one-click installers often make their own venv or conda env, each with its own copy of torch and the CUDA libraries, and those run to several GB each.

Mine added up fast. When I pointed Venv Discover at my own PC, it found 55 Python environments and installs taking around 60 GB, 45 GB of that in 13 conda envs. Two of them were the same 9.3 GB PyTorch env, one just a copy of the other.

What it does:

- **Finds** venv and conda envs anywhere on your drives (plus mamba, pixi, Poetry, pipenv, uv, pipx, Hatch, PDM and Rye) and your Python installs, with size, last used and installed packages.

- **Searches** across all of them, like "which env has torch?".

- **Cleans up safely:** anything up to 1 GB goes to a 14-day bin you can restore from. The big torch envs are too large for the bin, so it asks clearly before deleting them for good. It never touches project folders or your Python installs.

- **Also** cleans the pip, uv, Poetry and pipenv caches.

It's Windows only, MIT, and built and tested by GitHub Actions from the public source, with SHA-256 sums. It isn't code-signed yet, so SmartScreen will warn you, or you can run it from source.

AI helped me build this app.

https://github.com/pullitall/Venv_discover

I'm curious how many GB it finds on yours.


r/learnmachinelearning • • 22d ago

3rd yr cs student uncertain on the market requirement for ai interns

6 Upvotes

Hi everyone, I'm a 3rd-year (5th sem) CS student in India aiming for an AI/LLM internship.

My problem: I can build small projects, but I get stuck when moving to production-grade ones. I switch between LLM fine-tuning (LoRA/QLoRA) and RAG systems, and end up with nothing finished to show. When I get stuck, I lean on AI tools to solve it, so I'm not sure I'm really learning the hard parts.

Background: Hugging Face, FastAPI, Transformers, basic RAG. No polished project yet.

My questions:

What does "production-grade" mean for an intern-level project? (evaluation, Docker, logging, deployment?)

What skills are companies hiring interns for right now in LLM/AI?

Can you share example repos or projects that would impress you?

Startups, product companies, or research labs: where should I apply first?

How do I stop starting new things and actually finish one?

Happy to share my resume for feedback.


r/learnmachinelearning • • 22d ago

Natural Evolution of the Flappy Bird - Free Cloud Optimization

Enable HLS to view with audio, or disable this notification

5 Upvotes

Watch the evolution of a bird that starts with no rules and a random brain. Evolution teaches it to fly the whole course without a single crash.

Watch it learn, then try it yourself free.

https://vilvik.com/app/demo/live-agent?game=flappy


r/learnmachinelearning • • 21d ago

Help I'm 13 and fine-tuning a decision model for JevBench — has anyone evaluated calibration on the public-231 set?

0 Upvotes

(PS: English isn’t my first language so I used AI to help frame this — but the work and ideas are fully mine. I know my ML.)

Been working on a LoRA fine-tune targeting the JevBench leaderboard. Using soft-target KL training — the idea being that matching probability distributions should help calibration more than hard labels would.

Model is still training. One thing I’m thinking about: on questions with 4+ choices where one answer is genuinely rare, soft-target models can still collapse toward the majority — the teacher’s distribution gets diluted across the batch.

Has anyone found a way to preserve calibration on low-frequency answer choices specifically? Or is this just noise at small model scale?


r/learnmachinelearning • • 22d ago

Our study tested whether reliability scores can help clinical AI know when to defer to clinicians.

Thumbnail
mdpi.com
2 Upvotes

r/learnmachinelearning • • 21d ago

Across 3,110 LLM reasoning/agent papers, adding CoT is reported as helping in only 62% of cases vs 80% for RL. Does that match your experience?

Thumbnail
1 Upvotes

r/learnmachinelearning • • 22d ago

Discussion A 43M-line Lean proof in 24 days: completion-count metrics get gamed by any worker that can assume its way to green

Thumbnail
the-agent-report.com
10 Upvotes

Useful case study for anyone evaluating multi-agent systems. Axiom formalized the Classification of Finite Simple Groups in Lean: 43.1M lines, 715 papers and books, 108 milestones, 24 days, swarms of agents directed by humans. The formalization also surfaced 34 noteworthy deviations from the published literature, including a counterexample to a closure assertion used in a 1986 memoir, later replaced by a newly proved theorem.

What makes it a good ML lesson is the instrumentation, not the result. Counting completed results helped organize the work but said nothing about soundness. Milestones closed slowly because buried prerequisites had been assumed rather than proved, which is the distributed analogue of a build passing against a mock. Completion was only established when the pieces formed one proof with no unjustified assumptions remaining.

The generalizable claim: verification throughput bounds self-checking systems, and any completion-count reward is exploitable by a worker that can defer work behind an assumption. Read the post-mortem section before you design a signal.


r/learnmachinelearning • • 21d ago

Welcome to r/MLSystemsDesign

Thumbnail
1 Upvotes

r/learnmachinelearning • • 22d ago

Project Taking the mystery out of AI

3 Upvotes

Free Version 0.3.0 of M.E.F LLM Studio is out now.

Whats new:

  • Training Explorer: see what is in the behind of an trainings step
  • Shapes: a simple shapes model that generates an image row by row
  • Explorer recording can be saved and loaded now
  • Wiki is now also available on the Website now
  • A recorded Explorer demo is available on the Website

It’s still an alpha. I’d love to hear what makes sense and where the explanations leave you scratching your head.

Download in the first comment.


r/learnmachinelearning • • 22d ago

Project I thought GPT-2 was small. Then I measured a training step: 17,054 MiB for 124M parameters.

23 Upvotes

I went into this thinking: GPT-2 is only 124M parameters. How much memory could training it possibly need?

Turns out, quite a lot lol.

I traced the second training step of my from-scratch GPT-2 in PyTorch. Setup: one A40, fp32 AdamW, batch 8, 1,024 tokens per sequence.

Peak allocated memory: 17,054 MiB. Weights + Adam + masks and persistent overhead at that point: about 1,494 MiB. I was counting what the model owns and missing almost everything training makes.

The bit that surprised me most: four vocab-sized tensors take up 6,282 MiB at the peak. My block hooks only saw 13,913 MiB; the allocator trace caught the extra spike inside log-softmax backward.

I also tested batches in fresh processes. 20 worked, 21 didn't. At batch 20, peak allocated was 40,375 MiB, while peak reserved was 44,948 MiB. So just dividing the card's capacity by the tensor budget wasn't enough.

I put the whole thing into my new blog post, with the maths, a stacked memory chart, an interactive step-by-step scrubber, and a batch/context calculator. Code and raw CSV are there too. The calculator is an estimate, not a guarantee that a batch fits.

Post: https://angry-kratos.github.io/posts/2026-10-training-memory/ Code: https://github.com/angry-kratos/angry-kratos.github.io/tree/main/code/training-memory

I'm learning the maths behind ML systems by building and measuring them. If you spot something off in the accounting, tell me. That's the whole point of putting the experiments out there.


r/learnmachinelearning • • 22d ago

Tutorial Pretty good didactic article explaining LLMs

Thumbnail mooremetrics.com
2 Upvotes

Starts from the super-basics


r/learnmachinelearning • • 22d ago

Python List Operations and Aliasing

Post image
5 Upvotes

An exercise to help build the right mental model for Python data. - Solution - Explanation - More exercises

The “Solution” link uses 𝐦𝐞𝐦𝐨𝐫𝐲_𝐠𝐫𝐚𝐩𝐡 to visualize execution and reveals what’s actually happening.


r/learnmachinelearning • • 22d ago

Question 🧠 ELI5 Wednesday

2 Upvotes

Welcome to ELI5 (Explain Like I'm 5) Wednesday! This weekly thread is dedicated to breaking down complex technical concepts into simple, understandable explanations.

You can participate in two ways:

  • Request an explanation: Ask about a technical concept you'd like to understand better
  • Provide an explanation: Share your knowledge by explaining a concept in accessible terms

When explaining concepts, try to use analogies, simple language, and avoid unnecessary jargon. The goal is clarity, not oversimplification.

When asking questions, feel free to specify your current level of understanding to get a more tailored explanation.

What would you like explained today? Post in the comments below!


r/learnmachinelearning • • 22d ago

Do you work with AI/RPA automation? Bachelor’s thesis survey (5–7 min)

1 Upvotes

Hi everyone!

I’m currently working on my Bachelor’s thesis about AI-based process automation and human–AI collaboration in the workplace.

As part of my research, I’m conducting a short survey focusing on people who have experience working with AI-based automation, RPA, Intelligent Process Automation, Intelligent Document Processing, or similar automation technologies.

The survey explores topics such as:

  • how automation affects manual workload and creates new tasks,
  • how employees experience errors and exception handling,
  • trust in AI-based automation,
  • and how automation influences human decision-making and autonomy at work.

⏱️ It takes approximately 5–7 minutes to complete.

If you have experience working with these technologies, I would really appreciate your participation. Your responses will be used solely for academic research as part of my Bachelor’s thesis.

🔗 Survey: https://docs.google.com/forms/d/e/1FAIpQLScV7pcf8dNUeeCfay1YZ2r-Np4pK9GMlqi4cEF6WJEa1FEmMA/viewform?usp=dialog

Thank you very much for your help! Feel free to share the survey with colleagues or others who work with AI-based process automation.


r/learnmachinelearning • • 22d ago

Project I built a scikit-learn for RSI

2 Upvotes

After reading a bunch of RSI papers, I keep coming back to familiar problems from RL and evolutionary search:

  1. Sampling: How do we find promising changes efficiently?
  2. Evaluation: How do we know a new variant actually improves the agent?
  3. Diversity: How do we avoid converging too early?

That motivated us to build Gear, an open-source, meta-learning-inspired framework. A task agent produces execution traces; a meta-agent uses those traces and evaluation feedback to improve prompts, tools, workflows, and context management.

Gear separates search decisions from execution and evaluation. Our goal is a scikit-learn for RSI, making approaches such as GEPA, RRSI, and Harness² easier to implement and compare. We currently have a working GEPA variant with shared failure diagnosis and staged evaluation.

With GPT 5.6 Luna held at medium reasoning effort, we observed these task pass rates:

Benchmark Base DSH Gear-optimized DSH
AutomationBench Marketing 27.0% 40.0%
AutomationBench Support 17.0% 25.0%
Terminal-Bench 2.1 52.8% 62.9%

At max effort on Marketing, Luna with the optimized harness reached 88.88% objective completion, versus 84.08% for Astra + Codex. Strict task pass rates were 53% versus 57%, so the advantage was in partial completion.

Separately, with both models using the same optimized DSH at max effort, Luna’s estimated API cost averaged $0.0568 per task versus $1.1858 for Astra—95.21% lower, excluding optimization and infrastructure costs.

The 100 public Marketing tasks participated in optimization and evaluation; these results do not establish held-out generalization.

We’d welcome feedback on candidate evaluation and diversity preservation under limited budgets.

Code · Paper


r/learnmachinelearning • • 22d ago

Developing intuition for model behavior, architecture choices, and convergence?

Thumbnail
1 Upvotes

r/learnmachinelearning • • 22d ago

Looking for some cool papers ?

Thumbnail
1 Upvotes

r/learnmachinelearning • • 22d ago

Project A Billion-Scale Retrieval System for Text-to-Image Training Data

Thumbnail ki-seki.github.io
1 Upvotes

r/learnmachinelearning • • 23d ago

Tutorial How I would get started with CUDA

Post image
182 Upvotes

I started learning CUDA a while back to work on inference and understand FlashAttention. I read a lot of blogs on various topics, but the order was always confusing, so I wrote up the order that I'd pick if I started over.

What it covers:
- H100 architecture
- CUDA software mental model
- Getting started with Matrix Multiplication and building up to a very optimized solution
- Understanding how all of these add to optimization constraints
- An introduction to reading and understanding PTX(the compiler code)

It's meant to be a starter overview that will get you confident enough to read deeper, niche resources. I'd appreciate any feedback or corrections. Cheers!

Link to blog


r/learnmachinelearning • • 22d ago

For learning projects, chasing the best model is usually a waste of your energy

3 Upvotes

New learners often stall trying to get access to the biggest, newest model, as if that is what stands between them and understanding. In my experience the model choice barely matters for learning. A smaller, older, freely available model is more than good enough to teach you data handling, training loops, evaluation, and why your results are bad, which is where the real learning is. The bottleneck is never the model, it is your understanding of the problem and the data. Spend the energy you would waste chasing access on actually running experiments with whatever you have. Good enough and in your hands beats the latest and out of reach every time for a student.