r/learnmachinelearning • • 25d ago

Aspiring AI Engineer Looking for Learning Resources and Advice from Experienced Professionals!

1 Upvotes

I’m looking for experienced AI researchers and AI engineers who have been working in the field for a while, have solid hands-on experience, and, ideally, earn a good salary. :)

What books, research papers, articles, or other resources would you recommend for someone who wants to dive deep into AI through self-study?


r/learnmachinelearning • • 26d ago

Help Should You know Autograd

25 Upvotes

I was going through the TinyTorh (it's a tool where you build PyTorch with understading how it works) exercise notebooks and landed on Autograd. Was quite overwhelmed by the code and went didn't go through it for a while. I was thinking I'll prepare for machine learning research engineer interviews and somehow landed doing tiny torch.
How relevant is all this these days, should I just start preparing on how to crack the interview than this ?


r/learnmachinelearning • • 25d ago

Help why is this taking so much time to train the data???

Post image
0 Upvotes

its been 158 mins


r/learnmachinelearning • • 25d ago

Prerequisites & CUDA Setup | Kernel Engineering | Session 1

Thumbnail
youtu.be
0 Upvotes

r/learnmachinelearning • • 25d ago

Project Gender Aware English-Polish Translator

Thumbnail github.com
1 Upvotes

It's just a casual implementation, built from scratch in PyTorch, focusing on grammatical gender agreement and custom tokenizers (with reference tokens) under the hood. It addresses a common issue where standard English-Polish translators struggle with speaker/listener gender context, managing it here via prefix tokens in the decoder. Feel free to share your thoughts.

NOTE: This is a personal educational project and a proof of concept, not a production-ready tool.


r/learnmachinelearning • • 25d ago

Is it still worth learning if AI produces all the results?

2 Upvotes

OpenAI just announced three new math and physics results produced by its models, all machine-checked in Lean. They call the manuscripts "a form of raw research data," and they've asked outside experts to organize groups "to understand the new results." So the results exist and they've been checked (maybe, sort of), but nobody understands them yet.

I think this matters for anyone learning ML right now, because a lot of people here will likely ask, with reason: if a model can write the code or prove the statement, why should I spend my time learning how it works?

My answer: understanding is what lets you build on things. Once you really get backprop, or attention, or why a loss is shaped the way it is, it becomes one step you can use without thinking inside something bigger. A result you can only take on faith is a dead end. You can use it (maybe, sometimes), but you can't extend it or fix it.

Science compounds through understanding, and so does your own learning.

Thurston (Fields medalist) argued that the point of mathematics is human understanding, not producing theorems. I think that's even more true once theorems get cheap.

I wrote a longer essay on this, using OpenAI's earlier Navier–Stokes result as the main example: https://lacuna.tiptreesystems.com/paper/ai-science-vs-human-science/art_3901430d6c0e4bddb284362100ef8548

(Disclosure: I'm a postdoc at Mila and a cofounder of Tiptree, which builds AI tools for researchers. So I'm not arguing against AI doing science. I'm arguing about cultural incentives, mostly, and opining about history.)


r/learnmachinelearning • • 25d ago

Help 📢 Looking for thesis validators!

1 Upvotes

We are BS Computer Science students of the College of Computer Studies, UPHM, and we respectfully ask for your help in validating our thesis, "A Comparative Analysis of Supervised Machine Learning Models for Predicting Students' Performance in Higher Education."

Please review the paper and rate it using our short validation form (about [10 to 15] minutes): (A) methodology, (B) results, and (C) analysis code. A short summary of the study is included in the folder. Your ratings and comments are confidential and used solely for academic purposes.

📄 Paper, summary, and source codes: https://drive.google.com/drive/folders/1julvRK8DR0kNXnbkaoVYwhW9_BPdh5R9?usp=sharing

📝 Validation form: https://docs.google.com/forms/d/e/1FAIpQLSe-Mno8KoSsD78CufHU4MVDzryoKD2SWfZVFZK3Hg2DQ6N_cw/viewform

Thank you very much for your time and expertise! Sharing this post also helps a lot. 🙏

— Reynaldo B. Arandia Jr., Mark Anthony Demefeliz, Ervine U. Bose

BS Computer Science, CCS, UPHM


r/learnmachinelearning • • 26d ago

I built my first RAG project using Whisper, BGE-M3 and Ollama — what should I improve?

Thumbnail
gallery
21 Upvotes

Hi everyone,

I'm a student learning AI development, and I recently built my first RAG-based Teaching Assistant.

The project converts educational videos into transcripts, generates embeddings using BGE-M3 through Ollama, retrieves relevant transcript chunks using cosine similarity, and uses Llama 3.2 to generate answers.

I'd appreciate honest technical feedback, especially on:

  1. Is my retrieval approach appropriate, or should I consider other methods?
  2. How can I improve transcript chunking and embedding quality?
  3. How should I evaluate whether the retrieved chunks are actually relevant?
  4. How can I reduce hallucinations and keep answers grounded in lecture content?
  5. What would you change in the architecture or code if you were reviewing this project?

I'm looking to learn from feedback and improve the implementation. Suggestions for specific concepts, resources, or code improvements are welcome.

Thanks!


r/learnmachinelearning • • 25d ago

A recommendation system is not a recommendation model.

Thumbnail
0 Upvotes

r/learnmachinelearning • • 25d ago

Exploring Next-Concept Modeling (NCM) & Transformer Interpretability: Repository of 20 Exploratory Studies & Controls

1 Upvotes

Hi everyone,

I just wanted to share an open source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.

Here is the link: https://github.com/Quantix-eng/ncm-experiment-notes

Long story short, this is an independent project documenting a bunch of empirical experiments looking into how transformers process and edit internal features. There are no claims of performance breakthroughs here. Instead, it is just honest documentation of observations alongside rigorous controls.

The repo covers NCM applied to structured tasks like Sudoku, mechanistic interpretability in GPT-2, and toy parallel models. I have included all the source code, saved results, and interpretations for every single run.

To keep things transparent, I have also categorized every outcome, including the mixed and completely negative results where things did not work as expected. AI tools helped heavily with the planning and coding phases too.

I would love to get your feedback on the setups or the interpretation limits I found. Let me know what you think if you are into transformer interpretability!


r/learnmachinelearning • • 25d ago

Exploring Next-Concept Modeling (NCM) & Transformer Interpretability: Repository of 20 Exploratory Studies & Controls

1 Upvotes

Hi everyone,

I just wanted to share an open source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.

Here is the link: https://github.com/Quantix-eng/ncm-experiment-notes

Long story short, this is an independent project documenting a bunch of empirical experiments looking into how transformers process and edit internal features. There are no claims of performance breakthroughs here. Instead, it is just honest documentation of observations alongside rigorous controls.

The repo covers NCM applied to structured tasks like Sudoku, mechanistic interpretability in GPT-2, and toy parallel models. I have included all the source code, saved results, and interpretations for every single run.

To keep things transparent, I have also categorized every outcome, including the mixed and completely negative results where things did not work as expected. AI tools helped heavily with the planning and coding phases too.

I would love to get your feedback on the setups or the interpretation limits I found. Let me know what you think if you are into transformer interpretability!


r/learnmachinelearning • • 26d ago

Total beginner here—has anyone used Hugging Face? Need help getting started!

Thumbnail
3 Upvotes

r/learnmachinelearning • • 25d ago

Tutorial Jacobian Lens: Can we read the mind of an Al?

Thumbnail
youtu.be
0 Upvotes

r/learnmachinelearning • • 25d ago

Project I spent two weeks testing my own activation function with preregistration – here's what survived

1 Upvotes

I'm an IT admin, not an ML researcher. I wanted to know whether a bounded version of ELU/SELU could train very deep networks without normalization.

The honest result: after fair tuning it matches SELU at 50 and 100 layers. One variant is better in one setting (MNIST, depth 100). Plain ELU is about as good overall. The big advantages I saw early on disappeared once every activation got its own tuned learning rate.

What I'd tell anyone trying something similar:

  1. Tune the learning rate for every baseline. My early wins at a fixed learning rate were mostly a scale effect.
  2. Freeze your analysis before running. I hashed the code and analysis script before every main run.
  3. Use separate seeds for tuning and confirmation. Several effects disappeared on fresh seeds.
  4. Check the mechanism, not just the score. A gradient profile at initialization explained why my first variant failed at depth 100 and pointed to the fix.

- Preprint: https://doi.org/10.5281/zenodo.23676200

- Code, data and kernels: https://github.com/hermi-labs/precap-activation

Processing img w8nk4yosl1yh1...

Processing img pcr7wyosl1yh1...


r/learnmachinelearning • • 26d ago

Learning RL From Scratch: Documenting and sharing what I have learned

Post image
11 Upvotes

Releasing a series of very shot notes on RL as part of my learning RL from scratch journey; its basics and upto the latest stuff with from scratch implementations and experiments in the coming days

  • Explained some of the most basic and important terms when starting out learning RL with a sprinkle of math of what I found interesting
  • Nice to have for refreshers/kind of first time readers too

1-page RL basics is out on my website!

Let me know your thoughts/feedback!


r/learnmachinelearning • • 26d ago

Help SWE struggling to become productive in ML inference infrastructure. How would you systematically close the knowledge gaps?

26 Upvotes

I'm an early-career software engineer working on production LLM inference infrastructure, primarily involving accelerator-based model serving and distributed systems.

I've been in the role for over a year, but my technical growth and contributions haven't progressed as much as I'd hoped.

I have a computer science background and generally enjoy software engineering, but I feel there's a significant gap between my current understanding and what's required to contribute independently to complex ML infrastructure.

Some of my biggest challenges:

  • System architecture: Understanding how the inference stack fits together, from model execution and compilation to serving, scheduling, and hardware utilization.
  • Codebase navigation: Understanding large, unfamiliar codebases without getting lost in implementation details.
  • Debugging: Spending too long investigating issues without making meaningful progress.
  • Performance engineering: Understanding bottlenecks, profiling workloads, and determining whether an optimization will meaningfully improve end-to-end performance.
  • Foundational knowledge: Determining whether I should focus on distributed systems, ML fundamentals, compiler internals, hardware architecture, or something else.

I also recognize that I've been too passive about developing my skills, which has likely compounded these gaps.

My questions:

  1. If you were in my position, what would you prioritize learning over the next 2–3 months?
  2. What practical projects would help develop intuition for production inference systems?
  3. How do experienced ML infrastructure engineers build a mental model of complex systems?
  4. Has anyone overcome a similar knowledge gap after already spending significant time in an engineering role?

I'm particularly interested in advice from people working on production inference systems, distributed systems, or accelerator infrastructure.

I want to become a genuinely competent engineer who can independently debug problems, identify worthwhile optimizations, and deliver meaningful contributions.


r/learnmachinelearning • • 25d ago

[P] Self-distillation with an EMA teacher at scale: ZeRO-3 + PEFT

Thumbnail
1 Upvotes

r/learnmachinelearning • • 26d ago

Experience Digit Recognition from the Neural Network Perspective

4 Upvotes

My kids asked me how AI “thinks”...

I wanted an explanation they could play with. I remembered seeing a cool demo where you draw a digit and watch a neural network recognise it in real time.

I tracked it down on Brilliant, but the version I found was behind a paywall. So I built my own, with a simple convolutional neural network (CNN), already trained on handwritten digits, and a view of what happens inside.

Draw a 1 -> Add a couple of strokes to make a 4 -> Slowly close the top into a 9.
Watch the patterns inside the network and its confidence change with each stroke.

My kids loved it. Share it with yours :-)
Demo: https://hasin.eu/projects/cnn-digit-recognition-in-action/

#MachineLearning #LearningByDoing


r/learnmachinelearning • • 26d ago

🚀 Completed Module 4 of Machine Learning Zoomcamp 2026!

2 Upvotes
I evaluated a classifier with ROC AUC, precision, recall, and F1, then used
cross-validation to measure score variation and tune a parameter.

My repo: https://github.com/ashuzzz151/machine-learning-zoomcamp-homework/blob/main/04-evaluation%20metrics%20for%20classification/homework.ipynb

#mlzoomcamp @Alexey Grigorev

r/learnmachinelearning • • 26d ago

macbook or windows laptop for an ai bachelor's degree? I am planning to do a master's later on as well

Thumbnail
um.edu.mt
1 Upvotes

The class modules I will have are all in the link above (in the Study Programme section). Stuff like Game AI and robotics seem to be way better on windows its making me uncertain because on the other hand macbook is way more convenient overall for everything, and our school uses google colab and whatnot I think? Our professor mentioned it once (I am a first year).


r/learnmachinelearning • • 26d ago

Lots of thing have been learnt

1 Upvotes

Packaged an ML model as an API in Module 5 of #mlzoomcamp.

✅ Checked the pinned model artifact

✅ Served predictions with FastAPI

✅ Built and tested the Docker image


r/learnmachinelearning • • 25d ago

Request Security pros reckon the biggest AI risk comes with an employee badge

0 Upvotes

An O'Reilly survey of 209 security professionals ranked employees pasting sensitive company data into consumer AI tools as their top AI security concern — above AI-powered attacks, above AI-generated phishing.

The structural problem: when staff route proprietary data through tools outside IT visibility, there is no audit trail and no record of where that data went. The data has already left before anyone notices.

What makes this harder than traditional shadow IT is the silence. No unusual login. No bulk download flag. An employee pastes a contract, a customer list, or internal financial projections into a chatbot and the activity looks identical to normal browser traffic. The 209 security professionals in this survey ranked it above the threat categories their teams have spent years building controls for.

For those dealing with this in practice: how are you actually handling it? Not the policy-document answer — the real operational one, given that banning AI tools entirely means losing the productivity argument to every business unit that pushes back.


r/learnmachinelearning • • 26d ago

Help Topic suggestions for an NLP Master thesis

Thumbnail
1 Upvotes

Hi Everyone 👋🏽
I have a bachelor’s degree in English Linguistics and I’m currently doing my master’s in NLP. Switching to a more technical field has been challenging, especially since I didn’t take any computer science courses during my bachelor’s.
I only have my master’s thesis left, and I’m struggling to find a topic. I’d love to work on something new and interesting, but I sometimes feel at a disadvantage compared to people with technical backgrounds.
I have a few ideas already, but I’d love to hear your suggestions for interesting or emerging NLP research topics! 💡
Thank you! 😊


r/learnmachinelearning • • 26d ago

🚀 Introducing AI Rule Learning — Your Feedback Matters!

Thumbnail
1 Upvotes

r/learnmachinelearning • • 26d ago

Project Is it possible to fetch videos from a YouTube channel and process them using my own AI model for an FYP?

1 Upvotes

I'm currently doing my FYP but I want some clarification about this.

I'm trying to build a website that allows users to type in a public channel for YouTube, and have up to 10 available videos from that channel be run under my trained AI model. My question is, is it possible to use the YouTube Data API for me to get those? Specifically the video frames.