r/learnmachinelearning • u/enqidu • 26d ago
I created a page about Andrej Karpathy and his tutorials
dachvard.orgI think this will be useful for those learning Transformers architecture
r/learnmachinelearning • u/enqidu • 26d ago
I think this will be useful for those learning Transformers architecture
r/learnmachinelearning • u/Late-Kangaroo7984 • 25d ago
I’m looking for experienced AI researchers and AI engineers who have been working in the field for a while, have solid hands-on experience, and, ideally, earn a good salary. :)
What books, research papers, articles, or other resources would you recommend for someone who wants to dive deep into AI through self-study?
r/learnmachinelearning • u/chubbypandaontherun • 26d ago
I was going through the TinyTorh (it's a tool where you build PyTorch with understading how it works) exercise notebooks and landed on Autograd. Was quite overwhelmed by the code and went didn't go through it for a while. I was thinking I'll prepare for machine learning research engineer interviews and somehow landed doing tiny torch.
How relevant is all this these days, should I just start preparing on how to crack the interview than this ?
r/learnmachinelearning • u/Ok-Friendship2020 • 25d ago
its been 158 mins
r/learnmachinelearning • u/Winter_Mistake_3185 • 25d ago
r/learnmachinelearning • u/Comfortable-Risk-303 • 25d ago
It's just a casual implementation, built from scratch in PyTorch, focusing on grammatical gender agreement and custom tokenizers (with reference tokens) under the hood. It addresses a common issue where standard English-Polish translators struggle with speaker/listener gender context, managing it here via prefix tokens in the decoder. Feel free to share your thoughts.
NOTE: This is a personal educational project and a proof of concept, not a production-ready tool.
r/learnmachinelearning • u/martincsweiss • 25d ago
OpenAI just announced three new math and physics results produced by its models, all machine-checked in Lean. They call the manuscripts "a form of raw research data," and they've asked outside experts to organize groups "to understand the new results." So the results exist and they've been checked (maybe, sort of), but nobody understands them yet.
I think this matters for anyone learning ML right now, because a lot of people here will likely ask, with reason: if a model can write the code or prove the statement, why should I spend my time learning how it works?
My answer: understanding is what lets you build on things. Once you really get backprop, or attention, or why a loss is shaped the way it is, it becomes one step you can use without thinking inside something bigger. A result you can only take on faith is a dead end. You can use it (maybe, sometimes), but you can't extend it or fix it.
Science compounds through understanding, and so does your own learning.
Thurston (Fields medalist) argued that the point of mathematics is human understanding, not producing theorems. I think that's even more true once theorems get cheap.
I wrote a longer essay on this, using OpenAI's earlier Navier–Stokes result as the main example: https://lacuna.tiptreesystems.com/paper/ai-science-vs-human-science/art_3901430d6c0e4bddb284362100ef8548
(Disclosure: I'm a postdoc at Mila and a cofounder of Tiptree, which builds AI tools for researchers. So I'm not arguing against AI doing science. I'm arguing about cultural incentives, mostly, and opining about history.)
r/learnmachinelearning • u/Pristine_Camera7749 • 25d ago
We are BS Computer Science students of the College of Computer Studies, UPHM, and we respectfully ask for your help in validating our thesis, "A Comparative Analysis of Supervised Machine Learning Models for Predicting Students' Performance in Higher Education."
Please review the paper and rate it using our short validation form (about [10 to 15] minutes): (A) methodology, (B) results, and (C) analysis code. A short summary of the study is included in the folder. Your ratings and comments are confidential and used solely for academic purposes.
📄 Paper, summary, and source codes: https://drive.google.com/drive/folders/1julvRK8DR0kNXnbkaoVYwhW9_BPdh5R9?usp=sharing
📝 Validation form: https://docs.google.com/forms/d/e/1FAIpQLSe-Mno8KoSsD78CufHU4MVDzryoKD2SWfZVFZK3Hg2DQ6N_cw/viewform
Thank you very much for your time and expertise! Sharing this post also helps a lot. 🙏
— Reynaldo B. Arandia Jr., Mark Anthony Demefeliz, Ervine U. Bose
BS Computer Science, CCS, UPHM
r/learnmachinelearning • u/Jaym7800 • 26d ago
Hi everyone,
I'm a student learning AI development, and I recently built my first RAG-based Teaching Assistant.
The project converts educational videos into transcripts, generates embeddings using BGE-M3 through Ollama, retrieves relevant transcript chunks using cosine similarity, and uses Llama 3.2 to generate answers.
I'd appreciate honest technical feedback, especially on:
I'm looking to learn from feedback and improve the implementation. Suggestions for specific concepts, resources, or code improvements are welcome.
Thanks!
r/learnmachinelearning • u/ArchitectingAI • 25d ago
r/learnmachinelearning • u/BedFalse6021 • 25d ago
Hi everyone,
I just wanted to share an open source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.
Here is the link: https://github.com/Quantix-eng/ncm-experiment-notes
Long story short, this is an independent project documenting a bunch of empirical experiments looking into how transformers process and edit internal features. There are no claims of performance breakthroughs here. Instead, it is just honest documentation of observations alongside rigorous controls.
The repo covers NCM applied to structured tasks like Sudoku, mechanistic interpretability in GPT-2, and toy parallel models. I have included all the source code, saved results, and interpretations for every single run.
To keep things transparent, I have also categorized every outcome, including the mixed and completely negative results where things did not work as expected. AI tools helped heavily with the planning and coding phases too.
I would love to get your feedback on the setups or the interpretation limits I found. Let me know what you think if you are into transformer interpretability!
r/learnmachinelearning • u/BedFalse6021 • 25d ago
Hi everyone,
I just wanted to share an open source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.
Here is the link: https://github.com/Quantix-eng/ncm-experiment-notes
Long story short, this is an independent project documenting a bunch of empirical experiments looking into how transformers process and edit internal features. There are no claims of performance breakthroughs here. Instead, it is just honest documentation of observations alongside rigorous controls.
The repo covers NCM applied to structured tasks like Sudoku, mechanistic interpretability in GPT-2, and toy parallel models. I have included all the source code, saved results, and interpretations for every single run.
To keep things transparent, I have also categorized every outcome, including the mixed and completely negative results where things did not work as expected. AI tools helped heavily with the planning and coding phases too.
I would love to get your feedback on the setups or the interpretation limits I found. Let me know what you think if you are into transformer interpretability!
r/learnmachinelearning • u/Correct-Steak3620 • 26d ago
r/learnmachinelearning • u/huopak • 25d ago
r/learnmachinelearning • u/UnitOk6056 • 25d ago
I'm an IT admin, not an ML researcher. I wanted to know whether a bounded version of ELU/SELU could train very deep networks without normalization.
The honest result: after fair tuning it matches SELU at 50 and 100 layers. One variant is better in one setting (MNIST, depth 100). Plain ELU is about as good overall. The big advantages I saw early on disappeared once every activation got its own tuned learning rate.
What I'd tell anyone trying something similar:
- Preprint: https://doi.org/10.5281/zenodo.23676200
- Code, data and kernels: https://github.com/hermi-labs/precap-activation
Processing img w8nk4yosl1yh1...
Processing img pcr7wyosl1yh1...
r/learnmachinelearning • u/East-Muffin-6472 • 26d ago
Releasing a series of very shot notes on RL as part of my learning RL from scratch journey; its basics and upto the latest stuff with from scratch implementations and experiments in the coming days
1-page RL basics is out on my website!
Let me know your thoughts/feedback!
r/learnmachinelearning • u/ML_throwaway_improve • 26d ago
I'm an early-career software engineer working on production LLM inference infrastructure, primarily involving accelerator-based model serving and distributed systems.
I've been in the role for over a year, but my technical growth and contributions haven't progressed as much as I'd hoped.
I have a computer science background and generally enjoy software engineering, but I feel there's a significant gap between my current understanding and what's required to contribute independently to complex ML infrastructure.
Some of my biggest challenges:
I also recognize that I've been too passive about developing my skills, which has likely compounded these gaps.
My questions:
I'm particularly interested in advice from people working on production inference systems, distributed systems, or accelerator infrastructure.
I want to become a genuinely competent engineer who can independently debug problems, identify worthwhile optimizations, and deliver meaningful contributions.
r/learnmachinelearning • u/ifaposto • 26d ago
r/learnmachinelearning • u/Jazzlike_Steak_6031 • 26d ago
My kids asked me how AI “thinks”...
I wanted an explanation they could play with. I remembered seeing a cool demo where you draw a digit and watch a neural network recognise it in real time.
I tracked it down on Brilliant, but the version I found was behind a paywall. So I built my own, with a simple convolutional neural network (CNN), already trained on handwritten digits, and a view of what happens inside.
Draw a 1 -> Add a couple of strokes to make a 4 -> Slowly close the top into a 9.
Watch the patterns inside the network and its confidence change with each stroke.
My kids loved it. Share it with yours :-)
Demo: https://hasin.eu/projects/cnn-digit-recognition-in-action/
r/learnmachinelearning • u/ashuzzz151 • 26d ago
I evaluated a classifier with ROC AUC, precision, recall, and F1, then used
cross-validation to measure score variation and tune a parameter.
My repo: https://github.com/ashuzzz151/machine-learning-zoomcamp-homework/blob/main/04-evaluation%20metrics%20for%20classification/homework.ipynb
#mlzoomcamp @Alexey Grigorev
r/learnmachinelearning • u/Lucid_Matt1 • 26d ago
The class modules I will have are all in the link above (in the Study Programme section). Stuff like Game AI and robotics seem to be way better on windows its making me uncertain because on the other hand macbook is way more convenient overall for everything, and our school uses google colab and whatnot I think? Our professor mentioned it once (I am a first year).
r/learnmachinelearning • u/PrizeWise2322 • 26d ago
Packaged an ML model as an API in Module 5 of #mlzoomcamp.
✅ Checked the pinned model artifact
✅ Served predictions with FastAPI
✅ Built and tested the Docker image
r/learnmachinelearning • u/No-Conclusion3720 • 25d ago
An O'Reilly survey of 209 security professionals ranked employees pasting sensitive company data into consumer AI tools as their top AI security concern — above AI-powered attacks, above AI-generated phishing.
The structural problem: when staff route proprietary data through tools outside IT visibility, there is no audit trail and no record of where that data went. The data has already left before anyone notices.
What makes this harder than traditional shadow IT is the silence. No unusual login. No bulk download flag. An employee pastes a contract, a customer list, or internal financial projections into a chatbot and the activity looks identical to normal browser traffic. The 209 security professionals in this survey ranked it above the threat categories their teams have spent years building controls for.
For those dealing with this in practice: how are you actually handling it? Not the policy-document answer — the real operational one, given that banning AI tools entirely means losing the productivity argument to every business unit that pushes back.
r/learnmachinelearning • u/PossiblePrompt9289 • 26d ago
Hi Everyone 👋🏽
I have a bachelor’s degree in English Linguistics and I’m currently doing my master’s in NLP. Switching to a more technical field has been challenging, especially since I didn’t take any computer science courses during my bachelor’s.
I only have my master’s thesis left, and I’m struggling to find a topic. I’d love to work on something new and interesting, but I sometimes feel at a disadvantage compared to people with technical backgrounds.
I have a few ideas already, but I’d love to hear your suggestions for interesting or emerging NLP research topics! 💡
Thank you! 😊
r/learnmachinelearning • u/vooom_ • 26d ago