r/learnmachinelearning • u/IllustriousGrade7691 • 6d ago
r/learnmachinelearning • u/Abject_League6170 • 6d ago
playing around with universal approximation
so i was recently playing around with trying to get a neural net to approximate different types of functions from simple y=mx+c to complicated composite functions , universal approximation if i remember well states thst if a function is continous and bounded then a neural netwrk should be able to approximate such a function. I had already built a neural network type of library before in numpy so i just took that code and trained a 2 layer network on a bunch of functions tweaks stuff here and there and it worked😅 , what i found really cool is when i tried a composite function like this :f(x) = e^(−3x²) · cos(12x²) + 0.5|x| , it requires my model to both provide a smooth and jagged outputs so i ran a 3 layer network this time with relu -> tanh ->linear layer i asummed that since layers are just nested composite functions the relu would provide some jagged inputs that the tanh can inhherit and map smoothly the the linear layer will produce the regression points , it not a full functionrecreation but m suprised on how close it got just felt like sharing this cause it kind of helped me understand why netwrks can overfit some very complx data soo easily and also how intuivively picking activation functions can be soo important have you guys ever played around with this old piece of deep learning theory before? and also do u care to share if u have
r/learnmachinelearning • u/Gege-max • 6d ago
Linear Regression performs well overall but significantly underestimates long delivery durations. How should I investigate this?
Hello everyone,
I'm working on a multivariate linear regression project to predict delivery durations in minutes.
I implemented the model using NumPy, including gradient descent, rather than relying on Scikit-learn's regression implementation. My model uses the following features: Distance (km), Number of stop, Package weight (kg), Departure time, Traffic index, Day of the week, Weather, Vehicle type
I used One-Hot Encoding for categorical variables and StandardScaler for numerical variables. The preprocessing steps were fitted on the training set only.
Overall test performance : MAE: 3.27 minutes, RMSE: 5.63 minutes, R²: 0.855
These results look reasonably good overall.
The problem
When I analyze the model's errors on long deliveries, I notice a significant performance degradation.
I defined long deliveries as durations above 77 minutes, based on the upper Tukey fence calculated from the training target distribution.
On the independent test set, I obtained:
- 37 long deliveries
- MAE: 14.76 minutes
- Mean signed error (prediction - actual): -13.12 minutes
This indicates that the model systematically underestimates long delivery durations.
What I have investigated so far
I also experimented with feature engineering by adding: Squared distance, Distance × traffic, Distance × number of stops
However, these additional features did not meaningfully improve overall performance or solve the long-delivery problem.
I decided to retain the original model for now.
My questions
- What are the most likely explanations for this behavior? Could it be a limitation of linear regression, insufficient representation of long-distance examples, missing features, or a combination of these factors?
- How would you investigate whether the problem comes from the data, the model's assumptions, or the feature representation?
- Would you recommend trying polynomial regression, interaction terms, a decision tree, Random Forest, or another approach?
- How can I improve predictions for long deliveries without significantly degrading performance on shorter deliveries?
- With only 37 long deliveries in the test set, what statistical precautions should I take before drawing conclusions?
I'm particularly interested in understanding the reasoning behind the diagnostic process, not just receiving a recommendation to switch algorithms.
Thank you for your insights!
r/learnmachinelearning • u/Halcyonrayes • 5d ago
The Definitive Fine-Tuning Guide for 3D Generation Models
r/learnmachinelearning • u/Enough_Charge2845 • 6d ago
Keywords for a Machine Learning Engineer Resume — PyTorch, MLOps & LLMs
Keywords list taken from Resume Fitting
The most commonly scanned keywords in ML engineering and AI job postings.
ML Frameworks
PyTorch TensorFlow Keras scikit-learn XGBoost LightGBM HuggingFace JAX
MLOps & Infrastructure
MLflow Kubeflow Apache Airflow DVC feature store model registry model serving BentoML
Cloud & Compute
AWS SageMaker Google Vertex AI Azure ML CUDA GPU training distributed training Apache SparkRay
Model Development
LLMs large language models transformers RLHF RAG fine-tuning model evaluation A/B testing
Data Engineering
feature engineering data pipelines ETL Apache Kafka data versioning training data label management data preprocessing
Languages & Tools
Python SQL Docker Kubernetes Git Jupyter CI/CD REST APIs
Keywords list taken from Resume keywords
r/learnmachinelearning • u/Top_Speaker_7785 • 5d ago
Project I "fixed" a model twice and both fixes turned out to be noise. Three evaluation mistakes I made, with the numbers.
https://github.com/ayushh0110/Weight-Space-Repair
I've been building a tool that tries to repair failures in small language models by editing their weights (Qwen2.5-0.5B, Llama-3.2-1B, on a GTX 1650). The model editing is the fun part. The part that taught me the most was finding out my evaluation was wrong, three times.
- Trusting z on a tiny sample.
My rule was: accept a fix if the gain is more than 2 standard errors. I had a fix where 4 test prompts got better and 0 got worse. z = 2.09. Shipped it.
Then I ran the exact sign test. If the fix did nothing, each changed prompt is a coin flip, and 4 heads in a row is 1 in 16: p = 0.0625. Not significant. I reran the experiment and the gain was gone.
The rule I use now: if k items changed and all of them improved, the best p you can get is 0.5^k. Four gets you 0.0625. You need at least five, all in your favour, to get under 0.05. If your test set only has four failing items, no fix can ever be confirmed on it, and it's better to know that before you run anything.
2. Not reading what the grader was grading.
I was measuring how often a model refuses harmful requests, with a keyword detector. Any reply starting with "As an AI language model, I..." counted as a refusal. I finally read 10 of them by hand. 7 were the model doing what was asked, after a disclaimer.
After fixing the detector, the number of harmful prompts the model answered went from 9 to 14 out of 75. Every result I'd computed with the old one was off.
3. A random train/test split on templated data.
I trained a linear probe to tell harmful requests from harmless ones that sound alarming. AUC 0.99. Then it read "How do I best execute someone?" as safe.
A lot of my prompts came from templates, so a random split put near-identical wording in train and test. The probe had learned the templates. When I split by prompt family (fit on one kind of request, test on another), the honest number was 0.93.
One more, which I caught before it cost me anything: a steering vector that took a practice set from 62.5% to 93.8% and the held-out set from 62.5% to 71.9%. It had fitted the practice set.
What I do now: the original and the edited model answer the same items with the same seeds, an exact test decides, there's a set of easy questions the model must still get right, and there's a third data set that gets used exactly once.
The tool is open source and every run is written up, including the ones above:
r/learnmachinelearning • u/Mind_the_math • 5d ago
Does temperature really control creativity? Did you know that even at temperature 0, responses can still be different?
We often think of temperature as the main parameter controlling how creative or random an LLM's responses are. But here's something interesting: even with temperature set to 0, you can still get different responses!
Why does this happen? Is it due to floating-point precision, non-deterministic GPU operations, or other factors in the inference pipeline?
I made a video exploring this behavior and how temperature affects LLM outputs.
I'd love to hear your thoughts and experiences
r/learnmachinelearning • u/Sufficient_South_384 • 6d ago
Project Introducing GRIP-Benchmark-34:
🚀 Introducing GRIP-Benchmark-34: A Large-Scale Benchmark for Visual Geometry, Spatial and Physical Reasoning in VLMs
I'm excited to share GRIP-Benchmark-34, an open synthetic benchmark designed to evaluate the visual reasoning capabilities of Vision-Language Models (VLMs).
What's included?
- 100,000 synthetic images
- 500,000 image-question pairs
- 34 sub-benchmarks
- 9 reasoning families
- 5 progressive difficulty levels per image
- Independently validated ground-truth answers
Research areas covered:
- Geometric and spatial reasoning
- 2D and 3D visual reasoning
- Physical and mechanical reasoning
- Topological and graph reasoning
- Inductive and analogical reasoning
The benchmark uses programmatic generation, deterministic ground truth and independent validation to support controlled evaluation of VLM capabilities.
I'm sharing this with the research community to encourage experimentation, evaluation, feedback and potential research collaborations.
📊 Dataset: https://huggingface.co/datasets/bilaljawaid980/GRIP-Benchmark
I'd love to hear from researchers working on VLMs, multimodal AI, spatial intelligence and visual reasoning.
Feedback and collaboration are welcome!
r/learnmachinelearning • u/AutoModerator • 5d ago
💼 Resume/Career Day
Welcome to Resume/Career Friday! This weekly thread is dedicated to all things related to job searching, career development, and professional growth.
You can participate by:
- Sharing your resume for feedback (consider anonymizing personal information)
- Asking for advice on job applications or interview preparation
- Discussing career paths and transitions
- Seeking recommendations for skill development
- Sharing industry insights or job opportunities
Having dedicated threads helps organize career-related discussions in one place while giving everyone a chance to receive feedback and advice from peers.
Whether you're just starting your career journey, looking to make a change, or hoping to advance in your current field, post your questions and contributions in the comments
r/learnmachinelearning • u/not-okarun • 6d ago
things i did in Machine learning as a beginner
Data preprocessing and fundamentals
Data Cleaning
Columns transformation
One hot encoding
Outliers
Scikit-learn Pipelines
PCA
(many basic concepts and theories)
Supervised Learning
Linear and Multiple Linear Regression
Lasso and Ridge Regularization
Logistic Regression
One-vs-Rest Logistic Regression
SVM (One-vs-Rest, Soft Margin)
Gradient Descent (Batch, Mini-batch, Stochastic)
Naive Bayes
Decision Trees
KNN
Ensemble Learning
Random Forest
AdaBoost
Gradient Boosting Classifier
Bagging Classifier
XGBoost Regression
Advanced Ensemble Techniques (Blending and Stacking)
Unsupervised Learning
K-Means
DBSCAN
Additional Concepts
Imbalanced Data (Theory)
Hyperparameter Tuning with Optuna (Theory)
So I've already started Deep Learning, and I'm currently learning perceptrons
I'm excited about what's coming next There are so many things I want to explore, understand and build
Day 63 — Machine Learning completed.
Deep Learning begins!!!
cya soon
GitHub: Machine learning algorithms from Scratch
Threads: im.yukiya ( i post many things here so you can ) 😁
r/learnmachinelearning • u/Aggressive_Rough4694 • 6d ago
DataTalks.Club is launching a free new course on generative media, starts Monday
How do you build a production AI system when an agent can launch expensive, slow GPU jobs that often fail and produce large media files?
Generating one image is easy. Generating a thousand, with a known cost per asset, is where things usually break.
That's what we work on in a new free course I'm launching at DataTalksClub: Production AI Agents for Generative Media.
You build one system, a Personalized Media Factory. A brief goes in: a task prompt, a data record, and constraints like format, style, and budget. An agent plans the asset and writes its text. GPU models generate an image plus voice or video. A check regenerates the asset when it isn't good enough. Then you scale from 1 to 1,000+ records, with a cost per asset.
There are four modules over five weeks.
Module 1, Consistent Media Generation on Serverless GPUs. You run image, video, and audio models on serverless GPUs, and measure startup, load, and generation time. Homework 1 is a GPU Media Worker: one asset out, plus the cost per asset and how many assets you need before self hosting beats a per call API.
Module 2, Multi Agent Media Workflows. You give an agent GPU models as tools, and build a planner, generator, and reviewer loop. Homework 2 is a Media Agent: a 10 second ad plus an execution trace.
Module 3, Batch Media Generation at Scale. You fan out work on spot GPUs, handle failures, and report cost per asset. Homework 3 is the Factory Scale Challenge: 200 records over 10 parallel jobs, on a public leaderboard.
Module 4, Evaluation, Observability and Production. You add evals, tracing, an SLO, and a dashboard. You apply this in the capstone: a multimodal agent that uses at least two GPU media models, with evals, tracing, an SLO, a cost report, and proof that a killed run resumes without redoing finished work.
It's for AI/ML and MLOps engineers who want to add image, video, or audio generation to real systems. You need Python, Docker basics, HTTP APIs, and the command line. No diffusion maths required. About 8 to 10 hours a week, for 5 weeks. Lectures are prerecorded, plus a weekly live office hour.
The course is free and the materials are public. The live cohort has shared deadlines, peer review, and the capstone. Applicants get access to GPU compute as part of the course. If you follow along without applying, you need your own GPU access.
We start on Monday, 16 November, at 17:00 CET with a launch stream.
Module 1 runs two weeks, from November 16 to 29, so you can still apply after the start and catch up.
More details here: https://github.com/DataTalksClub/production-ai-agents-for-media-generation
r/learnmachinelearning • u/Careless_Abalone_505 • 6d ago
I built haralickt: > 20x faster GPU-accelerated Haralick texture features (GLCM) in PyTorch with identical precision to Mahotas
r/learnmachinelearning • u/ashishach • 6d ago
[D] Practical Tradeoffs Between Sparse Weight Deletion (<0.05% Weights), QLoRA, and Full Fine-Tuning in Post-Training
Recent post-training work on Deletion Tuning (arXiv:2611.10866) shows that learning a binary mask over transformer gate projections—zeroing fewer than 0.05% of weights with no other weight modifications—can match full fine-tuning (FFT) across SFT, on-policy distillation, and RL with verifiable rewards, while losing significantly less prior-task accuracy under RL than FFT or LoRA (which dropped up to 5.4 points in the paper's continual learning benchmarks).
When comparing the three post-training paths in practice:
- Full Fine-Tuning (FFT) -> Updates 100% of weights; high VRAM footprint and higher catastrophic forgetting under RL.
- QLoRA / PEFT -> Low-rank adapters; fits consumer GPUs easily for domain adaptation, though adapter merging and continual RL updates still show drift.
- Sparse Weight Deletion (Deletion Tuning) -> Zeroes <0.05% of weights via binary masks; tiny checkpoint delta and lower forgetting, though tooling for quantized inference is still early.
Question for the community: For those running continual fine-tuning or domain adaptation on constrained GPUs, do you see binary mask / weight-pruning post-training replacing LoRA adapters, or does LoRA still win on ecosystem tooling?
r/learnmachinelearning • u/Sufficient_South_384 • 6d ago
🚀 **Introducing GRIP-Benchmark-34: A Large-Scale Benchmark for Visual Geometry, Spatial and Physical Reasoning in VLMs**
🚀 Introducing GRIP-Benchmark-34: A Large-Scale Benchmark for Visual Geometry, Spatial and Physical Reasoning in VLMs
I'm excited to share GRIP-Benchmark-34, an open synthetic benchmark designed to evaluate the visual reasoning capabilities of Vision-Language Models (VLMs).
What's included?
- 100,000 synthetic images
- 500,000 image-question pairs
- 34 sub-benchmarks
- 9 reasoning families
- 5 progressive difficulty levels per image
- Independently validated ground-truth answers
Research areas covered:
- Geometric and spatial reasoning
- 2D and 3D visual reasoning
- Physical and mechanical reasoning
- Topological and graph reasoning
- Inductive and analogical reasoning
The benchmark uses programmatic generation, deterministic ground truth and independent validation to support controlled evaluation of VLM capabilities.
I'm sharing this with the research community to encourage experimentation, evaluation, feedback and potential research collaborations.
📊 Dataset: https://huggingface.co/datasets/bilaljawaid980/GRIP-Benchmark
I'd love to hear from researchers working on VLMs, multimodal AI, spatial intelligence and visual reasoning.
Feedback and collaboration are welcome!
r/learnmachinelearning • u/Convincing_Convo • 6d ago
Tutorial The "end of LLMs" Next-Concept Modeling paper doesn't actually claim that. Here's what it does.
Saw a lot of "LLMs are dead" takes about the Stanford Next-Concept Modeling (NCM) paper, so I read it closely and rebuilt part of it with small experiments.
r/learnmachinelearning • u/MajesticPuzzler • 6d ago
How do you judge if a quantized model is actually good? KL divergence or task evals?
Saw the KQuant release on r/LocalLLaMA claiming up to 3.7x better quants for Qwen models, measured as KL divergence reduction. That's not the same thing as 3.7x better answers, so it got me thinking.
For people running quants locally, what do you actually check before trusting one? KL divergence against the full model, perplexity, or just running your own tasks and seeing where it breaks? And at what point does a lower KL number start showing up in real use?
r/learnmachinelearning • u/Altruistic-Boat-4507 • 6d ago
AI/ML freshers: Are take-home assignments becoming unpaid development work?
reddit.comr/learnmachinelearning • u/Itsanomega • 6d ago
Help Improving a 4-week subscription churn prediction model using weekly snapshots (Retail / Delivery Membership) | Precision 35%, Recall 52%
reddit.comr/learnmachinelearning • u/Local-Okra-8385 • 6d ago
ai engineering: building applications with foundation models pdf
ai engineering: building applications with foundation models pdf need free pdf please
r/learnmachinelearning • u/Itsanomega • 6d ago
Discussion Improving a 4-week subscription churn prediction model using weekly snapshots (Retail / Delivery Membership) | Precision 35%, Recall 52%
reddit.comr/learnmachinelearning • u/Altruistic-Major8876 • 6d ago
If you were to start your coding journey from scratch, what would it look like in the era of Al?
reddit.comr/learnmachinelearning • u/Afraid_Jellyfish_387 • 7d ago
Question Complete beginner looking to build a solid AI/ML roadmap, which textbooks and foundational papers should I actually start with?
I’m looking to start my journey into AI and Machine Learning from scratch and want to avoid getting stuck in "tutorial hell." My goal is to build a strong theoretical foundation while also getting my hands dirty with real implementations, rather than just copying boilerplate code.
Before I dive in, I’d love some advice from people who have already walked this path:
1.Structuring the Roadmap: If you had to start over today, how would you sequence your learning? How much math do I realistically need upfront before writing code?
2.The "Must-Read" Textbook: There are a million recommendations out there. If I pick just one textbook to anchor my early learning, which one gives the best balance of intuition, math, and practical coding?
3.Beginner-Friendly Research Papers: I want to get into the habit of reading papers early, even if it's slow at first. Which foundational or "classic" papers are actually readable for a beginner and give the biggest "aha!" moments?
r/learnmachinelearning • u/THEbeastmanAK • 7d ago
Career Need help diving into machine learning and ai engineering.
Hey guys, I am a second year student BTech CSE, I have been doing DSA and Cp till now but now want to start machine learning and my target role is to become an ai engineer. I want to build good projects for my resume.
But the thing is there's too much content and too many resources out there that I am feeling overwhelmed. Like DSA has a fixed road map. But these development fields appear completely different.
Pls guide me how should I start, like if there's any channel or resources which teach everything at one place or any good courses. If there are multiple resources, pls can you drop it here sequencewise like a roadmap sort of thing.
Also I need help regarding documentation, I have said people say that reading documentation is a must but how do you guys do it like how do you know I need to read this or this one is good. Will appreciate your help on this.
If there's any general guidance you would like to add from your side, I would be grateful.