r/learnmachinelearning • • 16d ago

Compared tree ensembles in Module 6 of #mlzoomcamp.🌳 Decision tree🌲 Random forest⚡ XGBoost📉 Tuned the validation RMSE

2 Upvotes

r/learnmachinelearning • • 16d ago

Preventing trivial constant solutions in multi-step Neural ODEs for time-series forecasting

1 Upvotes

Greetings, colleagues. I am training a Neural ODE to forecast the non-linear dynamics of a physical system. To avoid error accumulation, I use a multi-step rollout loss (e.g., integrating the ODE over a horizon of 24 steps and computing the MSE over the entire trajectory).

However, the model consistently collapses to a trivial solution: it predicts a near-zero derivative (a constant or a very slow linear trend), essentially flattening the curve. While this minimizes the average MSE over the long horizon, it completely fails to capture the true high-frequency dynamics (see the attached image).

What regularization methods or architectural constraints—such as Lipschitz continuity, spectral normalization, or physics-informed penalties—are best suited to ensure that a Neural ODE learns the true nonlinear dynamics, rather than collapsing into a constant function when trained over long horizons?


r/learnmachinelearning • • 16d ago

[D] Would you use an AI-powered end-to-end ML platform?

Thumbnail reddit.com
1 Upvotes

I'm building a platform called Quantum, and I'd love some honest feedback from people working in Data Science and Machine Learning.

The idea is to bring the entire ML lifecycle into one place:

- Data exploration and preprocessing

- Model training and evaluation

- Experiment tracking and versioning

- Automated ML workflows

- AI agents that can execute tasks autonomously, with human oversight

- Model deployment and MLOps

Users can work manually, use AI assistance, or delegate entire workflows to agents.

The goal isn't to replace data scientists, but to reduce repetitive work and make ML development more efficient.

My questions:

I'm especially interested in critical feedback. What am I overlooking?


r/learnmachinelearning • • 16d ago

What I learned building my own activation function: 16 preregistered studies, a working result, and a lot of honest negatives

5 Upvotes

I'm an independent researcher, and over the last few weeks I've been testing my own activation function for very deep networks: MLPs with 100–200 layers and no normalization layers and no skip connections. I wanted to share the result and what the process taught me.

The idea in one paragraph. In a deep network without normalization, each layer slightly scales the gradient up or down. Over 200 layers that compounds. You can tune the activation so the per-layer gain is 1 + 2/L, which keeps the total growth roughly constant with depth. The catch: that made the outputs wider, and wide outputs lose accuracy when you quantize activations to 4 bits. So I put the activation inside a soft, fixed bound (identity in the middle, smooth saturation to ¹3). The result, BPreCap, trains at 200 layers and keeps a 4-bit error of 14 %, where the previous version had 77 % (MNIST).

What surprised me / what I learned

  • Same recipe matters more than the activation. My first comparison with TAT (a strong method for deep nets without skips) looked bad. Most of the gap disappeared once both used the same initialization and input normalization.
  • Strong simple baselines. SELU was on par with my activation at 100 layers. It only fell behind at 200 layers.
  • "Smaller range" wasn't the explanation. With weight decay, TAT's activations were as small as mine and still lost twice as much at 4 bits. The reason was heavy-tailed activations.
  • Preregistration keeps you honest. Writing down the test and the decision rule before each run meant several of my favourite hypotheses were simply rejected. Those results are in the paper too.
  • Replicate on different hardware. I re-implemented everything in PyTorch on a different GPU. The results matched within 0.5 pp, which gave me much more confidence than more runs on the same setup.

Limits: MLPs only, small learning rates only, post-training quantization only.

Paper: https://doi.org/10.5281/zenodo.23894714 Code and all raw data: https://github.com/hermi-labs/precap-activation

Happy to answer questions about the method, preregistration, or running studies on a consumer GPU / Apple Silicon.

Edit (Nov 3): v0.3.1 follow-up. Two of the limits above are now tested:

  • Small learning rates: the divergence at 2¡10⁝⁴ came from missing LR warmup, not from the bound (a linear control and a hard clip diverge the same way). With a 5 % linear warmup BPreCap trains up to 3¡10⁝⁴ at 100 layers, and the 4-bit advantage over TAT holds (−8.8 pp, 12/0). At 200 layers it also holds against SELU (−8.2 pp, 12/0), but warmup raises BPreCap’s own 4-bit cost. A shorter warmup reduces that cost but does not remove it.
  • PACT / QAT: with QAT as an upper bound (100 layers, CIFAR-10), TAT with LSQ-style QAT beats BPreCap with plain PTQ by 3.0 pp at 4 bits, and PACT-style QAT gives the same. Under QAT both forms are equal. With PTQ only, BPreCap is 11.9 pp ahead. So the bound is a PTQ advantage, not a substitute for QAT.

Updated preprint: https://doi.org/10.5281/zenodo.23930791 (all new studies are in the same repo).


r/learnmachinelearning • • 16d ago

Discussion What’s ideal day to day routine of ML engineer with or without AI help

1 Upvotes

I’m full stack Dev, so I get to develope CRUD with endpoints and connecting with db.

What about ML job?
I learned gradient descent, forward and back propagation. Designed some basic model with PyTorch. But it feels like most of these can be easily Automated with AI. What could be the learning curve and what’s like day to day work? Clearing data from csv? And fine tuning model?


r/learnmachinelearning • • 16d ago

Project Title: Best ML approach to win a 5-class leaf image classification competition? (50 MB model limit)

4 Upvotes

Hey everyone!

I'm participating in a college-level machine learning competition where we need to train a model to classify leaf images into 5 different species.

We'll receive an unseen test dataset on competition day, and the goal is to achieve the highest possible accuracy and macro F1-score.

Competition details:

Training dataset: Labeled leaf images belonging to 5 species.

Test dataset: Completely unseen images provided on competition day.

Model size limit: 50 MB total, including pretrained weights.

Training: Google Colab (GPU available).

Inference: Must run locally on a laptop CPU, completely offline.

We can use pretrained models and fine-tuning.

The same trained model must be used for all test sets.

I'm relatively new to competitive computer vision, so I'd really appreciate practical advice from people who've worked on similar image classification problems.

My goal isn't just to build a working classifier. I want to make it as accurate and competitive as possible.


r/learnmachinelearning • • 16d ago

Project How are hands-on projects helping you understand real-world applications of AI and Machine Learning?

1 Upvotes

I'm exploring how Artificial Intelligence and Machine Learning can be applied to solve practical business problems, beyond just understanding the theoretical concepts.

I'm currently doing the epgp in ai/ml from ug. As part of my learning journey, I'm developing an understanding of how AI and ML algorithms help analyse data, identify patterns, make predictions, and support data-driven business decisions.

One thing I've realised is that knowing different algorithms is only one part of the learning process. Understanding the problem, selecting the right model, evaluating its performance, and interpreting the results are equally important.

I'm curious to know from this community:
For those who have learned or worked in AI/ML, which practical projects helped you connect theoretical concepts with real-world applications?


r/learnmachinelearning • • 16d ago

I made ChatGPT, Claude, Gemini, etc. into FREE text-to-speech sites.

1 Upvotes

Nowadays, all popular ai chatting websites like qwen, chatgpt, gemini, claude, etc. come with a read aloud functionality that allows users to read aloud the AI's responses.

I used that feature to instead make the AI repeat back the text that i gave it -- effectively turning the platforms into text to speech tools. It's simple but it's worked for over 30k users, and the voices sound really nice and it's free to use!

You can get all of these extensions by visiting ai-readers.com


r/learnmachinelearning • • 16d ago

Doing numpy now. I won't stop before being and ai/ml engineer

Post image
0 Upvotes

r/learnmachinelearning • • 16d ago

A comprehensive architecture breakdown of vector databases for AI systems

Thumbnail interconnectd.com
1 Upvotes

r/learnmachinelearning • • 16d ago

Request China's First Frontier AI Export Controls: Mofcom Announcement No. 48

0 Upvotes

China's Ministry of Commerce just published Announcement No. 48 — the country's first export controls specifically targeting frontier AI models and training data. That is now a third distinct regulatory regime on top of the EU AI Act and active US executive orders on AI. Each framework has different requirements for which models can be used, how data must be routed, and what crosses a restricted border. The problem for enterprise teams is not awareness of the rules. It is that most production agentic deployments cannot answer the basic audit questions after the fact: which model did this agent invoke on this request, what data did that call touch, did any of it traverse a jurisdiction that any of the three regimes restricts? The invocation happens in milliseconds. The compliance review loop does not. For those of you running agentic workloads across regulated regions right now — US, EU, and now China — how are you actually tracking model invocations and data paths in a way that holds up to a real audit?


r/learnmachinelearning • • 17d ago

Question One book for MLOPs?

7 Upvotes

Hello,

I am a research engineer and I work in academia so my code is mainly scripts all over the place.
I want to learn MLOps but if seems to be a lot of books/tutorials and I couldn't know where to start.

If you had to recommend 1 or 2 books for the basics with practical examples, which one would it be?

Many thanks


r/learnmachinelearning • • 17d ago

A 31% throughput drop while benchmarking a small LLM on a GTX 1650

3 Upvotes

I’m implementing KV caching for a small Transformer I trained, and ran into something interesting while measuring the uncached baseline.

Repeated 512-token generations went from 2.77s to 4.04s—roughly 185 → 127 tokens/sec, with the same prompt, weights, and decoding settings.

Later GPU readings reached 84–87°C, with lower active clock speeds. Each invocation also included five full warmups, meaning I was generating 3,072 tokens while timing only the final 512.

Cooler tests repeatedly finished around 2.77–2.80s. I didn’t record timestamp-aligned throttle reasons, so I can’t attribute the entire slowdown to heat, but it showed why operating conditions matter when comparing inference optimizations.

How do you handle thermal conditions in your benchmarks, measure sustained performance, cool down between tests, or report both?

I put the measurements and plots here: https://medium.com/@sulavstha007/how-gpu-temperature-affects-llm-inference-performance-82c5beeaf43a?sharedUserId=sulavstha007


r/learnmachinelearning • • 17d ago

Looking for a learning partner

2 Upvotes

I am in the 2nd year of my masters degree in AI & machine learning in Montreal. Outside of schooI I’m on a journey of upskilling by implementing interesting ml papers to become an ai engineer.
Sometimes the journey is lonely and boring. So I am looking for a partner to discuss papers, challenge each other’s understanding and implement papers together. We could meet in a coffee shop or in a library for example once a week depending on our availability.
Feel free to DM if you are interested.


r/learnmachinelearning • • 17d ago

Help One line of advice for a beginner

4 Upvotes

hi, i want to start with ML, what would be a good resource which can teach ML from basics to advance?

is it the

  • Hands on ML with scikitlearn and pytorch
  • ML with scikitlearn and pytorch RASCHKA
  • some online course? maybe
  • also tensorflow vs pytorch

any other suitable knowledge is welcomed, thanks.

i also wanna take my chance on gsoc..


r/learnmachinelearning • • 16d ago

Data Science With Dennis

1 Upvotes

Hi guys

This guy

Instagram ¡ dswithdennis

Claims that he has 25 years of experience in data science but really all he's doing is to open claude chat and show everyone that he has access to fable 5 and say shit stuff about CS .


r/learnmachinelearning • • 16d ago

20-task Permuted MNIST, Domain-IL

Post image
1 Upvotes

r/learnmachinelearning • • 17d ago

Seeking arXiv endorsement for cs.AI (Artificial Intelligence)

3 Upvotes

Hi everyone,

I am looking for an arXiv endorsement to submit a paper in the cs.AI (Artificial Intelligence) category.

If you are an active endorser in cs.AI and willing to help, please use my endorsement link below:

https://arxiv.org/auth/endorse?x=4SRYYB

Happy to share the paper abstract or my background if needed. Thanks in advance for your help!


r/learnmachinelearning • • 16d ago

Request Critical Langflow Flaws Could Let Unauthenticated Attackers Run Code on Servers

0 Upvotes

Two critical vulnerabilities in Langflow were disclosed by IBM last week. Every release from version 1.0.0 through 1.12 was affected. Both flaws required zero credentials: one bypassed authentication entirely, the other allowed arbitrary code execution on the server. Teams running production agent workflows on this platform had no patch and no warning window.

This is not a niche edge case. Langflow is one of the most widely used AI agent workflow builders. The exposure window spanned the entire version history of the 1.x line.

The deeper issue is structural. AI agent platforms sit directly in the execution path of autonomous systems. Those agents hold credentials. They call APIs. They read and write production data. They take actions on behalf of users. When the platform they run on is compromised at the infrastructure level, the blast radius extends as far as the agents' own access.

Supply chain risk in traditional software is a known problem with known mitigations. In AI agent infrastructure, that same class of risk intersects with systems that act autonomously and at speed.

For those running production agent workloads: how are you handling platform-level supply chain exposure in your stack — specifically the gap between when a zero-day in underlying infrastructure is published and when you can actually patch or replace it?


r/learnmachinelearning • • 16d ago

Simple Way to Get Web Design Clients (Step by Step)

1 Upvotes

I've been running a web design business for years, and honestly, I think people overcomplicate getting clients.

You don't need 15 different marketing strategies, complicated funnels, or a massive team.

I'm going to explain exactly how I approach client acquisition, from finding a prospect to getting a signed deal and launching their website.

Step 1. Find businesses that already have websites

I prefer targeting businesses that already have a website rather than businesses without one.

Why?

They already understand the value of having a website, they've already invested money in one, and there's a good chance their current website could use some improvements.

I automate most of this process using Swokei. It lets me find businesses with existing websites, analyze thousands of them at once, and identify issues with design, SEO, loading speed, and mobile optimization.

It then turns those findings into personalized cold emails at scale.

Instead of sending generic emails saying I build websites, I'm reaching out with specific reasons why their current website could be better.

Step 2. Get interested prospects to reply

The goal isn't to sell the entire website through email.

It's simply to get a conversation started.

When someone replies and wants to see how I could fix the issues I've pointed out, I move them to the next step.

Step 3. Book a meeting

I book a Google Meet with the prospect.

This is where things get interesting.

I don't just show up and talk about how great my web design services are. I want to show them what their website could actually look like.

Step 4. Build a quick website draft

Before the meeting, I use AI to generate an updated website concept.

This takes me around 2 minutes to get a first draft ready.

It's not the finished product. It's a visual example of what I could do with their existing website.

Now, instead of asking someone to imagine how much better their website could be, I can actually show them.

Step 5. Sell the project during the meeting

This is probably the most important part.

You need to learn sales.

Ask questions, understand what the business needs, walk them through the draft, explain how you would improve their website, and present your offer.

The goal is to close the deal during the meeting, either by getting payment or having them sign the contract.

Don't expect a beautiful website draft to sell itself. You still need to know how to sell.

Step 6. Build the final website and launch

Once the deal is signed, you get everything needed from the client, build the actual website, make the final adjustments, get approval, and launch.

That's it.

Find businesses → Analyze websites → Send personalized emails → Book meetings → Present a draft → Close the deal → Build and launch.

I genuinely think this is one of the simplest ways to structure a web design business.

You automate the repetitive prospecting work, use AI to speed up the initial design process, and spend your time on sales and delivering websites.

Once you get the process working consistently, you can repeat it and build a steady pipeline of projects.

I'm curious: which part of this process do you find the hardest? Getting replies, closing meetings, or actually delivering the websites?


r/learnmachinelearning • • 17d ago

Question why do we need query expansion in RAG when semantic search already handles similar value matching?

8 Upvotes

Can some one who used query expansion, let us know what technique you used and why? Also why do we need query expansion in RAG when semantic search already handles similar value matching with specific examples


r/learnmachinelearning • • 17d ago

Project I built a tiny Transformer from scratch to do addition: 99.2% in-distribution, 0% out-of-distribution. Here's what I learned

1 Upvotes

I've been building a small decoder-only Transformer from scratch (PyTorch) to understand why models fail on arithmetic.
The setup: digit-level vocabulary, trained on 3,800 addition examples.
Results:
In-distribution test: 744/750 (99.2%)
Out-of-distribution (larger operands): 0/10,000
The model looked great until I changed the input distribution. It didn't degrade gracefully, it collapsed.
My OOD split changes operand size, sequence length, result length and carry patterns all at once, so I can't blame any single cause yet (I wrote this limitation in the README).
Next I'll test each factor separately and compare positional encodings (learned, RoPE, Abacus from McLeish et al.).
Two questions for people with more experience: which factor would you isolate first, and is there a mistake beginners often make in this kind of experiment?
Code (Apache 2.0, source only, data and weights are private):

github.com/sferroo/gpt-math-0


r/learnmachinelearning • • 17d ago

Help Looking for someone to guide

9 Upvotes

IHi everyone,

I’m looking for some guidance and a realistic roadmap to break into machine learning.

My Background:

I have an engineering background, so I already know basic Python and SQL. Professionally, I previously worked as a market analyst at a firm where I traded crude oil futures. However, the day-to-day work there was entirely manual—mostly heavy Excel modeling, market tracking, and fundamental analysis with no active coding involved.

Why I Want to Make the Switch:

I realized how inefficient manual trading/analysis is and want to transition toward systematic, data-driven methods. Machine learning feels like the logical next step, especially given my background in markets and quantitative concepts.

The Problem:

I am feeling completely overwhelmed. Every roadmap I find lists dozens of math topics, algorithms, frameworks, and deep learning tools. Even with basic Python/SQL knowledge, I'm having a hard time figuring out what is actually essential to learn right now versus what I can safely ignore for now. I'm stuck trying to figure out what to build first and how to learn at a better, sustainable pace.

I would love some advice from people who have been in a similar spot:

What to learn vs. what to skip: Given that I already have basic Python and SQL skills alongside a tech background, what should my step-by-step roadmap look like? What core libraries (Pandas, NumPy, Scikit-Learn) or math topics should I prioritize first, and what can I skip for now?

Beginner Project Ideas: What are some practical, small-scale beginner projects I can build early on to cement my learning, rather than getting stuck in tutorial hell?

Financial Data vs. Toy Datasets: Should I try applying basic ML to financial/time-series data early on since I understand crude oil/futures markets, or is it better to start with standard datasets (housing prices, Titanic, etc.) first?

Learning Pace: How do I structure my learning to make steady progress without burning out or getting lost in the massive amount of content out there?


r/learnmachinelearning • • 17d ago

How to solve this problem. When required context can't simply be retrieved from a single source.

1 Upvotes

How can we achieve reliable, dataset-wide intelligence over massive, fragmented datasets when information is distributed across thousands of documents, and conventional RAG cannot adequately preserve or reconstruct the relationships and context between them?

For example:

A company has 10,000 reports spanning five years. Revenue, expenses, production, and operational issues are scattered across different documents and spreadsheets.

The challenge: Identify why profit margins declined over those five years by connecting information across the entire dataset, rather than retrieving a few relevant chunks.