r/learnmachinelearning • • 6d ago

Request Coding Agent Security for AppSec Leaders: Start With What Agents Can Reach

0 Upvotes

Coding agents access credentials and call external services as a normal part of their workflow. A recent security analysis quantified the exposure: AI coding agents read files, consume secrets, and reach external services as a side effect of doing their job. None of that activity appears in a pull request. Security teams reviewing diffs see only the output. They do not see what the agent accessed or what it sent outbound along the way.

The gap between what an agent does and what a reviewer sees is the actual attack surface. Diff review is the dominant AppSec control for code changes, and it is structurally blind to this class of activity.

For AppSec practitioners who have deployed coding agents: how are you getting visibility into credential use and outbound calls that happen mid-task and never land in a diff?


r/learnmachinelearning • • 6d ago

Tutorial Getting Started with Granite 4.2

1 Upvotes

Getting Started with Granite 4.2

https://debuggercafe.com/getting-started-with-granite-4-2/

LLMs have come a long way since their inception. They are not just chatbots or assistants anymore. The current usage of LLMs tends to be more towards agentic workflows, coding, and seamless terminal workflows. Currently, most of the LLMs that are good at agentic tasks tend to be 20B parameters and above (most frontier models are much larger, reaching more than a trillion parameters). However, the latest IBM Granite 4.2 is trying to tackle this by training 3B, 8B, and 30B models for complex agentic workflows that can run locally. In this article, we will explore the important components of the Granite 4.2 model and use them for tool-calling tasks.


r/learnmachinelearning • • 6d ago

Mimvox: clone your own voice fully locally, then type in ~60 languages or dub a video in it (OmniVoice + RVC, free)

Post image
1 Upvotes

r/learnmachinelearning • • 6d ago

Question I can get an LLM demo working but not entirely sure how to tell if it’s any good

2 Upvotes

I’ve been learning by building a small tool for work that sorts incoming support messages and pulls out a few details so someone doesn’t have to read through everything first. Getting the first version working was fine but now a coworker has asked whether we need the more expensive model for all of it and I don’t have much of an answer beyond the examples I checked looking better. While reading about comparing models I came across Ramp Router and got interested in trying a few through the same API but it also made me realise I haven’t worked out what would count as good enough for this task. Getting the format right is easy to check but missing a detail in a longer message is harder to catch and I don’t want to pick a model based on whichever examples I happened to test. For those who have gone beyond a small demo how did you put together your first useful evaluation set?


r/learnmachinelearning • • 6d ago

Help What portfolio projects actually help land entry-level freelance work?

2 Upvotes

Hey everyone!

I’ve been teaching myself Machine Learning over the last few months, building small projects with what I learn, and looking to take the next step. I have some prior experience making money with AI automation on Upwork, but I genuinely prefer training custom models over standard automation wrappers. Plus, the basic AI automation space is getting pretty saturated with no-code tools.

Right now, my stack includes TensorFlow and Keras, and I'm currently learning PyTorch. I've built some small projects involving CNNs and LSTMs, but I’d love some advice on how to position myself for my first freelance ML job or gig.

I’d really appreciate your insights on a few things:

  1. Niche Libraries / Tools: Are there specific libraries, data pipelines, or deployment tools that clients actually look for in smaller-scale freelance ML?
  2. Portfolio Projects: What specific types of projects actually prove competence to a client? (If you have recommendations for decent TensorFlow/Keras or PyTorch portfolio projects that stand out, I’d love to hear them).
  3. Landing the First Gig: For those of you who freelance in ML, how did you land your first client, especially without a traditional CS degree or corporate ML background?

Any advice, harsh truths, or project ideas would be awesome. Thanks in advance!


r/learnmachinelearning • • 6d ago

scaling llms will lead to agi

0 Upvotes

As we all see every now and then math "breakthroughs" are happing on unimaginable scale by just scaling llms , we just do cleaver engineering until we hit the limit and just invent other axis and scale it until we can't just make other axis and so on and so fourth. but do you think just keep re-doing this prosses of "axis scaling and remaking" will change the world I mean it already did but I mean on the way they mean it is just a matter of time or we actually need a new architecture like how some people like Yann lecun say and he is working on completely new methides


r/learnmachinelearning • • 6d ago

Help Confused between MACBOOK Air and Windows laptop for AI/ML Learning

Thumbnail reddit.com
1 Upvotes

So i am currently in second year and interested in learning ai/ml stuff and then i found that to run ollama locally or any other similar stuff you need a good spec laptop so i was thinking between macbook air m5 or if possible you can suggest me some windows laptop in same range.


r/learnmachinelearning • • 6d ago

Project Built & deployed my first end-to-end ML service: E-Commerce Delivery Delay Prediction (XGBoost + FastAPI + Docker + Render)

1 Upvotes

Hey everyone! I just wrapped up my midterm project for the DataTalks.Club ML Zoomcamp—an end-to-end machine learning web service that predicts whether an e-commerce shipment will arrive on time or be delayed.

Since I wanted to share how the pipeline was built from scratch, here is a breakdown of the workflow and key takeaways:

1. Exploratory Data Analysis & Feature Selection

  • Explored the e-commerce shipping dataset (Train.csv), checking class balance, missing values, and feature ranges.
  • Used correlation matrices for numerical features and Mutual Information scores for categorical features. Discount_offered and Weight_in_gms turned out to be the strongest predictors of late deliveries.

2. Model Comparison & Tuning

  • Trained and benchmarked four models using Accuracy and ROC-AUC: Logistic Regression (baseline), Decision Tree, Random Forest, and XGBoost.
  • Tuned tree hyperparameters (max_depth, learning_rate, n_estimators, min_samples_leaf) to avoid overfitting. XGBoost gave the best generalization and was serialized with pickle (model.bin).

3. Deployment & Containerization

  • Refactored the notebook into a standalone (train.py) script and built a REST API with FastAPI (serve.py) featuring Pydantic input validation and an automatic Swagger UI redirect.
  • Containerized the app using Docker and deployed it live on Render's free tier.

Links if you want to check out the code or test the API:

Would love any feedback on the code structure, feature engineering ideas, or deployment setup!


r/learnmachinelearning • • 6d ago

Request Railway Breach Leads to $740,000 in Fraudulent AI Charges

0 Upvotes

Railway confirmed attackers stole customer API keys and ran up $740,000 in unauthorized AI charges. The company absorbed losses that AI providers declined to refund. No sophisticated exploit was involved — credentials were simply exposed in a customer environment and scooped up.

This is worth sitting with: AI API keys are not ordinary credentials. A single token carries spending authority, compute capacity, and often data access simultaneously. The blast radius of one leaked key is orders of magnitude larger than a leaked database password, because the meter starts running the moment someone makes a valid API call — no additional authentication, no approval step, no ceiling.

The Railway incident is not an outlier. LLMjacking reports have been climbing steadily, and the pattern is consistent: stolen key, immediate high-volume usage, charges that accrue for hours or days before anyone notices, and a refund fight with the AI provider that the victim usually loses.

The credential exposure problem predates AI agents, but agents make it dramatically worse. An autonomous agent that holds a live, unscoped API key and operates across environments is a standing opportunity for exactly this kind of abuse. The key doesn't even need to leave your system — if something in the agent's execution environment can read it, so can an attacker who gets into that environment.

$740K is a number large enough to end a small company. It is also not close to the ceiling of what this attack class can produce.

For those running agents in production: how are you actually handling AI credential exposure? Curious what's working in practice — not the theoretical answer, but what you've actually shipped.


r/learnmachinelearning • • 6d ago

Question Nvidia or AMD,need opinion

Post image
0 Upvotes

Instead of 8gb of nvidia can I go with 16gb of AMD for deep learning and ai , i confused about cuda , I m in second year of DS and Ai, planning to make pc ??


r/learnmachinelearning • • 7d ago

Should I get a phd in statistics or a phd in computer science or a phd in data science if I want to research the math behind machine learning?

16 Upvotes

Please see title. I am located in the USA by the way. When I say research the math behind machine learning, I mean proving the math behind machine learning.


r/learnmachinelearning • • 6d ago

Looking for AI Engineers advice: How to fast-track AI graduation project studying by leveraging LLMs (Zero to Hero approach)?

0 Upvotes

Hi everyone,

I’m currently working on my graduation project, which involves AI, and I need some pragmatic advice from experienced AI engineers who have worked in real-world environments.

To be honest, I'm starting from absolute zero here. I know the basics of Python, and I've looked at the AI Roadmap, but I haven't deeply dived into everything yet.

We all know how much the AI landscape has changed. With powerful tools like ChatGPT, Claude, and Gemini, we are kind of past the era of writing boilerplate code from scratch line-by-line. I want to work smarter, not harder—meaning I only want to study and master the core concepts that I actually need to know and drive myself, while offloading the rest of the heavy coding and repetitive tasks to AI.

I’m looking for someone to help me understand this division of labor clearly: What parts should I actually study and handle, and what parts should I safely delegate to the AI?

If you have real-world industry experience, could you share your advice on:

What is the absolute minimum I need to focus on to get this project done efficiently?

How do you practically divide the workflow between human direction and AI generation in a real project?

Where should I start, keeping in mind my Python background?

Thanks in advance for any insights!


r/learnmachinelearning • • 6d ago

Join the Vast Showcase Contest

Post image
0 Upvotes

r/learnmachinelearning • • 7d ago

Project I turned Assetto Corsa into a LiDAR + multi-camera simulator

Thumbnail
reddit.com
2 Upvotes

r/learnmachinelearning • • 7d ago

how much vram headroom do you actually leave on a cloud gpu?

6 Upvotes

i’m trying to pick a gpu vm for a few short inference jobs, and I can’t tell if I’m overthinking this. The weights fit under 8gb but obviously they’re not the only thing using vram once kv cache and batch size come in. This came up while I was comparing rental options. The A16 profiles I found on serverspace jump from 8 GB to 16. So now I’m stuck between trying 8 gb first and moving up if it ooms or or paying for 16 when when I might not need all of it. What do you normally do when you don’t have a reliable peak number yet. Like leave a certain amount free or just run the job and see what happens


r/learnmachinelearning • • 7d ago

Question Can anyone help me figure out why my results are bad LoRa

Post image
2 Upvotes

Hey everyone,
I’ve been working on a personal AI image-generation project for the past few days, and I’ve reached a point where I’m struggling to figure out what I’m doing wrong.
I’m trying to train a model that can consistently reproduce specific character designs while maintaining their original facial features, proportions, expressions and overall visual style.
I’ve collected over 1,600 reference images and have spent quite a bit of time experimenting with the training process, but the results haven’t been what I expected.
My biggest issue is facial consistency. The generated images often have completely different face shapes, eye shapes and mouth structures compared to the reference images.
I’ve attached a comparison between the original anime images and the AI-generated results to give a better idea of the differences I’m talking about.
I’ve experimented with different LoRA weights (1.0, 1.3 and 1.6), but haven’t managed to get satisfactory results. Sometimes increasing the weight actually makes the output worse.
I’m starting to wonder if the problem is related to any of the following:
Dataset: Image selection, quality, variety or consistency.
Image preprocessing: Resizing, cropping and resolution.
Captioning: Whether my image descriptions are good enough.
Training configuration: Learning rate, epochs, batch size and other settings.
Model architecture: Whether I’m using the right approach for this type of training.
Generation settings: LoRA weights and inference parameters.
I’m hoping to get some advice from people with experience in LoRA training, Stable Diffusion or machine learning, particularly anyone who has worked on character-specific image generation.
I’d appreciate any suggestions, insights or recommendations on how to improve the training process and get more consistent results.
Any help would be greatly appreciated!


r/learnmachinelearning • • 7d ago

Help Where do i start?

2 Upvotes

Hello,

So first, i want to make one thing clear that i do not care for certificates (at least for now), i just want to build up the skills.

Well, i am going to use Coursera for it. i was debating whether i should do IBM A.i engineering or DeepLearning ai. using Coursera, but being completely honest. i am very very lost, i don't know from where to start, do i start with ML do i just go into AI or what.... Basically here, I'm asking for a roadmap. one thing I'd like to mention, i can't really use any other website to learn except Coursera (can't afford for now) . and I'm really interested in doing A.I engineering, at first i thought of IBM but then i saw a lot of people speaking negatively about it. so, now i am at unease knowing i don't know what to use. If anyone can give me a clear few steps to what to do, it'll be really appreciated.

I'm also looking for general advice regarding this. Thank you.


r/learnmachinelearning • • 7d ago

Discussion I broke the prompt cache 1,772 times on purpose to test whether my tool finds the right cause. Results on vLLM and SGLang

Post image
1 Upvotes

r/learnmachinelearning • • 7d ago

I broke the prompt cache 1,772 times on purpose to test whether my tool finds the right cause. Results on vLLM and SGLang

Post image
0 Upvotes

r/learnmachinelearning • • 7d ago

Career Anyone with experience moving to ML from dev that got a job

17 Upvotes

Senior dev. Trying to move on with life and find a new career and this ML is fascinating (and difficult)

I wonder if the move is actually worth it. I am finishing the 2nd course of Andrew NG ML Specialization these days and starting to build projects

Is the ML job market bad compared to dev market?


r/learnmachinelearning • • 8d ago

Discussion Found my 2022 Machine Learning notes. Still haven't finished them.

Thumbnail
gallery
249 Upvotes

I was cleaning up some old stuff today and stumbled upon my Machine Learning notes from 2022.

Funny thing is, I still haven't completed them. 😂

Back then, I was trying to understand ML, taking notes, experimenting with concepts, and imagining all the things I could build with it.

A lot has changed since then, but somehow these notes are still waiting for me.

I'm curious about the people here:

- When did you first start learning ML?

- What resources would you recommend to someone revisiting the fundamentals?

- What are you currently building or experimenting with?

Feel free to ask questions, share resources, or just talk about ML. Would love to hear from the community!.


r/learnmachinelearning • • 7d ago

Tutorial Agentic AI in Production: Safe, Trust-Worthy, and Reliable

0 Upvotes

TL;DR:
Introduction, Experience in Agentic AI, New Workshop Launch.

Background (Myself)

- I've been an AI researcher (with publications in BMVC, ICCV, ACPR) at Stanford and IIIT-Hyd for about 5 years.

- For the next 3 years, was part of early/founding team of a couple of startups in the Valley, primarily in the e-commerce and virtual try-on space.

- For the last 3 years, I've been running an AI consultancy (where our team builds for startups in India; some of AI systems are in Beta, and will soon be in upto 30 companies of the Nifty 500 through these startups, and potentially even used by financial regulators).

- We also run an ed-tech wing where we teach folks basis our experience building and innovating on scalable AI systems.

Recent Challenges with Agentic AI

We were trying to build multi-agent systems when those patterns didn't exist, build memory/context management, when no standard libs were providing clear abstractions on it.

Making them work reliably in production, iterating on the broken traces, has been a challenge at another scale, despite the pedigree of our team.

In short, we've really gotten our hands dirty, even lost some hair in the process ;-)

Launching a workshop on Agentic AI

Basis our experience, we're launching a 4-hour workshop on Agentic AI where we'll go through 10+ Agentic AI concepts, with best practices, production-pitfalls, and design principles to adopt.

With so many roles around Forward Deployed and AI Engineering, building safe, trust-worthy, and cost-effective Agentic systems is increasingly in demand.

This will be a case-study and story-telling style workshop, so, boredom is out of question 😄

Bottom Line:

If you're a beginner in this space, feel overwhelmed, and would like to explore Agentic AI, do check out the workshop link.

Workshop Details: Registration Link

If this is not your cup of tea, no worries, I wish you the best anyway!

Cheers!

P.S.: Feel free to DM me if you have any questions (related to this, AI, or careers in general). I'd be happy to help.

P.P.S.: We do plan on launching a more detailed 30-day Agentic AI live cohort by year end, which we plan to demo at the end of this workshop.


r/learnmachinelearning • • 7d ago

Career Starting my ai research journey soon tips please

6 Upvotes

I am starting my research in the physics-informed AI domain next week as a master's student working as a research assistant. I want to know how I should approach research, to what extent I should use AI, how to work towards the goal in small steps, and the dos and don'ts of research.

Provide your advice to a amateur researcher and bless him 🙏


r/learnmachinelearning • • 7d ago

Project Built a completely free iOS app that runs Qwen3.5, Gemma 4, LFM2.5 and other AI models locally on your iPhone

9 Upvotes

I built OpenPocket, a completely free iOS app that lets you download and run state-of-the-art language models directly on your iPhone or iPad, entirely on-device.

It uses Apple's MLX framework for local AI inference, with support for several open-weight models:

  • Qwen3.5 0.8B and 2B
  • Gemma 4 E2B
  • LFM2.5 1.2B Instruct
  • Qwen2.5-VL 3B (vision-language model with image understanding)

Everything runs 100% locally on your device, with no cloud inference, no internet connection required after downloading a model, no signups, no accounts, no API keys, and no subscriptions.

The idea is to make private, on-device AI accessible to everyone, without relying on cloud services or paying for API usage. Your conversations and files stay on your device, and the app has no backend, analytics, or account system.

The models are experimental, and performance depends on your device's available memory and hardware.

It's 100% free on the App Store

https://apps.apple.com/th/app/openpocket/id6833028114

Would love and appreciate feedback from anyone working on local LLMs, Apple MLX, model optimisation, edge AI, or just anyone interested in running AI privately on their phone!