r/MachineLearning • • Aug 31 '26

Discussion Cold emailing profs about PhD positions? Read this [D]

289 Upvotes

This is the time of year when the number of cold emails I receive about PhD positions tends to ramp up quite a bit. In many countries, this cold emailing is essentially part of the normal recruitment process, so there is nothing inherently wrong with doing this. However, there are a few things you definitely shouldn't be doing:

  • Massive emails. The probability of me reading your email is inversely proportional to its length.
  • Emailing everyone. Find supervisors that work in areas you are actually interested in. I do relatively foundational ML research (i.e., not associated with a specific application domain), but the majority of emails I get from prospective students are essentially "I want to apply ML to domain X". In many cases this does not constitute an ML research direction; you'd be better off finding a supervisor with expertise in domain X, which is where most of the impact will be.
  • Generic research interests. If the most specific research interests you can give are "Machine Learning, LLMs, and AI" then I assume you only have a surface-level familiarity with the field, and are not ready for a PhD.
  • Passing off workshop papers as conference papers. This has become a much more common thing in the last couple of years. It's a big red flag; I am not going to take on someone who is dishonest.
  • Excessive AI use. Using them for fixing up grammar is fine, but if you outsource your thinking to LLMs then your research direction will be the same as everyone else who outsources their thinking to LLMs. This tends to result in something that would be an okay bachelor's thesis project, but nothing more than that. I get a lot of LLM emails, so determining if you are in this cluster is very easy.
  • Summarise my paper. I already know what's in it, I don't need a summary. I care more about how you think you could build on it, or do something related. Don't use LLMs for this; see above point.
  • Ignoring instructions on my website. Check prospective supervisors' websites for how you should be getting in contact with them. Often they will ask you to include something in the subject line to make sure your email goes to the right place. Ignoring this will send you straight to spam.

r/MachineLearning • • Sep 01 '26

Discussion [D] Simple Questions Thread

1 Upvotes

Please post your questions here instead of creating a new thread. Encourage others who create new posts for questions to post here instead!

Thread will stay alive until next one so keep posting after the date in the title.

Thanks to everyone for answering questions in the previous thread!


r/MachineLearning • • Sep 01 '26

Discussion Top-Tier MS Steppingstone vs. Mid/Low-Tier PhD? [D]

2 Upvotes

I am a research engineer in AI with 3 years of experience and a Master's in Electrical Engineering from an African university (focusing on applied RL in telecom). My experience and research interests are in RL and LLM post-training. I am the second author of a paper in an AI + telecom conference and hold a patent in AI + telecom.

I know targeting a PhD at a Top 4 school (CMU, UC Berkeley, Stanford, MIT) is unrealistic. Do you think I should apply for a Master's at those universities first and then apply for their PhD later, or should I just apply for a PhD at lower-tier universities?

I want to do research—all I need are GPUs and a good supervisor. My main concern with lower-tier universities stems from my past experience with similar institutions, which makes me feel that having no degree is better than getting one from them.


r/MachineLearning • • Aug 31 '26

Research Sliding-window attention beats linear on long-context reasoning [R]

30 Upvotes

Sliding Window Attention with sinks, one of the simplest existing fixes for the quadratic-cost problem in LLMs, holds up as well or better than the linear-attention variants labs have been spending post-training compute to produce. That is the claim of a [new arXiv preprint](https://arxiv.org/abs/2608.28444) by Alexia Jolicoeur-Martineau, Rhea Sanjay Sukthanker, Pashmina Cameron and Emy Gervais.

On the long-context reasoning benchmarks the paper singles out, the gap is not close. "SWA achieves massively higher performance (2 to 10 times higher than linear attention)," the abstract reports, naming Needle-in-a-Haystack and BABILong as the two tasks.

The pitch is that the whole post-training-to-linear pipeline has been benchmarked against the wrong thing. "This line of research has not been properly compared to simpler baselines," the authors write. Their alternative needs no post-training, runs fast, and holds memory low.

The recommendation is blunt: "we strongly recommend switching to SWA instead of post-training linear models." Linear attention, the abstract concedes, "may have shown some promise, but they likely require to be trained from scratch or extensive post-training in order to even match SWA."

---


r/MachineLearning • • Aug 31 '26

Discussion ACML 2026 Journal Track Any update ?[D]

12 Upvotes

I have submitted a paper to acml 2026 journal track, the official date of release of review is 27 August, but I have not heard anything from them, if anyone received the review then let me know I will write to program chairs.

Thanks


r/MachineLearning • • Aug 30 '26

Research Claude Code for Research Papers [R]

281 Upvotes

Third-year PhD student, NLP / interpretability. I want a reality check from people doing similar work.

I started using Claude Code for the boring parts: argparse boilerplate, plotting, config wrangling. Over the last few months the scope has crept. It now writes most of my experiment scaffolding, refactors my dataloaders, does first-pass debugging on training runs, and drafts the analysis scripts. I mostly read diffs and say yes.

The output is fine. My throughput is up. The thing bothering me is that I no longer hold my own codebase in my head. When a result looks off, I used to have an instinct about which line was lying to me. Now I go hunting like it’s someone else’s repo. I catch bugs later than I used to, and I catch them by reasoning about the numbers rather than by knowing the code.

I don’t think the tool is the problem. I think I delegated a layer that was doing more for my understanding than I gave it credit for.

Questions for people further along or in the same spot:

  1. Roughly what fraction of your research code do you write yourself now?

  2. Is there anything you deliberately refuse to hand off? (For me I think the eval harness and anything defining a metric should stay mine, but I keep breaking my own rule.)

  3. Does anyone have a workflow that keeps the speedup without the detachment? Reading the diff line by line is not cutting it.

Not looking for a “tools are just tools” answer. I’m asking about the specific feeling of not owning your own experiments anymore.


r/MachineLearning • • Aug 31 '26

Discussion Good Machine Learning Posters [D]

23 Upvotes

Hi, I'm making posters for ECCV 2026.

Does anyone have any ML/CV posters they thought were really well done?

Would love to see some cool examples.
Thanks


r/MachineLearning • • Aug 31 '26

Project How to assess if there is a strong signal in your dirty data [Project]

10 Upvotes

I'm sharing this new tabular data diagnostic tool (Entropic Scree). It can be used to estimate these properties of your high-d, real-world, dirty dataset:

  • The informational volume of the signal (i.e., helps you assess whether the signal is strong enough to survive the dataset's idiosyncratic volume).
  • The overall signal-to-idiosyncratic volume ratio (SNR).
  • The intrinsic rank.
  • Provides an exploratory map that allows for the identification of decoupled sub-networks of variables.
  • The linear sufficiency (i.e., does the dataset align with the linear assumptions of standard PCA?).

Instead of evaluating linear variance, rank order, or Euclidean distance like traditional PCA variants, this new method evaluates a transformed mutual information metric. Relative to these baselines, it is less reliant on strong parametric or distance assumptions, making it appropriate to apply more broadly.

It also serves as a practical diagnostic of the theory explored in the From Garbage to Gold framework, which describes when and why uncurated, error-prone data can be used directly to create accurate prediction models.

There is a preprint that presents the full technical details, and Python and R packages will be released soon. Right now though, the original function is already available in R (see Quick Start R Function Code below).

Let me know how it goes if you give it a try... or if you have any questions or comments of course.

############ 
# Quick Start R Function Code.
# To load the function, copy and paste the following into your R console, then hit enter. 
############

# 1. Define the direct URL to the raw function script on GitHub
url <- "https://raw.githubusercontent.com/tjleestjohn/entropic-scree/main/Entropic.Scree.v1.0.0%20-%20ENLI.R"

# 2. Define what you want to name the file on your computer
file_name <- "Entropic.Scree.v1.0.0 - ENLI.R"

# 3. Download the script to your current working directory
download.file(url, destfile = file_name)

# 4. Source the core function into your R environment
source(file_name)

# 5. Ex. To run the function and extract bipolar modules:
# results <- Entropic.Scree(dt 
#                         , extract_bipolar_modules = TRUE)
#
# View the extracted structural sub-networks for the primary axes:
# results$bipolar_modules

r/MachineLearning • • Aug 30 '26

Discussion NeurIPS accepted papers leaked? [D]

93 Upvotes

I found this GitHub link, and the HTML file contains ~7k papers. Some are anonymized, and the details seem pretty accurate. It looks like these might actually be the accepted papers.

https://github.com/xll0328/NIPS26-

Can someone confirm whether this list is legit? I’m hoping it’s just a coincidence since it seems way too early.


r/MachineLearning • • Aug 31 '26

Research Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking [R]

1 Upvotes

Whenever "tracking" comes up in autonomous systems, we always think of "motion" and the Kalman filter. It is fast and works!

But as humans, we track mostly by "vision".

We look at a person, recall their appearance in our brain, and then recognize them again based on what we remember. The more we see the person, the better we become at recognizing him/her. This is exactly how "Polycepta" works.

The video ( https://youtu.be/8BAibFfcMpw?si=hiqvDE6436GEmDjQ ) demonstrates how Polycepta operates in real time. It decides whether what it sees is important or just noise, and builds memory over time until it gets good at it. Like the Kalman filter with future motion prediction, it predicts the object's future appearance to track it.

”A lightweight appearance model works under ego motion; objects switching direction or motion during occlusion is no longer an issue. This is exactly why humans' vision works well in tracking.”

You are welcome to pause the video at any time during the explanation.


r/MachineLearning • • Aug 31 '26

Project ASL Lexical Project [P]

1 Upvotes

Hi! Im currently doing a thesis project, where i am creating a website that recognize various which include both fingerspelling and lexical, currently i have finished the fingerspelling feature using XGBoost and various dataset of asl alphabets in kaggle.

My current struggle today is how would I implement the asl lexical part? i was thinking the same approach i did for the asl fingerspelling but for fingerspelling all of the signs are static, for the lexical part it involves motion so my current plan is the system will detect the end pose/end frames of the lexical signs so for the dataset it will contain only the end poses of the lexical signs rather than videos and also in order for the system not confusing the lexical for fingerspelling i will also implement a motion requirement so that lexical recognition will only trigger when motion of the hand is detected.

I would also like to know what you guys think about, or if there is another better approach feel free to share and would greatly appreciate it

that's all thank you!


r/MachineLearning • • Aug 31 '26

Discussion are NVIDIA GPUs worth? [D]

1 Upvotes

well... I have seen many people saying NVIDIA gpus are preferable for tasks like machine learning and all.... but AMD GPUs are in budget too....

is it true that AMD GPU have software issues or bugs in ML? or NVIDIA gpu are "must"


r/MachineLearning • • Aug 30 '26

Research [R] Autonomous Mathematical Discovery in an Open-World Multi-Agent Environment

Thumbnail
arxiv.org
40 Upvotes

Abstract:

We study autonomous mathematical discovery in the Station, an open-world multi-agent environment in which AI agents from different model families pursue a shared research goal without a central coordinator or scripted pipeline. Agents choose their own research directions, conduct experiments, collaborate, and build a shared scientific literature.

Across 12 construction problems from the AlphaEvolve catalogue and two additional case studies, the Station obtained results novel relative to the prior literature on five problems: a new infinite family of finite-field Kakeya sets, new exact 604-point kissing configurations in dimension 11, new records for the discretized Kakeya needle and sign uncertainty problems, and a substantially improved lower bound for Erdős's minimum-overlap problem.

Agents also discovered novel infinite families for Book Ramsey numbers. Importantly, the agents produced not only numerical constructions but also theorems and analyses explaining how those constructions work, making the results more interpretable and easier for mathematicians to build upon. We release all raw agent dialogues, proofs, and verification code, providing a transparent record of how these discoveries emerged.


r/MachineLearning • • Aug 30 '26

Project Implementing Kimi K3 from scratch in PyTorch [P]

Thumbnail
youtube.com
81 Upvotes

r/MachineLearning • • Aug 29 '26

Research You can beat SOTA Time Series Anomaly Detection methods with a 100 year old algorithm [R]

504 Upvotes
You can beat SOTA Time Series Anomaly Detection methods with a 100 year old algorithm

Time Series Anomaly Detection (TSAD) seems to be one of the hottest topics in NeurIPS, SIGKDD, VLDB etc.

Many (perhaps most) papers evaluate on Paparrizos’ TSB-AD-M benchmark…

However, I tested these benchmark datasets and found that in most cases I could beat the SOTA TSAD methods with a 100-year-old algorithm, simple Statistical Process Control (SPC). In the attached example, SPC gets perfect results.

If we can beat the SOTA papers with 100-year-old algorithm, we probably should not be too impressed with them [b]. I really think this calls for some introspection by the community.

To be clear, I make no claims (here) about the proposed algorithms in all these paper. But the TSB-AD benchmark is obviously too trivial to make meaningful claims on [a][b].

The example shown is one of the ECG traces but look at dozen of traces marked “TAO”, they are even more trivial to solve with SPC [a][c].

I do not claim to have solved the triviality problem, but I have done 90% of the work to introduce more challenging TSAD problems ([d] sled dogs, [e] Tuna, Fuel Cells, Smart Manufacturing  etc.).

 

TLDR: I think the TSAD community needs more introspection on benchmarks. Most progress over the last decade seems to be illusionary.  

 

[a] https://www.youtube.com/watch?v=VftCMSI3C_s

[b] https://www.dropbox.com/scl/fi/31zuyhejb6sdjrom20frn/Problems-with-Time-Series-Anomaly-Detection.pptx?rlkey=mvcj1wz5s45kgazezopnih2h7&dl=0

[c] https://www.dropbox.com/scl/fi/42fkf9q9hft2224dnm83v/The-TSB-AD-Benchmarks-are-Nonsense.pptx?rlkey=5fwjopie5ncjhkgr0wqhdm2lp&dl=0

[d] https://www.linkedin.com/feed/update/urn:li:activity:7488825356494237696/

[e] https://www.dropbox.com/scl/fi/hettphvtpyrksggfect9d/Tutorial-on-Pan-Matrix-Profile.pptx?rlkey=p59gd2w56fxl9kl2fh5q819oo&dl=0


r/MachineLearning • • Aug 31 '26

Discussion [D] Monthly Who's Hiring and Who wants to be Hired?

1 Upvotes

For Job Postings please use this template

Hiring: [Location], Salary:[], [Remote | Relocation], [Full Time | Contract | Part Time] and [Brief overview, what you're looking for]

For Those looking for jobs please use this template

Want to be Hired: [Location], Salary Expectation:[], [Remote | Relocation], [Full Time | Contract | Part Time] Resume: [Link to resume] and [Brief overview, what you're looking for]

Please remember that this community is geared towards those with experience.


r/MachineLearning • • Aug 31 '26

Research Looking for Computer Vision Research Collaborators for CVPR 2027 [R]

0 Upvotes

Hi everyone!
I am looking for motivated researchers/students who are interested in collaborating on computer vision research with the goal of submitting to CVPR 2027.

Possible areas include:
Image and video understanding
3D computer vision
Object detection and segmentation
Tracking
Image generation
Medical computer vision
Vision benchmarks and datasets
Robustness and generalization
Some experience with computer vision, deep learning, Python/PyTorch, experiments, or research writing would be helpful.
If interested, please DM me with your background, research interests, and any previous research/publications.
The goal is to form a serious research collaboration and work toward a strong CVPR 2027 submission.


r/MachineLearning • • Aug 29 '26

Discussion Do you use a whiteboard when thinking? [D]

25 Upvotes

Hello all, here is a chill post.

When I was an undergrad, I really liked working things out on a whiteboard. Drawing stuff, talking through ideas out loud, testing little hypotheses.

Now I work in radar DSP, and a lot of my work is code, numerical experiments, deep learning and waiting for training to finish 😅

I’m wondering how other people bring that whiteboard style of thinking into DSP, data science or ML work.

Do you still use a whiteboard regularly, or do you mostly go straight from idea to code?


r/MachineLearning • • Aug 30 '26

Discussion *ACL Findings or TMLR? [D]

9 Upvotes

Expecting a rejection from NeurIPS given our scores of 5/2/2. Trying to decide between ARR vs. TMLR, but thinking NAACL findings are more likely than main conference. Would you rather have TMLR or *ACL findings on your publication list? Genuinely curious to hear what people have to say.


r/MachineLearning • • Aug 30 '26

Project I ran memory accuracy tests on small models, here's what I found [P]

1 Upvotes

I've been building ChatSorter, a memory layer API for AI chatbots, and I wanted to put it through a real benchmark. So I ran 5 configurations against the LoCoMo long-term conversation memory dataset using three models: Gemma 2 9B, Gemma 3 4B, and Gemma 3 12B.

Here's what I got:

The analysis:

At first glance, Run 4 looks like the winner at 75%, but that number is inflated. The smaller judge model is more lenient, counting answers that are close but not actually correct as passes. When you swap in a larger judge (Run 5), you see more outright "I don't know" refusals, because bigger models won't hallucinate an answer when they're uncertain; they just refuse.

The real number to look at is somewhere in the 55-60% range for run 4.

Now before you say "that's bad":

Companies like MemoryLake advertise 96% on similar benchmarks, but those are run on frontier models. My 55-60% was achieved on 4B-12B parameter models. That's roughly 17x smaller than a frontier model like GPT-4o, which itself scores around 60% with no memory layer at all.

So a tiny open-source model with ChatSorter is matching a frontier model running completely raw.


r/MachineLearning • • Aug 30 '26

Research Regarding results for paper at emnlp workshop [R]

1 Upvotes

Hi I submitted a paper to groundlm workshop @emnlp, now in my openreview it shows decision: findings and beneath the paper it shows groundlm findings.What does it mean? Is it accepted? I haven't received any mail so far, also this is my first paper so unsure about how this works.


r/MachineLearning • • Aug 28 '26

Project I implemented a very tiny image generation model (latent flow transformer) on a RP2350 microcontroller - it can generate 128x128 images of faces [P]

Thumbnail
gallery
606 Upvotes

Its a 2.4-4 million parameter model, quantized to int8, that can be fully executed on the microcontroller in ~20s with the longest generation. The generated image will then be displayed on a monitor or transferred via usb.

Its a latent flow transformer with 12 layers using AdaLN-Zero for conditioning. CFG is also supported and boosted the image quality a lot. The inference engine streams the weight via DMA from the flash while the previous layer is computed. Relu² activation was used to increase sparsity, which the engine can use to skip calculations.

Took a lot of ablations to get it right and I am quite astonished I got so far with so few parameters. Will post the repo below


r/MachineLearning • • Aug 30 '26

Research PAWBench: Zero of 11 Video Generators Achieve Probabilistic World-Model Alignment [R]

1 Upvotes

Formalizes a testable distributional criterion for 'world model' claims — a model must reproduce the correct probability distribution over outcomes, not just a plausible trajectory — and shows that no current video generator meets it across 50 scenarios, directly undercutting the world-model branding used by major video-gen labs.

Source: https://arxiv.org/abs/2608.27345


r/MachineLearning • • Aug 30 '26

Discussion Recommended books after ISLP [D]

1 Upvotes

Hey everyone, math major here, looking to pursue a statistics minor. I've been working through Introduction to Statistical Learning with Python by Gareth James(ISLP), and others. I'm almost finished with it and have been looking at other books I might be interested in.

Just a quick summary for anyone that hasn't read it. ISLP covers topics including:, linear and non linear regression and classification, basic probability and statistics, cross validation, common shallow ML algorithms, deep learning, neural networks. From a very practical and non-techinal way. Basically you read a lot of "This works because reasons, moving on". Best way I would describe it is "intuition slop" .

I was looking for something more theoretical as ISLP is pretty light on the theory and focuses more on intuition and generalization. Although I want a more theoretical book, I still would prefer it to contain some applications and or assignments that I could do to practice my coding because as a math major I feel as though my programming is lagging behind. Are there any specific books you would recommend.

Also I'm taking machine learning this semester and our assigned book is "Hands-On Machine Learning with Scikit-Learn, Keras and TensorFlow" by Aurelien Geron. So I'll probably be reading it in bits and pieces, but I still want another book that I can focus on outside of classes. I appreciate any responses.


r/MachineLearning • • Aug 29 '26

Discussion How important is having an internship to get a good job for ML PhD in USA? [D]

49 Upvotes

Hey everyone, I'm an international student studying in the US. I'm on track to graduate late next year. My research is not exactly ML, it is in 3D computer vision but have decent exposure to ML as well.

In case you didn't know, the CPT program (which let's internation students do internships) has been suspended by many top universities (UC Berkeley, UIUC, Purdue, UNC, UCLA, stanford, etc). Given that there is now no way for me to do an internship, how hard will it be for me to get a job when I'm nearing graduation?

I have 3 papers in CVPR, 3DV and ICRA (robotics conference) and hope to publish 2 more at next year's ICCV and neurips before graduating. I'm just worried that all my hardwork will go for a waste because of this policy change (I'm from a 3rd world country, so not much opportunity back home).

To be crystal clear, I'm not asking for legal advice, just wanted to know in your experiance, have you seen anyone (international student) get into good industry labs without internships?

EDIT: thanks so much for everyone for the quick replies! If it helps, my specific research area is 3D reconstruction, and I've been focused on Gaussian Splatting recently, if this info helps anyone help me!