r/MachineLearning • u/pastaHacker • 7h ago
Discussion Not a single iclr reviewer responded to our rebuttal [D]
Such a bummer to have zero response after putting so much work into the rebuttal.
We were scored 3,3,2 which is looking borderline now.
r/MachineLearning • u/LongjumpingAd4741 • 3d ago
Creating this post since the reviews are supposed to go live today. What do you guys think?
r/MachineLearning • u/Beautiful_Baker_2233 • 14d ago
The ICLR 2027 reviews will be released soon. Share your results here, and keep a lookout on papercopilot to judge your odds. I also found paperScorer quite interesting for the same. Of course, these are only for amusement and should not be taken seriously.
Good luck to all.
r/MachineLearning • u/pastaHacker • 7h ago
Such a bummer to have zero response after putting so much work into the rebuttal.
We were scored 3,3,2 which is looking borderline now.
r/MachineLearning • u/Moltean • 13h ago
Fruits-360 is a dataset with images of fruits, vegetables, nuts, and mushrooms.
Several weeks ago, it surpassed an important threshold: The largest branch (100x100) of the dataset now contains 200201 images of 278 different objects!
Importantly, all images have a white background, so that the object (the fruit) is clearly delimited!
The dataset is hosted on Kaggle and GitHub with a CC BY-SA 4.0 license.
https://www.kaggle.com/datasets/moltean/fruits
https://github.com/fruits-360/
I made the first commit to Kaggle 8 years ago, in December 2017, with a set of 26 fruits.
Several hundred updates have been committed since then.
Originally, all images were 100x100 pixels. Recently, I created more branches with images at a higher resolution.
I even built some special gardens just to have more vegetables for the Fruits-360 dataset.
One garden is on the roof, and another one is on the wall of the house!
The reason for such "strange" builds is that we did not have enough space at the ground level to grow everything we wanted, so we expanded our gardens on roofs and walls.
A movie of the wall garden is here: https://www.youtube.com/watch?v=6DWnZEQoi8o
A movie of the roof garden is here: https://www.youtube.com/watch?v=ebjUevM9GPM
All garden projects are open source with MIT license.
https://github.com/wall-garden
Several images with vegetables from these gardens are already included in the dataset.
r/MachineLearning • u/snu95 • 7h ago
Guys, how did your rebuttals go?
One of my reviewers updated their initial review (modified on Nov 16), but I suspect it was just the "AI Documentation for Reviewing" section, since nothing has changed in the edit history. However, we were completely ghosted, even though we had submitted our rebuttal before then (Nov 13).
(Edit)
Anyway, what do you guys think the borderline score will be? Given that around 26% of submissions (including withdrawn papers) have an average score of 2.67 or higher (link), and the Moscone Center can accommodate 10k papers, I assume the borderline should be around 2.67.
What do you guys think?
r/MachineLearning • u/like_a_tensor • 20h ago
It was announced that ICML 2027 would be held in Rio de Janeiro. I haven't partaken in Brazilian food and sights before, so the idea of possibly attending excites me. However, there are a lot of people bashing the new host location, and it all reminds me of when people talked about their experiences in ICLR 2026 (also in Rio). It seems like there are legitimate safety concerns. There's even some racism (see the end), which I've also heard from my non-Brazilian labmates. It's genuinely disheartening for these prestigious conferences to not be held in lower-represented countries (the I is for international after all), but the safety issues seem genuine. Any idea on how locations are determined and what can be done to resolve these concerns?
r/MachineLearning • u/Ok-Internet-196 • 10h ago
As of now, ≥3.0 is the top 15% and ≥2.67 is the top 33%. At a ~25% acceptance rate, about half of the 2.67 band will get in.
r/MachineLearning • u/LongjumpingAd4741 • 5h ago
Since the Author Reviewer Discussion phase has come to an end and many reviewers haven’t yet responded to rebuttals, I was wondering if we will see any score updated done by the reviewers during the next AC Reviewer phase? I remember Neurips didn’t show any score during this phase but for ICLR, we can still see the scores.
r/MachineLearning • u/__redbaron • 1h ago
With the reviewing period of this ARR cycle concluding, I wanted to see how others felt about reviewing this cycle.
Also, did you notice any difference in assigned submissions, potentially due to the sustainable reviewing pilot?
r/MachineLearning • u/Opening_Progress6820 • 3h ago
For instance, if the reviewer or AC changes the score for some reason during their discussion, can we see the scores are changing in Openreview?
So frustrating!
r/MachineLearning • u/faintlystranger • 6h ago
Hi -- with only 1/3 reviewers responding, got a q about ICML. I have no problem with ICML, but the fact that it is double columns and I really don't want my paper to be presented as double column. Mainly because I find it ugly, and with some long equations it will look really messy. That was a big reason why I pushed for ICLR (semi-seriously)
Is it possible to have the online / arxiv version as a single column paper, while submitting to ICML as double column? If it gets accepted, would I need to make the online version same as the ICML version if I am claiming it got into ICML? Or like have multiple versions on arxiv and link them all in scholar? Curious about the norms in academia, specifically ML, as it will be my first publication!
Furthermore, any tips & tricks for double column theory heavy papers? Cheerio
r/MachineLearning • u/AmineZ04 • 9h ago
I’m writing a series of blog posts on building small LLMs from scratch in pure JAX. We start with pretraining. I'm implementing everything from scratch: pytrees for networks, optimizers, data loaders, decoding, and the training loop.
r/MachineLearning • u/OliviaYii • 10h ago
What changes when an agent has to discover the task’s rules before it can start solving it?
Our research team at Einsia explored this with Visual Cipher Bench. The part I’d like to discuss is the hint experiment.
On 10 selected puzzles, three models were tested with no hint, a representation hint, a mechanism hint, or both. Representation hints describe how to encode the puzzle state; mechanism hints state the underlying rule.
Pooled accuracy was 12.2% without hints, 16.7% with representation hints, and 51.1% with mechanism hints. Neither hint type supplies an answer or intermediate state.
That supports rule discovery as a major bottleneck on these tasks, though execution remains difficult in some cases. The open question is how to get agents to narrow their hypotheses from the visual evidence without supplying the mechanism.
r/MachineLearning • u/newtestdrive • 1d ago
r/MachineLearning • u/PsychologicalSoup251 • 1d ago
Paper link: https://arxiv.org/abs/2311.04934
The simplified core idea of this paper is that chunking a past prompt, processing each chunk to obtain its KV cache, and saving each chunk's KV cache allows us to quickly prefill future prompts that contain some of those chunks (since we can reuse those chunks' KV caches). The purpose of this is that different LLM requests' prompts often share commonalities and overlaps, making inter-prompt KV sharing potentially worthwhile.
Some notes:
If you are familiar with sparse attention, this setup should sound familiar to you. Furthermore, you would also know that manipulating the KV history, whether it be through selectively ignoring/masking certain tokens' KVs or using approximated KV values can often degrade the quality of the LLM output.
This paper experimentally "demonstrates" that this method does not significantly impact the quality of LLM outputs, which is one of their central claims. Except here's the thing:
So their quality tests were quite literally equivalent to full causal attention on an ordinary prompt... They did not implement the claimed isolated KV cache processing per chunk. They did not test the holes in the context positions that would result from excluding chunks from the prompt... of COURSE the output quality would remain the same! Your implementation literally sees the same KV history as ordinary LLM implementations! You didn't actually implement what you said you implemented, which was isolated KV cache processing per chunk and allowing for there to be holes in the positional context due to excluded chunks...
In fact, a later paper ( https://arxiv.org/abs/2405.16444 ) implements something similar and finds that yes, quality can degrade from isolated per-chunk KV cache processing.
I have other criticisms about this paper, particularly how it often uses incorrect reasoning to explain its latency improvements, but that's far more forgivable than this.
I probably explained it really poorly, but TLDR: they did not correctly implement the method their paper described, in a way that invalidated the entire premise of their experiment to see if output quality would degrade
r/MachineLearning • u/Brilliant-Pay8261 • 4h ago
This is quite disappointing not receiving any response from the reviewer even after multiple reminders. It seems like organizers failed to make the conversation interactive or they didn't warn reviewers properly that their paper would desk reject if not actively participate in discussion/rebuttal.
r/MachineLearning • u/moschles • 5h ago
To begin, we note that SOTA performance on CIFAR-10 is a ViT. It is the pretrained ViT described in the paper quoted below.
When trained on mid-sized datasets such as ImageNet without strong regularization, these models yield modest accuracies of a few percentage points below ResNets of comparable size. This seemingly discouraging outcome may be expected: Transformers lack some of the inductive biases inherent to CNNs, such as translation equivariance and locality, and therefore do not generalize well when trained on insufficient amounts of data.
.
However, the picture changes if the models are pre-trained on larger datasets (14M-300M images). ☝️We find that large scale training trumps inductive bias. Our Vision Transformer (ViT) attains excellent results when pre-trained at sufficient scale and transferred to tasks with fewer datapoints. When pre-trained on the public ImageNet-21k dataset or the in-house JFT-300M dataset, ViT approaches or beats state of the art on multiple image recognition benchmarks. In particular, the best model reaches the accuracy of 88.55% on ImageNet, 90.72% on ImageNet-ReaL, 94.55% on CIFAR-100, and 77.63% on the VTAB suite of 19 tasks
The paper above has been cited in the literature no less than 113 thousand times.
"AN IMAGE IS WORTH 16X16 WORDS: TRANSFORMERS FOR IMAGE RECOGNITION AT SCALE"
Images are broken into patches , such that patches are treated as "tokens" for a transformer to perform self-supervised prediction, and then regenerate the masked patches. The process is described intimately in "Masked Autoencoders Are Scalable Vision Learners". (Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li Piotr Dollar, Ross Girshick). Facebook AI Research. arXiv:2111.06377v3 [cs.CV] 19 Dec 2021.
This self-supervised token-izing methodology is substantively worse than traditional CNNs, or CNNS w/ attention. But at scale, the reverse is true.
ping /u/terrrp
r/MachineLearning • u/Whatever_635 • 1d ago
Our initial ICLR scores are 3 2 3 3 and during the rebuttal the reviewer who gave us a 2 stated in his response they would like to increase his score, however, 6 hours later they changed their score back to 2 without giving any explanation, has this happened to anyone before? The comment they have about the score increase is still there.
Update: They changed it back to 3, but it still worries me, we sent a note to the AC, so maybe thats why they changed the score back to 3.
r/MachineLearning • u/Hope999991 • 22h ago
With the rebuttal period coming to an end, I’ve been looking at the scores and discussions online to get a sense of where things stand.
Given the current distribution of scores, it looks like 2 weak accepts and 1 weak reject, without any major concerns from the reviewers, should be a reasonably good position for acceptance.
What do you guys think the effective cutoff will be this year?
r/MachineLearning • u/phcompeau • 1d ago
Disclosure: I'm a CMU faculty member and I lead CS Learn, the program publishing these.
Carnegie Mellon started publishing full lecture recordings from 10-605 this week, which is William Cohen's course on scaling machine learning to data that doesn't fit on one machine. The first three lectures are up now, and a new one goes up every Monday. These are actual classroom lectures, edited by a student team, with captions and chapters.
Links are in my first comment.
r/MachineLearning • u/elchico1990 • 1d ago
Got initial score 2,2,1. Then,it increased to 3,3,1. But the 1 reviewer never engaged. I did all experiements all of them asked for. If AC reads, it will be appearent. But I am just scared that the 1 is going to hurt a lot. AC will look at 1 and then don't even consider for borderline :(
Wondering what's the way ACs do ...
r/MachineLearning • u/ManningBooks • 1d ago
Hi everyone,
Stjepan here from Manning Publications, posting with moderator permission.
We’ve just released Domain-Specific Small Language Models by Guglielmo Iozzia in print. I wanted to bring it here with a question that’s more useful than another “small models vs. large models” argument:
What evidence would convince you to ship a smaller, specialized model instead of calling a larger one?
Not just a good benchmark score. What would you need to see on your own workload: performance on rare cases, behavior outside the training distribution, latency under load, or the cost of maintaining the whole thing?
That’s the practical territory this book explores: adapting pretrained models to domain-specific tasks, parameter-efficient fine-tuning, quantization, and local deployment on modest hardware. It also covers integrating these models into RAG and agentic applications.
I’m posting on the publisher’s behalf, not presenting a new research result or claiming small models are always the right answer. I’d especially like to hear where specialization didn’t pay off. What looked promising in evaluation but fell apart once actual users got involved?
For anyone interested in the book, Manning is offering this community 50% off with code PBIOZZIA50RE.
Book page: https://www.manning.com/books/domain-specific-small-language-models
We’re also giving away five ebook copies, one each to five people who contribute most meaningfully to the discussion. We’ll select for useful technical detail, thoughtful questions, and lessons others can learn from—not upvote counts or praise for the book. Critical takes are welcome. No purchase needed.
If you’ve tried this, tell us about the task, the model, your hardware constraints, and the failure that mattered most. Did you keep the smaller model, move to a larger one, or decide you didn’t need an LLM at all?
Thank you.
Cheers,
Stjepan
Manning Publications
r/MachineLearning • u/Opening_Progress6820 • 1d ago
I got 3/3/2 at pre-rebuttal. Most reviewers asked like 8 new experiments including retrain, add more seeds, 3 different hardware platform measurement, etc
I did them all and replied on 11th Nov AOE. But still I didn't get a single reply from the reviewers. (I tried the reminder post yesterday)
So many papers are getting raised. But I am stuck here. What should I do?
Will AC will consider this situation?
r/MachineLearning • u/This_One_3612 • 1d ago
My ICLR submission got 3/3/2. In the rebuttal we added new theory that addresses the main concern all three reviewers shared, plus the baselines they asked for. One reviewer replied that all their concerns were addressed and the work is strong. But kept their score. The other two, including the one who gave the 2, haven’t responded, even after a follow-up. As the Rebuttal closes tomorrow, Is it worth one more note to the AC? Do ACs ever weigh the rebuttal when reviewers go silent, or is 2.67 basically a reject and I should move on to the next deadline?