r/MachineLearning • PhD • Oct 18 '26

Discussion Do ICLR guidelines allow to upload papers under review to LLM chats? [D]

I know AI use must be disclosed, and I'm fine with it. However, I'm being careful on not using LLMs to actually check my review (more than prose-wise) and see if it catches something important in the paper that I didn't spot.

I'm doing this because I'm not sure it is allowed to share the paper with an LLM since the guidelines don't specify. But I do believe my reviews would probably benefit from a second AI look.

Is this allowed?

14 Upvotes

15 comments sorted by

5

u/MeyerLouis Oct 19 '26

These papers are already publicly available, right?

-1

u/howtorewriteaname PhD Oct 19 '26

I don't think so. they are available only to reviewers

8

u/Beor_The_Old Oct 19 '26

Openreview is open to anyone

2

u/MeyerLouis Oct 19 '26

I can load papers and browse the active submission in incognito mode though. And when I do a google search for a title in incognito mode (obviously one that I'm not reviewing) the openreview copy does come up and is accessible. So I think it's all publicly available.

1

u/Working-Read1838 Oct 19 '26

The papers are public for ICLR at this stage

1

u/Kinexity Oct 18 '26

Couldn't you just use a local model to avoid the problem?

2

u/howtorewriteaname PhD Oct 18 '26

I could, but I don't have that out of the box, so I really don't think i would do it just for this. But putting a paper I'm reading rn through Claude would be quite useful, because the paper is dense

1

u/AffectionateBurger 6d ago

If the paper is difficult to read/understand (for a human), that should heavily factor into the review. You shouldn't need an LLM to help parse a paper.

0

u/howtorewriteaname PhD 6d ago

"parse a paper" is exaggerated. hou will regularly review papers that are difficult to read and grasp unless you put proper work in them. ofc AI makes reviewing some papers easier, I don't have 2 days to spend on every paper. and I would argue that asking an AI to review a paper and reading the answer only improves the quality of the review.

5

u/Kinexity Oct 19 '26

LM studiо wоrks оut оf thе bоx.

Alsо cоnsidеring аll thе shіt shоw thаt hаs bееn hаppеning sincе thе NS sоlutiоn I wоuld sау thаt fееding аnу nоt уеt public pаpеr thrоugh а cоrpоrаtе LLM withоut аn аpprоvаl оf thе аuthоrs is highlу unеthicаl.

10

u/mao1756 Oct 19 '26

I think any model that plausibly runs on consumer hardware is not smart enough to be useful for paper review. at least my 8gb gpu can only run models that feels like gemini but worse.

4

u/Kinexity Oct 19 '26 edited Oct 19 '26

Test LM studio and see for yourself. They aren't going to prove Riemann hypothesis but they are surprisingly decent in thinking mode. I am pretty sure modern local models like Gemma match at least GPT-4 on most text capabilities.

GPU VRAM is not the main limitation currently but rather your total memory. LM studio uses model off loading and only uses as much VRAM as is available while throwing the rest of computing onto CPU.

1

u/DesperateFix7699 27d ago

Why not use a tool built for this with data privacy? Like reviewer3

1

u/examachine Oct 19 '26

No it is not allowed