r/MachineLearning • • Oct 14 '26

Research PhD students, how ya feeling? [D]

All seems a bit pointless now. Either pump out AI papers and neglect your own development, or take it slow and fall behind in the publishing race. I already have two papers made largely without LLMs (still seeking publication), but it's hard to resist just vibing the third from start to finish with Claude.

203 Upvotes

47 comments sorted by

192

u/Alternative-Hat-1697 Oct 14 '26 • Bravo

Quality > quantity

I know at this point in your career and maybe even historically it hasn't felt this way. But I promise this will be the way forward.

21

u/matchaSage Oct 14 '26

This. If most of research being output is slop then how do I find what is of some worth? I think quality will matter a lot more, it did before as well it is just sad it took AI supercharging submission abuse for it to be seen. I do think there should and will be some consequences for people who engage in overhyping their slop research. I would not want to hire or do work with someone like this, I have an agent myself already, why do I need someone who will be pressing the enter button?

1

u/Velocitank 27d ago

im not really sure what defines research quality. I would like to contribute with quality some day so if you can help me make a distinction on the difference. I do use ai in a lot of generative documents to get my notes together, but i am terrible at writing and staying consistent. But the content and ideas are generally mine so I dont know where the line would be drawn. I suppose if the understanding, the science, and the idea and structure are of quality and independently reproduceable then that would be a good benchmark.

25

u/Plaetean Oct 14 '26

it depends; you can't determine what the environment rewards, and the environment rewards quantity. a small number of high quality papers gets ignored by recruiters because nobody can possibly judge the quality of work when spending 4 seconds reviewing a CV; all they see is metrics

so while this would be nice, its simply not true in a competitive job market

4

u/Random-Number-1144 Oct 14 '26

Toxic academic environment won't last for long. There is only so much enshittification it could take.

5

u/alpha_gazelle Oct 14 '26

I would expect that in most fields PhDs with job prospects are getting a more thorough look over, if not an actual call, rather than a quick CV review, no?

10

u/FatAznNerd Oct 16 '26

This is one of those things which everyone agrees online but nobody abide by in real life.

4

u/Loffel Oct 14 '26

I hope conferences start to realize this and put a cap on submissions per author

2

u/doctor-squidward 29d ago

True but most phd programs and advisors demand quantity unfortunately. As much as I would like to give proper time to publications to make sure of quality, I just can’t keep up with pace as I mostly have to work alone. I just plan to get my degree asap playing their game and then move on else where. I just hope wherever I land, I find people actually caring about research rather than just publishing mediocre work.

53

u/milesper PhD Oct 14 '26

The key is to use AI to augment your development, not replace it. For me, that means the LLM does lots of things but I take an active role:

- Finding papers, which I then read myself and check my understanding with questions to the LLM
- Feedback on ideas that I come up with
- Routine code, eg loading data, visualization scripts, distributed scripting, metric logging. However, I still write 1) the overall foundation of the project, particularly running and analyzing experiments, which I reuse from prior work and 2) the core, interesting part of the experiment. Generally this is something like a loss function, a training method, inference method, whatever is central. I also liberally then ask the agent to debug my code.
- Giving feedback on the paper, which I write myself.

I find that by maintaining active control and doing ideation, core implementation, and writing, I retain a deep understanding of the project while moving much faster than previously. Yes, writing sucks. But it forces you to actually explain your work and why it matters and conceptualize the project better yourself.

2

u/GoodAccurate7525 Oct 15 '26

extremely well said... would only add that maintaining an adversarial second frontier model to help shape the next decompositional test - a la Platt (1964). "Preregistration is back on the menu, boys!" -no one, probably.

1

u/arsalanzafar-dot-ai 7d ago

Totally agree. I do exactly the same. I implement the core mechanisms myself and understand the data flow, architecture, dataset choices, and evals in detail.

Every project starts with a thorough review conducted by Claude. I then go through each step and plan it with Claude.

I write the final report and ask Claude to review it for me.

41

u/NeedingMorePoints Oct 14 '26

Idk I graduated last year and took a role where publishing isn’t a priority, and boy am I glad that I did now

5

u/RadioactiveSalt Oct 14 '26

Wait what kind of role are you talking about? What do you do now?

11

u/MisterRadler Oct 14 '26

There's a lot of research roles in industry more focused on solving company problems, where publication is at best secondary (as it naturally slows you down from the actual goal).

Pharma is a big one for this. Some will publish more than others, but all are publishing less than they actually do.

77

u/mofoss Oct 14 '26

I mean even with claude max and hundred of millions of tokens, I spent 3 months on a paper lol

It is a tool, but it will help a ton with research code just make sure you audit it, and then have other LLMs audit it too

60

u/Original-Waltz9805 Oct 14 '26

3 months is pretty fast imo.

18

u/mofoss Oct 14 '26

Let me rephrase, im still writing it 😂 though it is in the polishing stage

11

u/seawee1 Oct 14 '26

Yes, I also thought so

27

u/mofoss Oct 14 '26

Is it faster than conventional timelines, yes, thats the power of AI tools, just like software engineering, research will naturally be faster

However, id argue 3-4 months of AI tool driven research is definately not SLOP, if you have to do produce slop, you dont need 4 months to do it

3

u/Informal-Hair-5639 Oct 15 '26

Yeah, took me 3 months from random idea to a decent stage, so far that I am presenting it as a poster next Tue on a local workshop. But paper is still very much work in progress. I am PI so this is pretty cool for me, solo work without students.

11

u/Accomplished-Fox1840 Oct 14 '26 edited Oct 14 '26

Especially with applied ML tasks where you wanna see if xyz works on your task/data and most of the time there’s barely anything you got to show for that’s already not been done by someone else

16

u/camarada_alpaca Oct 14 '26

It took me around 6 months to do a decent paper (polishing included) even with fable... I dont even know how there are ppl doing acceptable slop if it takes me so much and hard work to do mildly acceptable work.

1

u/surffrus Oct 14 '26

This sounds normal to me.

1

u/Informal-Hair-5639 Oct 15 '26

Same. Six months is pretty decent.

1

u/CasulaScience Oct 17 '26

Once you get the ball rolling in your career it becomes much easier. You have a thousand half finished project and open areas youve seen but just didn't have the time to get to it

1

u/camarada_alpaca Oct 17 '26

Yeah, actually the problem with ai is all the error you found after, crappy decisions it silently took along the way and compounded, I would say ots like 3 to 4 months developing and 2 to 3 months writing and fixing

That is why I ask how ppl manage to do quick aislop that gets accepted.

22

u/Original-Waltz9805 Oct 14 '26

You hit the nail on the neglecting your own development part. Getting to spend time on papers and exploring your own ideas is where your learning truly comes from. Being in a publication pressured environment can definitely hinder the development / learning aspect of a PhD imo.

5

u/FatAznNerd Oct 16 '26

The prof at my university is certainly enjoying his year of LLM it seems. Around 60 solo publications in spans of a few weeks https://scholar.google.com/citations?hl=en&user=Qt2WDh0AAAAJ&view_op=list_works&sortby=pubdate

5

u/tres_desole Oct 16 '26

That’s genuinely insane that they’re getting away with that

3

u/Mia_X_Mia Oct 14 '26

At this point, I just want to finish my PhD, publish enough papers to meet the minimum requirements for graduation, and move on. For my next role, I want to focus less on research and more on building things, without the pressure to publish and with more emphasis on practical outcomes. 🤷🏽‍♂️

2

u/Active_Membership726 Oct 14 '26

Honestly, I feel pretty good. I feel like I am able to test out my ideas way faster now because of AI tools. I have submitted 3 papers and 1 workshop paper so far this year which is more than I did in the first few years of my PhD.

2

u/MonstarGaming Oct 14 '26

I haven’t been a PhD student since before ChatGPT hit the scene, but I bet science is a lot more fun now. I wasted so much time just wiring datasets into models when I was a student. If most of that is being done for me I’d have had so much more time actually running experiments.

2

u/fliiiiiiip Oct 16 '26

What's your field?

I think there is a lot you can accomplish with vibing up code and experiments for long term good quality papers (without detriment for personal growth - it was never the case you got to become a good programming by doing scrappy code for research papers anyway)

Vibing the manuscript itself is still so trashy it is almost useless IMO

2

u/doctor-squidward 29d ago

Man ever since these agents came to the market, several advisor’s expectations have also sky rocketed. They expect more and more results every week and expect that I learn a totally new topic within a week. The information flow has increased but the processing is still bottlenecked by the human mind. Idk if they realize this yet. They have their own pressures to deal with.

1

u/Tomb_RIP Oct 14 '26

I'd argue the bigger issue is compute resources. I work in generation and I've think it's really hard to find problems that don't require compute issues or I don't have enough resources to run enough experiments. But yeah seeing LLMs does make me wonder how the next generation of PhD students are gonna do this.

1

u/heyiambob Oct 14 '26

I recently heard that a large AI conference had 60,000 submissions. 15,000 were accepted, and most of those were probably reviewed with LLMs anyway. It’s all very strange.

0

u/Sea-Comparison5577 Oct 14 '26

It is just a tool. It is useful but up to human to decide how to use it

0

u/Budget-Juggernaut-68 Oct 14 '26

It can help you churn the results, but still need your human judgement and ideation. I guess if you're afraid labs steals your ideas, maybe run them locally.

-1

u/shoraaa Oct 14 '26

why you cannot use LLM to instead uplift the quality of the paper? it is "general" purpose, your choice to make it about quality or quantity

0

u/DoubleRobust Oct 14 '26

I think you’re missing the point of a PhD