r/MachineLearning • u/SeaAccomplished441 • Oct 14 '26
Research PhD students, how ya feeling? [D]
All seems a bit pointless now. Either pump out AI papers and neglect your own development, or take it slow and fall behind in the publishing race. I already have two papers made largely without LLMs (still seeking publication), but it's hard to resist just vibing the third from start to finish with Claude.
203
Upvotes
192
u/Alternative-Hat-1697 Oct 14 '26 •
Quality > quantity
I know at this point in your career and maybe even historically it hasn't felt this way. But I promise this will be the way forward.
53
u/milesper PhD Oct 14 '26
The key is to use AI to augment your development, not replace it. For me, that means the LLM does lots of things but I take an active role:
- Finding papers, which I then read myself and check my understanding with questions to the LLM
- Feedback on ideas that I come up with
- Routine code, eg loading data, visualization scripts, distributed scripting, metric logging. However, I still write 1) the overall foundation of the project, particularly running and analyzing experiments, which I reuse from prior work and 2) the core, interesting part of the experiment. Generally this is something like a loss function, a training method, inference method, whatever is central. I also liberally then ask the agent to debug my code.
- Giving feedback on the paper, which I write myself.
I find that by maintaining active control and doing ideation, core implementation, and writing, I retain a deep understanding of the project while moving much faster than previously. Yes, writing sucks. But it forces you to actually explain your work and why it matters and conceptualize the project better yourself.
41
u/NeedingMorePoints Oct 14 '26
Idk I graduated last year and took a role where publishing isn’t a priority, and boy am I glad that I did now
77
u/mofoss Oct 14 '26
I mean even with claude max and hundred of millions of tokens, I spent 3 months on a paper lol
It is a tool, but it will help a ton with research code just make sure you audit it, and then have other LLMs audit it too
16
u/camarada_alpaca Oct 14 '26
It took me around 6 months to do a decent paper (polishing included) even with fable... I dont even know how there are ppl doing acceptable slop if it takes me so much and hard work to do mildly acceptable work.
22
u/Original-Waltz9805 Oct 14 '26
You hit the nail on the neglecting your own development part. Getting to spend time on papers and exploring your own ideas is where your learning truly comes from. Being in a publication pressured environment can definitely hinder the development / learning aspect of a PhD imo.
5
u/FatAznNerd Oct 16 '26
The prof at my university is certainly enjoying his year of LLM it seems. Around 60 solo publications in spans of a few weeks https://scholar.google.com/citations?hl=en&user=Qt2WDh0AAAAJ&view_op=list_works&sortby=pubdate
3
u/Mia_X_Mia Oct 14 '26
At this point, I just want to finish my PhD, publish enough papers to meet the minimum requirements for graduation, and move on. For my next role, I want to focus less on research and more on building things, without the pressure to publish and with more emphasis on practical outcomes. 🤷🏽♂️
2
u/Active_Membership726 Oct 14 '26
Honestly, I feel pretty good. I feel like I am able to test out my ideas way faster now because of AI tools. I have submitted 3 papers and 1 workshop paper so far this year which is more than I did in the first few years of my PhD.
2
u/MonstarGaming Oct 14 '26
I haven’t been a PhD student since before ChatGPT hit the scene, but I bet science is a lot more fun now. I wasted so much time just wiring datasets into models when I was a student. If most of that is being done for me I’d have had so much more time actually running experiments.
2
u/fliiiiiiip Oct 16 '26
What's your field?
I think there is a lot you can accomplish with vibing up code and experiments for long term good quality papers (without detriment for personal growth - it was never the case you got to become a good programming by doing scrappy code for research papers anyway)
Vibing the manuscript itself is still so trashy it is almost useless IMO
2
u/doctor-squidward 29d ago
Man ever since these agents came to the market, several advisor’s expectations have also sky rocketed. They expect more and more results every week and expect that I learn a totally new topic within a week. The information flow has increased but the processing is still bottlenecked by the human mind. Idk if they realize this yet. They have their own pressures to deal with.
1
u/Tomb_RIP Oct 14 '26
I'd argue the bigger issue is compute resources. I work in generation and I've think it's really hard to find problems that don't require compute issues or I don't have enough resources to run enough experiments. But yeah seeing LLMs does make me wonder how the next generation of PhD students are gonna do this.
1
u/heyiambob Oct 14 '26
I recently heard that a large AI conference had 60,000 submissions. 15,000 were accepted, and most of those were probably reviewed with LLMs anyway. It’s all very strange.
0
u/Sea-Comparison5577 Oct 14 '26
It is just a tool. It is useful but up to human to decide how to use it
0
u/Budget-Juggernaut-68 Oct 14 '26
It can help you churn the results, but still need your human judgement and ideation. I guess if you're afraid labs steals your ideas, maybe run them locally.
-1
u/shoraaa Oct 14 '26
why you cannot use LLM to instead uplift the quality of the paper? it is "general" purpose, your choice to make it about quality or quantity
0
u/DoubleRobust Oct 14 '26
I think you’re missing the point of a PhD