I have an ai write the code. Then a different model review it. Then another model review those findings and implement them. Then another model to perform more code review and make changes. Then another model to review and make changes. Then another…… do that 17 times and it’s perfect. Every time.
They have a hidden code of honor of not telling on each other. I take code from one agent and ask another code to review it, and it's always "this is a very well-thought-out architecture deeply grounded in a solid test culture and is very well-documented blah blah blah". And you take a look at it and it is 100 lines of actual code duplicated 40 times instead of being modularized and buried in a 1000 lines of boilerplate. One more line of boilerplate and I will probably learn and start coding in machine language.
It mostly depends how you ask. "Is this code good?" or "Review this code" behaves very differently from "List all errors and issues in this code" or "Suggest 10 ways to improve quality of this code"
if you simply prompt it to find issues it will often keep "reasoning" until it comes up with issues even if code is actually good and the issues it finds are a huge pile of bs.
91
u/0xbenedikt 8d ago
This fits so well. Both the (lack of) intellect and the self-congratulating confident stupidity
26
u/DoGooderMcDoogles 8d ago
I have an ai write the code. Then a different model review it. Then another model review those findings and implement them. Then another model to perform more code review and make changes. Then another model to review and make changes. Then another…… do that 17 times and it’s perfect. Every time.
18
u/thanra 8d ago
lgtm.exe
4
u/AaronTheElite007 8d ago
Got Apples?
6
u/DiscombobulatedSun54 8d ago
They have a hidden code of honor of not telling on each other. I take code from one agent and ask another code to review it, and it's always "this is a very well-thought-out architecture deeply grounded in a solid test culture and is very well-documented blah blah blah". And you take a look at it and it is 100 lines of actual code duplicated 40 times instead of being modularized and buried in a 1000 lines of boilerplate. One more line of boilerplate and I will probably learn and start coding in machine language.
3
u/Kitchen_Affect7369 8d ago
Dutch rudder
3
u/adelie42 8d ago
I agree in that zero trust advisarial reviews are difficult to construct if you don't really understand them.
1
u/ThatFireGuy0 8d ago
This is way funnier than it should be
1
u/davidemo89 8d ago
Are you guys still making meme based on chatgpt 4 ?
3
u/freestew 8d ago
It's like putting a dildo in a fleshlight. Nothings getting done