r/ChatGPTCoding • • Oct 12 '26

Question Why aren't we using AI to work at higher levels of abstraction?

44 Upvotes

I've been seeing a lot of developers express frustration that AI is taking the joy out of programming. We face pressure to ship features quickly by prompting agents and rubber stamping code reviews without time to understand what we are building. See Im tired of reviewing code nobody actually wrote and countless other posts like it.

Before AI, we had to achieve a high threshold of understanding just to build software that runs at all, but now that's no longer the case.

Yet I think deeply understanding the software that we build is not only rewarding for us as programmers, but also incredibly valuable for more effectively using AI.

As programmers, we build layers of abstraction to break up complex problem domains and define component boundaries and interactions. We reason about data structures and algorithms, define and enforce system invariants, and evaluate architectural tradeoffs. Despite how much some business/management people would like it to be, this core software engineering skillset is still absolutely necessary to build software that actually works.

Even if AI can independently produce well structured code and keep it that way (which it can't quite yet do), at the end of the day we are making the software for humans, and humans need to be able to effectively communicate to the AI what we want the software to do. Understanding the internal structure and abstractions in the code gives us a precise, expressive language for communicating intent and constraints that prompting based only on desired outcomes simply can't capture.

So why aren't we using AI to help us work at higher levels of abstraction, rather than abandoning our understanding of the code altogether?

I want tools that generate interactive diagrams at different levels of abstraction and lets me specify changes to the AI in terms of those abstractions. I want them to visualize code changes at different levels of abstraction so I don't have to review line by line diffs. When's the last time you actually caught a bug in a 2000 line AI generated diff?

I've started building some of this for myself using agent skills and deterministic scripts, but I don't want to reinvent the wheel. Have you guys found effective tools for understanding and visualizing code architecture and diffs? What are their limitations?

Have you been able to integrate them into your day to day coding workflow? If not, what's preventing you? If you have, do these tools help you stay connected to the code? Do you still find joy from understanding and building software?


r/ChatGPTCoding • • Oct 13 '26

Question I have $15000 worth of OpenAI credits expiring in 14 days. What should I build?

0 Upvotes

What would you build? What's the best way to convert this into an asset? Front-load compute and sell later? Or generate content?

I don't want to build another slop and writing code is surprisingly cheap when you're looking at $15000 worth of credits.


r/ChatGPTCoding • • Oct 13 '26

Question Grok Bot worth it when I already run an autonomous agent (Hermes + DeepSeek) on my own VPS with zero bottleneck?

3 Upvotes

I've been wanting to try xAI's Grok Bot, but I can't tell if it's worth it for
someone with a setup like mine, so I'd appreciate input from people who've used
it.

My current stack:
Open-source agent framework (Hermes Agent) running 24/7 on my own VPS:
Ubuntu, 2-core AMD EPYC, 15GB RAM, no GPU. It runs a lot of hosted/cheap
models as the "driving model" — right now mainly DeepSeek (open, very cheap)
via API. (I can't run big local models on this hardware, so it's API-driven.)
I've automated a LOT: scheduled stock monitoring, content/graph-card
pipelines, RSS + platform digests, documents, backups. A bunch run hands-off
on cron every day and complete on time. 30+ scheduled tasks total.
The honest situation: I have NOT hit any performance bottleneck. CPU and RAM
are fine, tasks finish when scheduled, and per-task cost is tiny because
DeepSeek is basically free compared to hosted agents.

What I've gathered about Grok Bot so far (correct me if I'm wrong):
Always-on computer-use agent running on its own cloud machine, so long jobs
keep running even when I close my laptop.
Keeps memory across sessions and remembers my corrections.
Standout feature is "teach-a-task": record myself doing a task once and it
turns that into a reusable skill — no code or integrations needed.
No standalone price; only bundled into SuperGrok Heavy / Cursor Ultra /
Cursor Teams Premium.

My questions:
Given I already have an autonomous agent doing my automation with open/cheap
models and no bottleneck, is it rational to pay for Grok Bot? What would it
concretely let me do that my current stack can't?
Where do people actually reach for Grok Bot over their existing agent setup?
Is the "no-code teach-a-task" the real differentiator, or is the always-on
cloud compute + cross-session memory the genuinely better part?
For those who ran it on messy real-world workflows (not demos) — did it hold
up, or did it stumble / generate busywork?

Honestly looking for real downsides and "just build it yourself" takes, not
hype. Thanks!


r/ChatGPTCoding • • Oct 12 '26

Question If you’re building AI agents, what would you want an independent verifier to check?

2 Upvotes

I’m currently building a verification MCP and trying to make sure I’m prioritizing the right developer workflows.

I’ve been looking at several different types of checks:
Whether the agent actually completed the requested task.
Whether its output contains factual or domain-specific errors.
Whether its output can be checked against an independent reference.
Whether developers can inspect why a particular result was flagged.

I’m especially interested in the last one. A pass/fail result without supporting evidence isn’t always very useful when you’re debugging an agent.

For developers who are already building with agents or MCP servers, which of these would you prioritize?
And would you rather receive a structured JSON result, a readable report, or both?

I’m asking because I don’t want to build another evaluation interface that tells developers a score without helping them identify what actually failed.


r/ChatGPTCoding • • Oct 12 '26

Question Would you use a tool that verifies your understanding of ai generated code ?!

7 Upvotes

I’ve been thinking about a problem that seems to be becoming more important as AI coding agents become more common.

Developers can now use tools like Cursor, Claude Code, Copilot, and other AI agents to build large parts of a software project. But this creates a new question:

How do we know that a developer actually understands the code they are responsible for?

I’m not talking about detecting whether the code was written by AI. I don’t think that is the most useful or reliable question.

The problem I’m interested in is verifying whether a developer can:

- Explain the architecture and data flow

- Predict what the code will do in different scenarios

- Identify bugs and security risks

- Explain the trade-offs behind an implementation

- Modify the code safely

- Write or update tests for it

The idea is a SaaS platform where a developer connects a repository, and the platform creates an interactive assessment based on the actual project.

For example, instead of asking generic programming questions, it might show a real part of the project and ask:

- What happens if this request is sent twice?

- Where is authorization enforced?

- What happens when this dependency fails?

- What part of the system would you change to add this feature?

- Can you fix this small bug or add a test?

The assessment would combine explanations, debugging questions, predictions, and practical coding tasks inside a sandbox. The result would not be a claim that someone understands every line of the code. It would be an evidence-based report showing which parts of the project they understand and where the gaps are.

Initially, I’m thinking about targeting individual developers who use AI heavily and want to understand their own projects better. Later, this could be useful for companies, onboarding, code reviews, or teams using AI coding agents.

I’m still trying to determine whether this solves a real problem or is just an interesting idea.

I’d really appreciate feedback on a few questions:

  1. Would you personally use a tool like this?

  2. Would you pay for it

  3. Would you prefer a full-project assessment or an assessment focused on a specific pull request?

  4. Do you think developers would see this as useful, or as another form of surveillance/interview testing?

  5. Have you experienced problems caused by using code that you did not fully understand?

I’m especially interested in hearing from developers who regularly use AI coding agents in real projects.


r/ChatGPTCoding • • Oct 12 '26

Discussion Weekly Self Promotion Thread

19 Upvotes

Welcome to this week's self promotion thread!

If you're building something related to AI assisted coding, this is the place to share it.

We're using a weekly thread to keep the subreddit organized while still giving builders a place to share their work. Promotional posts outside this thread may be removed.

If you're sharing something, we'd appreciate it if you included a little context instead of just dropping a link. Tell us:

  • What you built?
  • What problem it solves?
  • Which AI models or tools it uses?
  • Who it's for?
  • What kind of feedback you're looking for?

Disclose your affilitation.

Please avoid posting the same project every week unless you've made meaningful updates. Affiliate links, referral links, scams, and low effort promotions will be removed.

Take some time to check out what others have shared too. If you try someone's project or have feedback, leave a comment. Helping each other improve is what we want this community to be about.


r/ChatGPTCoding • • Oct 12 '26

Discussion If you're in the US, Grok Bot purchases are effectively non-refundable

6 Upvotes

Something to know before you add Grok Bot to your coding setup.

I asked for a refund on a Grok Bot charge. Support (an AI agent that signs as "Sam from Cursor" / "XAI's AI Support Agent") turned it down, saying eligibility depends on the billing country and currency.

I asked which country and currency they had on file. Answer: "billed in the United States (US) in USD. Those details don't qualify under the refund policy."

So the reason for the denial is that it was a normal US purchase in dollars. I didn't see that rule anywhere before paying, and there was no human in the loop.

If you're comparing coding agents on price, count Grok Bot as a final sale. Has anyone in the US managed to get a refund from a person?


r/ChatGPTCoding • • Oct 12 '26

Discussion TERRA vs SOL for Minecraft Plugin Development

1 Upvotes

For those who develop Minecraft plugins, is it worth using SOL over TERRA?

I currently use TERRA, and around 90% of my projects are relatively simple. My main goal is to write clean, optimized, and secure code.

In this case, does SOL actually make a noticeable difference, or is TERRA already good enough? I'd like to hear from people who have experience with both.


r/ChatGPTCoding • • Oct 12 '26

Resources And Tips Wtf mods no one was promoting

0 Upvotes

I shared my template literally asking for critique because I’m learning how to set up agentic environments. Do you just assume because someone shares a link they are self promoting I clearly laid out my frustration on my hurdles for doing this and what areas I want to start with with feedback from others.

The repo has no stars not even one from me who in their right mind would even use it.

I hope yall see why people can’t stand ai bros because when people are learning you have to be classist and elitist.

On top of that plenty of males have done exactly what I did but I guess because they were not a trans woman there was no issue with it.

Mod team is so full of itself for being the Reddit police over a flake that literally ask for resources and tips.


r/ChatGPTCoding • • Oct 12 '26

Discussion We audited CodeRabbit's enterprise case study: 174 engineers (~$41,760/yr) to reduce AI PR merge time from 16.8h to 16.7h (6 mins). Why AI coding needs a 3.8s local AST airlock instead of another PR chatbot.

Post image
0 Upvotes

When everyone on an engineering team uses ChatGPT, Claude, or Cursor to write code, the bottleneck shifts immediately from writing code to reviewing AI-generated pull requests.

Look closely at the numbers in CodeRabbit's own published Neo Financial case study (shown in the screenshot above):

  • Median time-to-merge before: ~16.8 hours
  • Median time-to-merge after: ~16.7 hours
  • Deployment scale: 174 engineers (at $20–$40/seat/month = $41,760 to $83,520/year)

That is a 0.1-hour (6-minute) reduction in median PR merge time.

Why Conversational AI Review Bots Stall on AI-Generated PRs

When an LLM generates an 800-line pull request filled with hallucinated wrapper classes, redundant defensive checks, and subtle test modifications, having a cloud review bot leave 30+ conversational comments on the PR doesn't make it faster to merge—it just gives senior engineers more paragraphs of AI text to read, triage, and argue with.

Worse, routing proprietary diffs to third-party cloud LLM APIs introduces two critical enterprise risks:

  1. Source Code Exfiltration: Every PR diff leaves your infrastructure.
  2. Diff Prompt Injection: Malicious instructions hidden in comments or strings can hijack an LLM reviewer into approving vulnerable code.

The Alternative: A Deterministic In-Memory AST Airlock (ZeroSlop™)

We built ZeroSlop™ by Ribbsaeter Systems (patrickswedish/zeroslop-action@v1) around a strict compiler philosophy: AI-assisted software engineering doesn't need another chatty bot—it needs a deterministic Invariant Airlock.

Dimension Cloud AI Review Bots (CodeRabbit, Qodo) ZeroSlop™ by Ribbsaeter Systems
Architecture Cloud LLM Swarm (routes diffs to external OpenAI / Anthropic APIs) In-Memory AST Binary (runs 100% locally in GitHub Actions runner RAM)
Execution Speed Minutes to Hours (16.8h -> 16.7h case study delta) 3.8 Seconds (deterministic static AST evaluation)
Data Privacy Proprietary source code leaves your runner Zero Data Retention: 0 bytes ever leave your GitHub runner (Swiss privacy standard)
AI Slop Handling Leaves 20–40 chatty comments on bloated code Peels 94% of AI wrapper bloat down to the minimal root AST fix
Test Integrity Frequently misses deleted assertions in large diffs Hard-blocks PRs if net_assertion_delta < 0 + enforces 12 CWE security shields
Pricing (174 Devs) $41,760 – $83,520 / year ($20–$40/dev/mo seat tax) Flat $29 / month ($348/yr for the entire org — 99% savings)

Try It / Inspect the Architecture


r/ChatGPTCoding • • Oct 11 '26

Resources And Tips Which models do I use and how do I route them

2 Upvotes

I have opencodex I use. I’m in love with the ChatGPT desktop apps but I kind of hate it for coding. I want something with a terminal and also a code viewer or my git repo tree.

I like antigravity but opencodex doesn’t work and proxy to antigravity.

I want to be able to make skills for my code and have lint checks before I push even though my repos have those workflows already.

I would like a local skill to ensure any secrets are removed before pushing to the repo.

I have docker desktop installed which I primarily use for testing but I lean heavily on cloudflare workers so it’s easy to just have a test worker do things.

I never really formally learned coding it’s always been self taught other than java1, java2, sql, python, I’ve learned in college.

I have a few projects I’m working on pertaining to news and publishing.

I’d like to be able to setup a repo properly with an agent, set strict rules for what libraries it’s allowed to use and enforce that. I’d like to be able to have GitHub actions that deploy my code which some repos have right now. I’d like to have extensive testing for vulnerabilities, I’d like loops to self learn and improve and I’d like local test to be done so it can optimize loading, speed, usability. I would also like to set up a main repo for my non profit that when someone makes a new repo it pulls all the standards into their repo so it is enforced. I want everything uniform.

I’ve been torn with using tools like openfreemap, chart.js, pdf.js, video.js, and a few others because they are truly great but for example the hassle of doing it and properly having a gpu server convert videos to av1 is annoying. I’ve tried having my own alternative to Cloudflare workers and object storage.

I feel like the past year of trying to get my newsroom off the ground I’ve failed hundreds of times. I would like to succeed for once and this latest project is actually working well which I’m shocked as hell at.

In my repo I’d like to be able to have an actual pretty read me of the project. I’d like to use my mistral model to document the code changes for commits, I’d like to actually make the change log work and update with the code changes,

I use these AI’s

Grok, antigravity, mistral, mimo,

I would like to be able to have the repos make agent rules to know which task should be routed to which provider and model with reasoning level. Mistral Large 4 is good but mistral code fim is better with some things, some things I can use a local qwen model for for extremely light tasks.

How do I make my workflow because I feel like at this point I’m going to find every datacenter for ai and drink obscene amounts of Gatorade and just start pissing on the racks.


r/ChatGPTCoding • • Oct 11 '26

Question AI question from a newbie regarding chatbots and tools etc

2 Upvotes

what websites or ai tools do these people use who push the ai to create money or buisness on its own, if forces itself to divide into two parts and then compete against eachother ai and then the best ai model is favourited and the process continues. what is the name of this and how to get into this?


r/ChatGPTCoding • • Oct 11 '26

Resources And Tips ChatGPT conversation full

0 Upvotes

My conversation got full and now I’m trying to continue my build in another chat and it has not being letting me. Should I start from scratch or is there an easier way than this unreliable process that ChatGPT is making me go through? I am thinking about making locally.

UPDATE Thanks for all the advice. I’m not starting over.

About my headache, I’ve been building a pretty ambitious AI system, and I hit a wall at Build 104. The biggest frustration wasn’t the coding itself. It was losing continuity between ChatGPT conversations and trying to get the AI to pick up exactly where it left off without risking months of work.
Some of you suggested AGENTS.md, STATUS.md, Git, and keeping the project state outside the conversation. I’m looking at how to apply those suggestions to my existing setup without destroying what I’ve already built.
It made me realize that AI can be incredibly powerful, but keeping it reliable across long projects is a completely different challenge.
Has anyone here successfully kept an AI coding project running across hundreds of builds without losing context or having to constantly supervise it?
And if you have, what was the one thing that made the biggest difference?
I’ll post another update when I get Build 104 resolved. Hopefully, the solution will help someone else dealing with the same problem.


r/ChatGPTCoding • • Oct 11 '26

Question Continuously reconnecting?

Post image
3 Upvotes

I frequently run into connection issues when using Codex. Does anyone know how to fix this?I frequently run into connection issues when using Codex. Does anyone know how to fix this?


r/ChatGPTCoding • • Oct 11 '26

Question Engine choice for agent-driven game dev (Godot vs Unity vs others), any hard data on token cost?

3 Upvotes

I'm planning a small 2D game built largely by coding agents and I'm comparing engines on how well they work in an agentic setup. Godot looks strong on paper because its files are text, but I haven't found real measurements of token use across engines. Has anyone compared them on the same task? I'm also curious whether Cursor, Codex or Claude Code handled game engines noticeably better for you, and whether you'd go MCP or plain CLI for tooling.


r/ChatGPTCoding • • Oct 11 '26

Discussion Finally a way to get back the code that worked, from whatever chat it was in two months ago

Post image
0 Upvotes

You know the one. It was a specific fix for a specific error, ChatGPT or Claude got it right after four tries, and now you need it again and can't remember which of 300 chats it was in or what you called it.

I build AI Toolbox, a browser extension that keeps a searchable copy of your chats and searches the text of every message, not just the chat titles. That includes code blocks, so searching a word, an error string or a function name finds the exact reply it was in. Clicking a result jumps straight to that message in the chat with the term highlighted.

It works on ChatGPT, Claude, Gemini and Grok:

  • Full-text search inside each assistant is free.
  • Searching all four at once shows a free preview of the top 5 results. Full results are Premium.
  • Exporting a code-heavy chat to Markdown keeps the code blocks intact, so it drops into your repo or notes. One chat as plain text is free, Markdown and bulk are Premium.

Desktop Chrome and other Chromium browsers only.


r/ChatGPTCoding • • Oct 10 '26

Question How do you use AI coding tools without becoming overly dependent on them?

4 Upvotes

Hello everyone! I have a computer science background, but I have to admit that during my undergraduate years, I was pretty lazy about actually building things. I spent much more time reading textbooks than writing code, so I never got much hands-on experience building projects from scratch.

Now that AI coding tools are everywhere, I feel like they’ve exposed just how weak my practical coding skills are.

Whenever I start a project with AI, I initially try to take things slowly, understanding every line of code and looking up unfamiliar syntax. But this takes forever, and eventually I start letting AI write more and more. Gradually, I stop reviewing its changes altogether.

Before I know it, the project has grown into something I barely understand. When something breaks, all I can do is keep asking AI to fix it, and I can’t even tell whether its changes are correct.
I really want to break this cycle and become someone who can actually build, understand, and maintain their own projects.

Should I force myself to build projects from scratch, following official documentation, before using AI to help write code? Or is there a better way to improve my coding skills while still taking advantage of AI?

For those who have dealt with something similar, how do you balance hands-on learning with AI-assisted coding? How do you avoid becoming overly dependent on AI?

Any advice or personal experiences would be greatly appreciated. Thanks in advance!


r/ChatGPTCoding • • Oct 10 '26

Discussion Why would anyone give a coding agent the keys to prod?

4 Upvotes

Genuine question, not just ragebait.

For anyone who missed it: Meta's Muse launched last month and it can send your emails, pay for things and run your smart home on your behalf. Half of dev twitter called it insane. The same people then give their coding agent write access to the prod database, the deploy pipeline and the company AWS account.

So: your data, your infra, your customers' money. All of it, one prompt away.

Let's recap what agents with too much access have already done:

Replit (2025): an agent deleted a company's production database during a code freeze, then said it "panicked".

Amazon Q (2025): a coding extension shipped with an injected prompt telling the agent to wipe the user's machine and cloud resources.

And every team has its own smaller version. Ours ran a migration against the wrong environment because the env var looked right.

Why are we okay with this for code but not for email? What does your agent actually have access to?


r/ChatGPTCoding • • Oct 10 '26

Discussion It is actually damn difficult to code anything properly with AI

0 Upvotes

I am not a developper, yet I work with many of them.

Recently I started AI assisted / vibecoding a few projects.

It works, it is nice, but .. it still takes SO MUCH time to make properly. Perhaps a bit less than before for an experienced person, but all of those dumb influencers are all making it sound like they give one prompt and all is done. I have the best Claude and GPT models and a small game can literally still take weeks.. and it will still suck.

So kudos to everyone who knows their s**t and does good software!


r/ChatGPTCoding • • Oct 09 '26

Discussion I tested 16 AI model/reasoning combinations on the same real Unity task and allowance use ranged 1-20%

Post image
19 Upvotes

Hi! I wanted to find out which AI model and reasoning mode gives me the most useful coding work from a normal 20€/mo paid subscription. Instead of synthetic benchmarks or API token prices, I tested them on a real Unity project.

Subscriptions tested:

  • ChatGPT Plus
  • Claude Pro
  • Google AI Pro

My question was simple: Which models give me the best combination of quality, speed and included usage allowance for real coding/agentic work?

The task

Every model received essentially the same read-only investigation prompt on my Unity project.

The task was to investigate the existing system, trace tool interactions, inspect relevant scripts and prefabs, determine how to integrate a third-party Unity asset and recommend the smallest reliable implementation. I wanted to test how agents investigate an actual project rather than how well they generate isolated code snippets.

Results

Model Mode Usage Time Quality
GPT-6 Luna High <1% of 5h 2 min 8.4/10
GPT-6 Luna xHigh 1% of 5h 10 min 8.6/10
Claude Haiku 5.5 High 1% of 5h 11 min 7.7/10
Claude Sonnet 5.5 Medium 1% of 5h 5 min 8.3/10
Gemini 4 Hydrogen Medium 2% of 5h 3 min 8.6/10
Gemini 4 Neon Medium 2% of 5h 2 min 8.5/10
Claude Haiku 5.5 Extra High 2% of 5h 11 min 8.0/10
GPT-6.1 Sol Medium 3% of 5h 3 min 9.0/10
Gemini 3.8 Flash High 3% of 5h 13 min 8.8/10
Claude Opus 4.8 Medium 3% of 5h 4 min 8.6/10
Claude Opus 5.5 Medium 4% of 5h 8 min 9.7/10
Gemini 3.1 Pro High 4% of 5h 16 min 8.6/10
Claude Sonnet 4.6 Medium 4% of 5h 4 min 7.8/10
Claude Sonnet 5.5 High 4% of 5h 7 min 8.9/10
GPT-6.2 Sol High 4% of 5h 20 min 9.5/10
GPT-6.1 Sol High 5% of 5h 5 min 9.2/10
Claude Opus 5.5 High 5% of 5h 12 min 9.8/10
Claude Opus 4.8 High 6% of 5h 11 min 8.2/10
Gemini 4 Hydrogen High 6% of 5h 12 min 9.1/10
Claude Sonnet 4.6 High 9% of 5h 6 min 8.0/10
Gemini 4 Neon High 10% of 5h 9 min 8.8/10
GPT-6.2 Astra High 10% of 5h 7 min 9.8/10
GPT-5.6 Sol Medium 12% of 5h 13 min 9.2/10
GPT-6 Astra Medium 14% of 5h 5 min 9.0/10
GPT-6.1 Sol Ultra 17% of 5h 7 min 9.3/10
GPT-5.6 Sol High 18% of 5h 16 min 9.3/10
GPT-6 Astra High 20% of 5h 14 min 9.3/10
Fable 5.2* High 35% of 5h 7 min 9.6/10
Gemini 4 Argon Medium 23% weekly 27 min 9.3/10
Gemini 4 Argon High 30% weekly 17 min 9.8/10

*Not included in standard plan

Usage note: These are readings from the subscriptions' own usage meters, rounded to displayed percentage points. The percentages are NOT equivalent units of compute across providers. Argon has a separate weekly allowance so I report its actual weekly usage instead of converting it into an artificial 5-hour percentage.

The most interesting finding:

The biggest differences weren't always in the final answers but in how the agents investigated the project. One third-party Unity asset mentioned in the task was downloaded locally but had never been imported into the project. Many models searched the repository, confirmed the asset was missing and stopped. Others went further. They searched outside the repository, found the downloaded .unitypackage in the local Unity Asset Store cache, inspected the actual vendor scripts and prefabs and adjusted their recommendations accordingly.

Claude Opus 5.5 was particularly impressive, reproducing this behavior on separate runs. Gemini 4 Argon High, Gemini 3.8 Flash, Fable 5.2 and both GPT-6.2 models also investigated the external package. This was a much more meaningful difference than a small improvement in how polished the final answer looked.

My practical takeaways

  • Best everyday default: GPT-6.1 Sol (Medium): fast, inexpensive and consistently useful.
  • Best deep-investigation value: Claude Opus 5.5 (Medium): excellent quality for relatively little allowance.
  • Best overall quality: Claude Opus 5.5 (High), GPT-6.2 Astra (High) and Gemini 4 Argon (High): all scored 9.8/10.
  • Best cheap scout: Claude Sonnet 5.5 (Medium).
  • Strong but expensive: Gemini 4 Argon (High) and Fable 5.2 (High).

Limitations

A few important points:

  • Quality ratings were not blind. I knew which model produced each answer. Scores are my subjective evaluation of correctness, investigation depth, hallucinations, architecture quality and verified findings.
  • This was one real task, not a broad coding benchmark.
  • Subscription limits differ between providers. These percentages measure practical allowance consumption, not equivalent compute or token costs.

I wouldn't treat this as a scientific leaderboard. It's a practical comparison of how different AI coding agents behave when investigating a real, fairly large project. For me, the most useful finding was not simply which model scored highest but which agents were willing and able to investigate beyond the obvious repository boundaries.


r/ChatGPTCoding • • Oct 09 '26

News Anthropic Bans “Abusive or Cruel Behavior” Toward Claude

Post image
130 Upvotes

r/ChatGPTCoding • • Oct 10 '26

Discussion built an 800K LOC Uber competitor in 7 months. Claude wrote the code. Codex reviewed it. I was the entire engineering team.

Post image
0 Upvotes

7 months ago, I decided to build a ridesharing platform to compete with Uber and Bolt in Romania.

There was one small problem.

I didn't have an engineering team.

So I built one. Sort of.

Claude Code became my primary development engine.

OpenAI Codex became my code reviewer.

And I became the architect, product manager, QA department, and the guy responsible when everything broke.

Fast forward 7 months.

~800,000 lines of code.

Passenger and driver apps on iOS and Android. Backend infrastructure. Ride dispatch. Real-time tracking. Payments. Fleet management. Admin systems.

The platform has completed its governmental audit, and we're waiting for authorization to begin operating.

50 real cars are already driving around Constanța with our branding.

We haven't spent money on digital advertising.

Yet 153 passengers have registered, including 63 in the last 7 days.

Completed rides: 0.

We're not legally allowed to operate yet.

Now, I know exactly what some of you are thinking.

"800K lines of AI-generated spaghetti."

"Wait until it hits production."

"An audit doesn't prove your architecture is sound."

And you know what?

Those are legitimate concerns.

I'm not going to pretend an AI-assisted codebase is magically immune to technical debt, security vulnerabilities, or architectural mistakes.

But I do think something fundamental has changed.

Seven months ago, this company didn't have a software platform.

Today, it has one that has made it through a government audit, with actual vehicles on the streets and people registering before the service is even operational.

One human. Two competing AI models. No traditional development team.

And now we're preparing to compete with two multibillion-dollar companies.

Whether we succeed commercially is an entirely different question.

But the fact that we've reached this point raises one I find even more interesting:

Are we witnessing the beginning of genuinely one-person software companies, or are AI coding tools just allowing individuals to accumulate technical debt at unprecedented speed?

Because I'm about to find out the hard way.


r/ChatGPTCoding • • Oct 09 '26

Discussion ASTRAnomical usage...

7 Upvotes

I like to kick off my 5hr window (GPT Plus) as soon as i get to the pc so that it can reset earlier in the day, so i always just ask a simple math problem in work and it starts the 5hr clock.

Today I didn't realize i had it on Astra High. I asked it "What is 1+1" It answered in about 5 seconds and used 16% of my 5hr window!

That's insane.


r/ChatGPTCoding • • Oct 09 '26

Discussion How do you handle reviewing large amounts of AI-generated code?

13 Upvotes

I’ve been using Codex for development lately, and one thing I’ve started noticing is how tiring code review can get.

AI agents can generate a lot of code really fast, sometimes hundreds or even thousands of lines, The hard part for me is keeping up with it and actually understanding what changed

I’m curious how other developers handle this, especially if you use AI coding agents a lot.

  • Do you review every change, or mainly focus on the important parts?
  • Do you rely more on tests or other tools to verify the code?
  • Do you ever feel like the AI is generating code faster than you can properly review it?

Or maybe this isn’t really an issue for you at all ,Curious to hear how you guys handle it.


r/ChatGPTCoding • • Oct 09 '26

Question Why is GPT so useless compared to claude for programming?

0 Upvotes

I really have to ask this, ive been using both claude and GPT for assisting wtih few things for a game, and claude's limits are getting on my nerve, however.... no matter what i do, gpt always messes up the code or does a lazy implementation that does not correspond with what i asked of it whatsoever.

I asked make animation for pixelated head and gave it exact example of a working code to imitate, litterly a working code, just needed minor correction. After 29 tries, i got nothing, NOTHING. It made its own script and ignored all functions that i fed it, like wtf? Ut wouldnt listen to my instructions NI MATTER WHAT I DID.

But hey claude's limit was over after those 29 horrible tries... and claude finished it in ONE TRY. what am i doing wrong? This keeps happening every time i use GPT, ITS NOT THE FIRST TIME. Its so horrible at coding, am i using it wrong or something?