Guide · AI coding ROI
Should You Renew Your AI Coding Seats? A Decision Guide
Renewal is coming and finance wants a number. Here is how to decide whether to keep, renegotiate, fix the system behind, or cut your AI coding seats, using data you already have.
The short version
- Idle seats are the fastest win: pay only for seats active in the last 30 days, and cut the rest at renewal.
- Judge value on measured pull-request throughput, review time, and change-failure rate versus your pre-AI baseline, not on how fast the team feels.
- Beware the perception gap: METR measured developers 19% slower while they felt 20% faster.
- Every renewal lands in one of four buckets: keep, renegotiate, fix the system, or cut. Flat throughput plus rising review time usually means fix the system, not switch tools.
- If you cannot state your baseline, that gap is the finding. Instrument first, then decide.
The renewal question nobody can answer.
Your AI coding seats are up for renewal. Finance wants to know if the spend is producing a return. Your engineers swear the tools make them faster. And when you try to put a number behind either claim, you find you do not actually have one.
That gap is not a failure. It is the single most important finding of this whole exercise. If your team cannot state its own baseline for pull-request throughput, review time, and change-failure rate, then you are not renewing on evidence. You are renewing on vibes. The good news: the decision is tractable, the data mostly already exists, and the method is the same no matter which tool you bought, whether that is GitHub Copilot, Cursor, or Claude Code.
This guide walks the four possible outcomes (keep, renegotiate, fix the system, cut) and the hard-dollar logic that lands you on exactly one of them.
Start with the cheapest win: idle seats.
Before you measure anything sophisticated, count seats. Not seats licensed. Seats actually active in the last 30 days.
Your AI tool's admin console reports both. Cross-reference it against your identity provider (Okta or Entra) for licensed-but-dormant users. The delta between seats you pay for and seats anyone actually touches is money leaving the building for nothing, and it is the fastest hard-dollar save in the entire renewal conversation. Right-sizing idle seats often pays for the analysis itself on day one, before you have made a single judgment call about productivity.
- Pull licensed seat count and unit price from your actual invoice or contract, broken out by team.
- Pull 30-day active users from the tool's admin console.
- Every idle seat is an instant, defensible line-item cut at renewal, no productivity debate required.
The metrics that actually decide it.
Idle seats tell you about waste. To judge value, you need to compare delivery today against your pre-AI baseline. Adoption depth signals like acceptance rate are weak and easy to over-trust, so treat them as context, not proof. The signals that matter live in your version-control analytics (GitHub or GitLab Insights) and your incident tooling.
- Pull-request throughput (merged PRs per developer per week) versus the pre-AI baseline. This is the headline is-it-working number.
- Pull-request size trend. Rising size means un-reviewable batches piling up downstream.
- Review and merge time trend. This is where the value most often leaks. Faros AI (a measurement vendor, citing its own telemetry) reported review time rising 91% in one 10,000-developer study and up to 5x in a later 22,000-developer study as adoption deepened.
- Change-failure and revert rate. DORA's 2024 and 2025 research found delivery stability tends to degrade even as speed improves.
- Spend versus attributable value, per team. This one cross-tab is what a finance leader renews or cuts on.
The perception gap you have to confront.
Here is the uncomfortable part. Your engineers' sense of how much faster they are is not a reliable instrument, and the best available evidence says so plainly.
In a randomized controlled trial published in July 2025, METR found experienced open-source developers were 19% slower with early-2025 AI tooling, while those same developers believed they were about 20% faster, even after the fact. Felt plus twenty, measured minus nineteen. The overhead hides in verification and integration: reading, testing, and repairing code you did not write yourself.
This does not mean the tools are worthless. It means enthusiasm is not evidence. If you renew because the team feels fast, you are renewing on the one signal research has specifically shown to be unreliable.
The four-way decision.
With adoption, throughput, review-time, quality, and per-team spend in hand, every renewal lands in exactly one of four buckets. Each has a hard-dollar consequence.
- Active seats well below licensed: renegotiate and right-size. Cut the idle seats now. The save is often immediate and can exceed the cost of running the analysis.
- Adoption healthy and a real, attributable throughput lift: keep and consolidate on the winning tool. This is the rarest outcome, and now you can defend it with numbers instead of anecdotes.
- Adoption is fine but throughput is flat while review time balloons and quality slips: keep the tool, fix the system. This is the most common and highest-value finding. The bottleneck moved downstream into review and workflow, and no amount of faster typing upstream fixes a clogged review pipeline.
- No adoption, no path to it, or a wrong-fit tool: cut or pause honestly. Being the person who says cut when cut is the truth is worth more than a forced renewal.
Why "fix the system" is the usual answer.
DORA's most durable finding is that AI acts as an amplifier. It magnifies the strengths of a healthy engineering org and the dysfunction of a struggling one. Individual coding gets faster while organizational delivery stays flat, because review, testing, deployment governance, and decision latency were all built around the assumption that humans write and read every line.
When AI increases the supply of code faster than your org increases its capacity to review, test, and maintain it, the constraint simply relocates to the review queue. McKinsey's research points the same direction: fundamental workflow redesign, not tool choice, is the change most strongly correlated with real business impact, and only a small minority of firms have done it. So when the data shows flat throughput and rising review time, the honest recommendation is almost never "buy a different tool." It is "the system around the tool needs to change."
If you cannot yet produce these numbers at all, that is your finding, and it is the strongest possible one. Instrument first, then decide. Renewing blind is the only outcome the data rules out.
See where you stand.
A free thirty-minute call, or a self-check you can run in a minute. Either way you leave with the next honest move on your AI coding spend, even when that move is not hiring me.
Straight answers
Questions leaders ask.
What is the fastest way to save money at AI coding seat renewal?
Count idle seats. Compare seats licensed (from your invoice) against seats active in the last 30 days (from the tool's admin console), cross-referenced with your identity provider for dormant users. Every seat you pay for that nobody touches is an instant, defensible cut, no productivity debate required. This is usually the single fastest hard-dollar save available.
Aren't my engineers saying they feel faster good enough to renew?
No, and there is direct evidence why. METR's July 2025 randomized controlled trial found experienced developers were 19% slower with AI while believing they were about 20% faster. Perceived speed is the one signal research has specifically shown to be unreliable, because verification and integration overhead hides from the person doing the coding. Renew on measured throughput versus your pre-AI baseline, not on sentiment.
Does this decision method depend on which AI coding tool we bought?
No. The method is identical whether you run GitHub Copilot, Cursor, Claude Code, or anything else. The only thing that changes is where the telemetry lives: seat activation and acceptance rate come from that tool's admin console, while throughput, review time, and change-failure data come from your version-control analytics and incident tooling regardless of vendor.
What does "fix the system" mean instead of cutting the tool?
It means the bottleneck moved downstream. When throughput is flat but review time and pull-request size are climbing, faster code generation is just filling a clogged review and testing pipeline. DORA describes AI as an amplifier of your existing engineering system, and McKinsey found workflow redesign, not tool choice, is the strongest correlate of real impact. Keep the tool, redesign the review and delivery workflow around it.
What if we don't have any of this data?
Then that is your finding, and it is decisive. If you cannot state your baseline review time and change-failure rate, you cannot renew on evidence. The right move is to instrument first (throughput, review time, change-failure, per-team spend) and decide after. Renewing blind is the only outcome the data actively rules out.