News

AI-Generated Code Validation Is the New Bottleneck

AI-generated code validation, not generation, is where the constraint moved. Blacksmith's $550M valuation is the signal. Here is where each layer belongs.

· · 6 min read
A pull request queue rendered as ink on paper, checks pending.
A pull request queue rendered as ink on paper, checks pending. AI-generated illustration by Carlos Arias .
Prompt sent to Higgsfield · nano_banana_pro · 3:2

AI-generated code validation is the constraint now, not generation. If your team adopted AI coding tools in the last eighteen months and the merge queue somehow feels slower than it did before, that is not a perception problem. The work moved. It moved from producing diffs to proving diffs are safe to ship, and most engineering budgets are still aimed at the layer that stopped being scarce.

The market priced that shift publicly on August 12, 2026.

The $550M Signal Is About Volume, Not Intelligence

Blacksmith raised a $45M Series B led by Peak XV Partners at a $550 million valuation, up from roughly $60 million when it raised a $10M Series A less than a year earlier, with customers climbing from around 800 companies to more than 6,000 in that window (TechCrunch, August 12, 2026). Supabase, Clerk, Ashby and Mercury are on that list. Worth noting what investors did not pay a near-10x markup for. Blacksmith is not a model company. It runs GitHub Actions on bare metal, roughly twice as fast at half the cost, using high single-thread CPUs instead of general-purpose cloud instances.

That is plumbing. The plumbing repriced because the water volume changed.

The number I would underline is not the valuation. Blacksmith reported that CI jobs on its platform grew 5% to 10% week over week since the start of 2026 (PR Newswire, August 12, 2026). Run the low end of that across the roughly thirty-three weeks to August and you get close to five times the January volume. Some of that is new logos. Not all of it is.

The company’s second product tells you where it thinks the pain lives. Codesmith is a coding agent that sits inside the validation loop, diagnosing failed checks, fixing them and keeping pull requests green. Not an agent that writes features first. An agent that cleans up after the checks say no.

Why AI-Generated Code Validation Became the Constraint

The evidence for the shift is not subtle, and it is not vendor marketing.

Teams got faster and shakier at the same time

DORA’s 2025 report put AI adoption among software professionals at 90%, and found that higher adoption correlates with both increased delivery throughput and increased delivery instability (DORA, 2025). Trust moved the other way. Thirty percent of respondents reported little to no trust in the code AI writes for them, which is a strange thing to say about a tool you use every day.

Stack Overflow’s 2025 survey, fielded across more than 49,000 developers in 177 countries, found more respondents actively distrust AI accuracy (46%, up from 31% the year before) than trust it (33%). The top frustration, named by 45%, was output that is almost right but not quite (Stack Overflow, 2025). Almost right is the expensive kind of wrong. It passes a skim and fails in staging.

The code itself is drifting

GitClear’s analysis of 623 million code changes found block duplication climbing from 40.3 per million changed lines in 2023 to 73.0 year to date in 2026, the highest on record. Moved code, the fingerprint of refactoring, fell from 21% of changed lines in 2022 to 3.8% in 2026 (GitClear, 2026). Nobody is consolidating anything.

Veracode tested more than 100 models across 80-plus coding tasks and found 45% of samples introduced an OWASP Top 10 vulnerability. Java failed 72% of the time. Cross-site scripting defenses failed in 86% of the relevant samples (Veracode, 2025).

Scale Will Not Fix This

Veracode’s blunt finding is the one that should move your roadmap: newer and larger models did not write more secure code than smaller ones. Model scale did not fix it, so the next release will not either. This is a property of how these systems generate, not a bug sitting in someone’s patch queue.

The Validation Stack: Four Layers, and What Each Is Allowed to Decide

Here is the shallow version of this argument, which I want to reject out loud: “AI writes half our code, so buy an AI reviewer.” No. That swaps one unverified generator for another and calls the pair a control. Validation is a stack, and each layer earns a specific authority.

  • Static analysis and type checking. Deterministic and cheap, run pre-commit. This layer should absorb the duplication and injection classes the GitClear and Veracode data predict. It is allowed to block a merge on its own, because its verdict is reproducible.
  • Test execution and CI capacity. The throughput layer, and the one Blacksmith is selling. It is allowed to say “not yet.” It is never allowed to say “safe,” because a green suite only proves the assertions you wrote.
  • AI-fix loops. The Codesmith class: an agent scoped to a failing check, with a bounded diff and no merge rights. Useful, and genuinely a time saver on mechanical failures. It must never be both defendant and judge on the same change.
  • Human review of consequence. Not review by diff volume. Review targeted at irreversible surfaces: migrations, auth, money movement, anything with a customer-visible blast radius.

The rule underneath all four is one I apply to any agentic system: the layer that produced an artifact never clears it. That is the same irreversibility gate logic I use for autonomous agents in production, and it does not get weaker because the artifact happens to be a pull request instead of a wire transfer.

The Three Ways Teams Buy the Wrong Layer

Buying faster runners when the suite is flaky. You are now paying premium rates to run a coin flip more often. Fix determinism first, then buy compute. Compute is the easiest layer to purchase and the least likely to be your actual constraint.

Buying an AI reviewer when the real gap is coverage. A reviewer agent inspects what exists. If the assertions are thin, both the human and the agent are reading a story with the ending torn out. Coverage on the paths that carry consequence is not glamorous work, and it is the work.

Giving an autofix agent merge rights to “save review time.” This is the one I would refuse to build. The moment the fix loop closes without a human on irreversible surfaces, you have automated the appearance of validation. Where the human sits in the loop is an architecture decision, not a policy preference, and it belongs in the authorization layer rather than a prompt.

The Diagnostic That Costs You Nothing

Before you buy anything, instrument one number: time from pull request open to merge, split into four buckets. Queue wait. Compute time. Waiting on a human. Rework after a failed check.

Most teams have never split it. They feel slow and buy the layer with the best demo.

If queue and compute dominate, the Blacksmith thesis is your thesis, and faster runners are a clean purchase. If rework dominates, you have a generation-quality problem, and a scoped fix loop earns its cost. If waiting on a human dominates, no tool fixes it. That is a routing and ownership problem, and it looks a lot like the coordination failures that sink multi-agent systems in production.

I started on a Commodore 64 in 1988 and have been building software professionally since 1999, a good stretch of that in FinTech, where you learn early that shipping is the easy half. Since 2022 my work has been agentic AI. The pattern holds. The constraint moves faster than the budget does, and right now writing code is cheap while confidence is scarce.

If that is the problem you are looking at, write me at [email protected].

Share
Comments

Hook this up to your favourite commenting platform — Giscus, Disqus, or your own.

Continue reading

Stay in the loop.

One email when it’s worth it — new posts and updates, no spam.

Free. Unsubscribe in one click.

Let’s talk

Let’s build something.

Tell me what you’re trying to solve. Your message comes straight to me — no sales team, no runaround — and I’ll reply personally, usually within a day.