3 min read | Skills & Expertise AI

The Risk You Can't See Is the Risk AI Creates

Sabina Engdahl
Sabina Engdahl

AI-generated changes break at least 60% more often in codebases with poor code health. That number is probably understated — the research only covered code that already met a baseline health threshold. The truly messy, legacy-heavy parts of most enterprise codebases weren't even in the sample.

The Risk You Can't See Is the Risk AI Creates

That single finding reframes the conversation about AI-accelerated development. The question isn't whether AI introduces risk. It's whether you know where that risk is concentrating — and whether your QA practice is built to find it.

Risk Doesn't Distribute Evenly. AI Makes It Worse.

AI coding tools predict the next token based on patterns in training data. They don't reason about your architecture, your downstream dependencies, or the module three repositories away that relies on the function they just changed. The output compiles. It passes basic tests. And it still breaks downstream — usually in the parts of your system that were already fragile.

This is the pattern that peer-reviewed research from CodeScene confirmed: AI-generated changes concentrate defect risk exactly where your code is already weakest. Qodo's analysis of enterprise AI usage found the same dynamic from a different angle — output that looks correct but fails on edge cases the model never anticipated.

For a QA leader, this means your existing risk map just became more important, not less. And if you don't have one, the cost of not having it just increased significantly.

Testing Everything Equally Is No Longer a Strategy

Coverage targets made sense when development velocity was human-paced. At AI speed, they become a resource allocation problem that testing capacity cannot solve.

Risk-based QA allocates scrutiny based on the likelihood and impact of failure. Payment processing, authentication, data persistence, external integrations — these components warrant deeper review by default when AI has touched them. Lower-risk code gets lighter, automated checks instead.

This isn't about testing less. It's about deciding, deliberately, where human judgment actually pays for itself — and building the structures that make those decisions consistent rather than ad hoc.

The shift AI forces on QA leadership is exactly this: from managing a testing process to governing a risk framework. Those are different disciplines. The first is about throughput. The second is about accountability.

Where Judgment Still Lives

AI removes repetitive mechanical work. It doesn't remove the calls that matter: what a signal means in context, whether a structural risk is worth addressing now or later, what "good enough" looks like for this specific system under these specific conditions.

Tools like CodeScene's code health analysis surface where risk is building — which components are deteriorating, where AI activity is concentrating, and where defect probability is rising. That visibility is valuable. But deciding what to do about it is still a human call, made by someone who understands the business consequences of getting it wrong.

That's the judgment AI cannot replace. And it's the judgment that risk-based QA is designed to protect.

The Question Worth Asking in Your Next Leadership Meeting

Do you know where in your codebase AI is generating the most code right now? Do you know whether that overlaps with your highest-risk components? And do you have explicit verification gates — defined upfront, not improvised per sprint — for what needs human review versus what can pass on automated checks alone?

If those answers aren't immediate and unambiguous, your QA practice is running behind your AI adoption. The gap between them is where risk accumulates quietly — until it doesn't.

The question was never just "does it work?" It's "can we trust what it's building, and do we know where to look when we can't?"

Sabina Engdahl
Sabina Engdahl
Group Digital Marketing Officer at System Verification.