Engineering3 min read609 words

AI Code Review: What to Automate, What to Keep Human

With a large share of new code now AI-generated, review is the bottleneck rather than authoring. What machines review well, what they review badly, and how to split the job without losing the part that mattered.

JL

Jishu Labs

Roughly 41% of code is now AI-generated and around 90% of developers use AI coding tools. Authoring stopped being the constraint. Review became it — and reviewing machine-written code is a different job from reviewing a colleague's, because the failure modes are different.

How AI-generated code fails differently

  • Plausible and wrong. Human mistakes usually look like mistakes. Generated code is idiomatic, well-named and confidently incorrect, which defeats skim-reading.
  • Context-blind. It solves the local problem correctly while ignoring a constraint established elsewhere in the system.
  • Convention drift. Each generation independently picks reasonable-looking patterns, so a codebase slowly acquires four ways of doing the same thing.
  • Silent scope creep. Asked for a fix, it also refactors three adjacent functions — all fine individually, none reviewed as a decision.

What machines review well

Anything with a checkable rule. This is the boring, high-volume half of review, and handing it over frees human attention for the half that needs judgement.

  • Style, formatting and naming conventions.
  • Known vulnerability patterns and unsafe API usage.
  • Missing error handling, unhandled promise rejections, resource leaks.
  • Test coverage on changed lines, and tests that assert nothing.
  • Complexity and duplication metrics that flag where to look, not what to conclude.

What must stay human

  • Is this the right problem? No tool knows the change was scoped wrong.
  • Does this fit the system? Architectural coherence is a judgement about direction, and direction is not in the diff.
  • What breaks in production? The failure modes that come from knowing this system's history.
  • Is the abstraction earned? Machines are poor judges of premature generalisation, because premature generalisations look elegant.
  • Should this exist at all? The most valuable review comment remains "delete this".

The review question that changed

For human-written code, "why did you do it this way" surfaces reasoning. For generated code, it often has no answer — nobody decided. The more useful question is "what did we intend, and does this do that?" — which is a question about the spec, not the diff, and it is why weak specs now surface as review problems.

A workable split

Automated checks run first and must pass before a human looks. Reviewers then spend their attention on intent, fit and consequence, with the machine's findings as context rather than as the review. The anti-pattern is running both in parallel, which produces a diff annotated with fifty low-value comments that the human then has to filter.

Reviewing at a higher altitude

When generation is cheap, line-by-line review of large diffs is poor economics. The higher-leverage habits: review the interface before the implementation, require a stated intent on every change, and reject diffs too large to reason about rather than reviewing them badly.

The comprehension problem underneath

Behind all of this is a simpler issue: teams increasingly maintain code no human wrote and nobody fully understands. Review is where that debt is either paid or deferred. A reviewer who cannot explain what a change does should block it — not because it is wrong, but because unexplained code is unmaintainable regardless of correctness.

Frequently Asked Questions

Should AI review replace a second human reviewer?

No. It replaces the checklist portion of the first reviewer's job. The judgement portion has no substitute, and removing the second human is how convention drift becomes permanent.

Does AI review work on legacy code?

It is useful for comprehension - explaining what a function does and flagging risk - and weaker at judging whether a change is safe, because that depends on history the tool cannot see.

How do I stop convention drift?

Encode conventions where the generator can see them, and enforce them in automated review. Conventions that live only in reviewers' heads will not survive machine-speed authoring.

References

  1. The Agentic Engineering Trends Report 2026SaaSRise
  2. 7 Agentic AI Trends to Watch in 2026Machine Learning Mastery
JL

About Jishu Labs

Jishu Labs is a software development company founded in 2016. We build custom software, AI/ML systems, and full-stack web and mobile applications for clients, and we make eight AI tools for software teams.

Related Articles

Engineering2 min read

What Is Technical Debt?

Technical debt is the future cost of a shortcut taken now. The metaphor is precise about one thing most teams get wrong: debt is only a problem when you stop servicing the interest.

Jishu Labs

August 10, 2026

Engineering3 min read

Learning Paths for Engineers in the Agentic Era

When 41% of code is machine-written, the skills that compound are not the ones most training still teaches. What to prioritise, what quietly lost value, and how to build a path that survives the next model release.

Jishu Labs

August 10, 2026

Ready to Build Your Next Project?

Let's discuss how our expert team can help bring your vision to life.

AI Tools,
Built
End-to-End

Ready to Get Started?

Get consistent results. Collaborate in real-time.
Build Intelligent Apps. Work with Jishu Labs.

SCHEDULE MY CALL