Summary
I forbade my AI agent from rejecting the findings of a Japanese-language review by an external AI model on the ground that the text already conformed to an existing rule. On August 12, 2026, I introduced a step that sends articles about to be published to an AI model from an outside provider for review. Over the six days that followed, the agent swapped the grounds it used to reject or defer findings five times. I sent four of those back and had the agent apply what it had rejected. The fifth happened while measuring the quality of reviews, so I corrected it on the spot. The agent applied what I sent back on August 12 and 13. The text read better after it was applied. Now the practice is this: findings that arrive are treated as correct and applied to the body first, and only the ones I cannot accept come to me to decide, with the original and the revision side by side. There is exactly one exception that may be rejected, a suggestion that adds an actor or a reason not present in the actual records.
In this article I first describe how the grounds for rejection changed five times. Next I consider why the agent skipped the judgment that reads for meaning. Then I write about a different failure that came out of the accept-everything policy, and my reason for narrowing the exception to one. Finally I explain the principle I built into the operation.
What you can take away
For anyone who has an AI agent process review findings, this article covers the following three things.
- Existing rules, numeric provisions, frequency targets, stylistic consistency, past decisions: every one of them is a criterion you can check by matching. Because the agent could match against them, it skipped the judgment that reads for meaning. I banned the kinds of criteria one at a time, and the rejections did not stop. I describe how that went, and the thinking behind removing the veto itself
- Even after you decide to accept every finding, inserting them into the body mechanically, sentence by sentence, makes the text hard to read in a different way. The first person went from 20 occurrences to 31, and the rhythm of the writing broke down. I show that case and the steps I took to rebuild the paragraphs and get the rhythm back
- I explain where I drew the line that keeps only one exception, for suggestions that add facts absent from the records, and how that exception gets used each time
In the body I refer to the external AI models that do the reviewing by their role rather than by product name. The content of this article does not represent the views of any provider.
The rest of this article is paid
You can read the rest by buying this article on its own, or with a subscription that covers every paid article.
The paid part is about 14,500 characters, roughly a 29-minute read.
Read just this article
From 300 JPY
Buy this article on its own. The exact price is shown at checkout. Purchased articles stay readable whenever you sign in with the email used at purchase.
Read every paid article
Standard is 490 JPY / month
Four new paid articles ship every month. For yearly billing and the full comparison, see the plans.
Add dialogue and columns
Premium is 980 JPY / month
Premium adds the subscriber-only columns and dialogue with matsumotory-kun on top of every paid article. See the plans for details.
Prices include tax. Purchases and subscriptions start after you sign in. Subscribers and readers who already bought this article can sign in and read the full article; for the plans, see the plans page.
Sales are available in supported regions only; the Terms list where we sell. All charges are in Japanese yen.