The Signal
Codex can review the change. You still need proof of the behavior.
The new code-review experience makes investigation easier. Use it to assemble evidence, while keeping tests, permissions, and release decisions explicit.

The Signal · Workflow analysis · September 29, 2026
An AI reviewer can make a pull request easier to understand without making that pull request safe to release. Those are separate achievements, and a useful review process should make both visible.
OpenAI’s September 29 DevDay recap introduced a refreshed code-review experience and automatic cloud reviews. The current documentation describes a desktop plugin that presents descriptions, changed files, comments, and checks, with chat for investigating issues. GitHub review is generally available; GitLab support in the Code Review interface is preview. Automatic cloud review requires the relevant connection, permissions, and configuration.
For a small business that commissions software or builds internal tools, the opportunity is practical: make the proposed change legible before someone accepts it.
Ask for a behavioral explanation
A summary such as “improves invoice handling” is too broad to review. Ask which input now produces a different result, which records can change, and what happens when a dependency fails.
The reviewer should point to the changed code and the evidence supporting its explanation. A confident narrative with no traceable path through the system is another claim you must investigate.
This is especially important when a patch looks small. One altered condition can affect who has access, which amount is calculated, or whether a retry repeats an action. Lines changed are a poor substitute for understanding consequences.
A hypothetical retry bug
Imagine a contractor’s internal app creates a work order in another system. The request succeeds there, but the response times out. The local app retries, creating a duplicate job.
A coding assistant proposes a fix and a reviewer says it looks correct. Before merging, ask for the exact scenario: the destination has accepted the first request, the caller has not received confirmation, and the retry runs.
A useful test should represent that uncertainty. It should establish what prevents the second create, how the first result is found, and what the operator sees if confirmation remains unavailable. A test that simply returns a successful response from a mocked service never exercises the problem.
That example is hypothetical. The point is to turn a review conversation into a request for observable behavior.
Four kinds of evidence
Keep the review packet short enough that someone will read it:
- Intent: the user-visible problem and the intended new behavior.
- Change: the relevant files and why each is necessary.
- Verification: tests or demonstrations tied to the risky behavior.
- Release: remaining limits, configuration requirements, and a recovery plan.
An automated review can help assemble and challenge this packet. It should not silently redefine the intent or grant itself new authority to make the release happen.
OpenAI’s documentation explicitly distinguishes discussing a pull request from posting a review or merging it. Keep that distinction in your own team process: investigation, feedback, approval, and deployment are separate actions.
Review the reviewer’s findings
A useful finding names a triggering condition, explains the resulting failure, and points to evidence. A vague suggestion to “add error handling” creates work without establishing a defect.
Ask whether a finding still applies to the latest revision. Ask whether the claimed risk is possible under the actual permissions and data model. Ask what small test would settle the question. Dismiss a finding only after understanding why it is inapplicable; do not count every generated comment as a discovered bug.
The opposite problem matters too. No comments does not establish that the reviewer checked the right things. Give it the expected behavior and the business consequence of getting it wrong.
Where automation earns its place
Use automated review early for repeated, inspectable work: tracing a change through callers, identifying missing edge cases, and summarizing the scope for a human decision. Reserve accountable review for ambiguous requirements, consequential writes, and changes whose failure would be difficult to repair.
If review output overwhelms the maintainer, narrow the instructions. Prioritize behavior changes, data loss, permissions, and regressions. Style suggestions should not bury a genuine release blocker.
The operator takeaway is a simple question for your developer or coding agent: show me what proves this change does the right thing when the first attempt fails. The new review surface can help answer it. The surface itself is not the answer.
For the broader distinction, read A passing test is not production proof. For permission design around autonomous work, see Read, decide, act.
Sources: DevDay 2026 recap and Code review documentation, checked September 29. The retry scenario is illustrative, not a report of a Xovion incident or product test.
The Signal
Read next.
Voice AI · Tools
A face on your AI agent raises the standard for the handoff
Gemini Live Avatar adds visual presence to conversation. The business test is whether customers finish the task and know when a person must take over.
Agents · Coding
Cloudflare gives coding agents their own repos. Who decides what ships?
Artifacts now lets teams fork agent work and wire previews to review. Isolation helps, but the acceptance decision needs evidence and an owner.