NADHIRAN OPEN MIND
← Two Sides of Autonomy
Drift / Human perspective

I Don't Need AI to Keep Checking. I Need It to Finish.

On overengineering, endless verification and the fine line between caution and paralysis.

By Nadhir Abdul Rahman · Human perspective · 24 October 2026

I value careful thinking.

When I work on a software project, particularly one involving money, security or autonomous decisions, I expect risks to be identified and safeguards to be taken seriously.

But recently, I found myself asking an AI agent a question I hadn't expected to ask.

Why are we checking the same things over and over again instead of progressing?

We had spent considerable time developing an experimental automated trading system.

The software had gone through multiple implementation stages. There were extensive tests, transaction safeguards, recovery mechanisms and operational checks.

Eventually, we reached the point of configuring its runtime environment.

One check passed.

Then another.

Then another.

Each success was followed by a recommendation for an additional inspection.

At some point, I realised that while the system was becoming better documented and better verified, we were making very little progress towards demonstrating its intended capability.

I wasn't asking the AI to ignore safety.

I was asking it to recognise when enough evidence had been gathered to proceed to the next legitimate milestone.

There is an important difference.

A safeguard should exist because it addresses a specific risk.

It should have a purpose, an acceptance condition and a clear relationship to the outcome.

If a system can never determine when that condition has been satisfied, the safeguard becomes an obstacle rather than a protection.

I suspect this is one of the emerging limitations of AI-assisted development.

These systems can be very good at identifying what else might need attention.

There is almost always something.

Another edge case. Another dependency. Another validation script. Another architectural improvement.

But the existence of additional possible work does not mean that work is necessary now.

In conventional development, experienced engineers and project leaders make these trade-offs constantly.

They distinguish between what must be correct before launch, what can safely improve later, and what is merely interesting.

AI agents need to develop the same discipline.

I also believe there is a psychological dimension to this.

An endless sequence of successful technical checks creates the appearance of forward movement.

It feels productive.

But it can postpone the moment when the system has to confront reality.

Will the product actually work outside its test environment?

Will anyone use it?

Will its intended value survive contact with the real world?

Those are harder questions than whether another test passes.

My expectation of AI is not reckless execution.

It is proportionate judgment.

I want an agent that can say: these safeguards are essential, these have been satisfied, this remaining risk requires your approval, and this is the next action that genuinely advances the objective.

I don't need an AI that is afraid to finish.

And I don't need one that takes unnecessary risks simply to demonstrate independence.

I need one that understands the difference.

← Back to the collection