← All insights

A team working together at computers in an office.

Plate · Forest canopy — a living system extended, not replaced

Essay

Augment, never abdicate: keeping people in charge

How to build AI that widens what a person can consider, then steps back — instead of quietly making the decision for them.

There is a quiet temptation built into every capable tool: to let it decide. It’s faster. It feels objective. And when something goes wrong, “the system recommended it” is a comfortable place to hide.

We think that temptation is the most dangerous thing about this moment — more dangerous than any single mistake an AI might make. Because the harm isn’t only a bad decision. It’s the slow disappearance of anyone who is answerable for it.

So we draw a hard line. AI should augment human judgment — and never let a human abdicate it.

In practice, that means a tool’s job is to widen what a person can see: surface the evidence, lay out the options, stress-test the assumptions, name the risks, show the trade-offs. Make the person who decides better-informed and harder to fool. And then — this is the part that’s easy to skip — step back, so that a person actually decides, and stays responsible for the decision.

A tool should never wear the crown.

This sounds obvious until you notice how much of the industry is quietly building the opposite: systems designed to be trusted instead of thought about, optimized to feel authoritative so you’ll stop checking. That design choice removes friction, and removes accountability with it.

We’d rather keep the friction. Every consequential answer we produce names a person who is accountable for it, before the fact. Every one can be questioned. None of them get to be the final word on their own.

The measure of a good decision tool is not how often people follow it. It’s whether the people using it end up more capable, more informed, and more clearly responsible than they were before. The day it would be easier to let the machine decide is the day this matters most — and the day we most need to refuse.