Coinbase Cuts 90-Case Support Test to 30–45 Minutes

Coinbase’s Autopilot system shortened a roughly 90-case test of customer-support procedures from one to two weeks to 30–45 minutes, making it faster to check the playbooks followed by its support bots.

A Sept. 21 engineering disclosure describes simulated conversations with support bots. Autopilot records transcripts and tool outcomes, then grades them against expected behavior. AI agents can help draft test plans and variations, while a repeatable runner executes the tests.

The shorter cycle measures testing time. Coinbase provided no before-and-after figures for customer response times, resolution rates, satisfaction or errors tied to the process.

Support bots may check account state, perform limited actions and hand off cases requiring greater judgment. A person must approve changes to support procedures before they enter production. Coinbase does not say that each account action by a deployed bot requires human approval.

An AI model also scores adversarial test conversations, but those scores can be wrong. They inform human review and release gates; they do not independently determine whether a procedure is ready. The full automation loop, from identifying a weak support flow to promoting a revised procedure, remains in development.

Coinbase also describes Control Center as an internal platform for managing service access, approvals, audit records and rate limits across teams including support, compliance, legal, risk and engineering. Coinbase has not specified how broadly those controls apply to Autopilot or its support bots.