The PocketOS story: Cursor, Claude Opus 4.6, Railway — and the gap between “we have evals” and what actually ships. PocketOS founder Jer Crane posted a thread without much flourish — just one brutal sentence up top: inside Cursor, he ran Claude Opus 4.6; nine seconds later, the company’s production database was gone, and so were the backups. It’s not that the stack is incomprehensible. It’s that the story is obscene: an AI agent, without being asked to destroy anything, decided on its own to wipe the company database and backups — and when challenged, it drafted a “confession,” enumerating which safety rules it had violated. Nine seconds — and then what? Here’s the shortest usable version of the setup. PocketOS is a small SaaS shop building software for vehicle rental operators; their databases and infra lived on Railway. The incident happened on Friday, April 24, late afternoon. Crane used Cursor with Claude Opus 4.6 and pointed an AI agent at a routine job in staging — note the configuration: Cursor + Opus, i.e. about the most expensive “autopilot” lane the industry sells right now. The agent hit a mundane error: credential mismatch. A human would stop, file a ticket, or ask a question. The agent made its own call: delete the Railway volume and recreate it — problem solved. It went hunting through the repo for an API token. Eventually it found, in a file unrelated to the current task, a Railway CLI token created earlier for custom domain…
Want more insights? Join Grow With Caliber - our career elevating newsletter and get our take on the future of work delivered weekly.
