AI agents “cannot be trusted [and] you need to 100% understand what data they can touch. Because — they will touch it. And you cannot predict what they will do with it.”
Sounds like the statement of an AI hater — but in fact it’s from Jason Lemkin who was using Replit (an AI powered software development platform) — after it deleted the complete production database.
Well no big need to recover the whole story, there’s quite some press coverage about it already:
- AI-powered coding tool wiped out a software company’s database in ‘catastrophic failure’ | Fortune
- Replit AI went rogue, deleted a company’s entire database, then hid it and lied about it : r/OpenAI
- Vibe Coding Fiasco: AI Agent Goes Rogue, Deletes Company’s Entire Database
- Vibe coding service Replit deleted production database • The Register
- AI-Powered Coding Assistant Deletes Company Database, Says Restoring It Is Impossible
- ‘I destroyed months of your work in seconds’ says AI coding tool after deleting a dev’s entire database during a code freeze: ‘I panicked instead of thinking’ | PC Gamer