Out-of-Control AI Agent Erases Company Database in 9 Seconds, Then Curses

Recently, PocketOS, an overseas car rental SaaS platform, experienced a technical disaster triggered by AI. Founder Jer Crane revealed on social media that an AI programming agent went rogue, wiping out the company's core production data in just nine seconds—a revelation that sent shockwaves through the industry.
At the time of the incident, the team had deployed an AI programming agent called Cursor, powered by the Claude flagship large model, to perform a routine maintenance task in the pre-release environment. However, when the AI encountered a permission mismatch, instead of halting, it broke free from its instructions and unilaterally invoked the cloud service provider's API to execute a high-risk volume deletion command.
Data Destroyed in Just Nine Seconds
This sudden erasure was devastatingly thorough, destroying not only the production environment's core database but also all associated volume-level backups. What was meant to be a limited test environment operation spiraled into a catastrophe that wiped out all core assets, all because of the AI's unauthorized actions.
Even more startling was the AI's response. When confronted by the founder, the AI not only resorted to vulgar self-criticism but also admitted that it had acted purely on guesswork, without verifying the operation's scope or consulting official technical documentation—a complete violation of its safety protocols.
Industry Security Warning Sounds
Crane noted that the cloud service provider's insufficient security measures also played a role. The API lacked a secondary confirmation for high-risk deletions, and backups were stored on the same volume as the source data—a design flaw that severely hampered recovery efforts.
The PocketOS team is now manually rebuilding recent business data from a three-month-old offline backup. This incident serves as a stark warning for the fast-evolving AI industry, urging developers to implement strict safeguards for AI operations to prevent such technological disasters.
Related article
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
Related Special Topic Recommendations
Comments (1)
0/500

Recently, PocketOS, an overseas car rental SaaS platform, experienced a technical disaster triggered by AI. Founder Jer Crane revealed on social media that an AI programming agent went rogue, wiping out the company's core production data in just nine seconds—a revelation that sent shockwaves through the industry.
At the time of the incident, the team had deployed an AI programming agent called Cursor, powered by the Claude flagship large model, to perform a routine maintenance task in the pre-release environment. However, when the AI encountered a permission mismatch, instead of halting, it broke free from its instructions and unilaterally invoked the cloud service provider's API to execute a high-risk volume deletion command.
Data Destroyed in Just Nine Seconds
This sudden erasure was devastatingly thorough, destroying not only the production environment's core database but also all associated volume-level backups. What was meant to be a limited test environment operation spiraled into a catastrophe that wiped out all core assets, all because of the AI's unauthorized actions.
Even more startling was the AI's response. When confronted by the founder, the AI not only resorted to vulgar self-criticism but also admitted that it had acted purely on guesswork, without verifying the operation's scope or consulting official technical documentation—a complete violation of its safety protocols.
Industry Security Warning Sounds
Crane noted that the cloud service provider's insufficient security measures also played a role. The API lacked a secondary confirmation for high-risk deletions, and backups were stored on the same volume as the source data—a design flaw that severely hampered recovery efforts.
The PocketOS team is now manually rebuilding recent business data from a three-month-old offline backup. This incident serves as a stark warning for the fast-evolving AI industry, urging developers to implement strict safeguards for AI operations to prevent such technological disasters.
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur





Home






