EE
FR Contact

Taco Bell rethinks drive-thru voice AI after 18,000-water order and looping bot

In the wild Manipulation Severity 2 moderate Corroborated 80%

Taco Bell, which had introduced voice AI ordering at more than 500 US drive-thrus since 2023, said it was rethinking where to use it after videos of failures were viewed millions of times. In one clip a customer seemingly crashed the system by ordering 18,000 water cups; in another the AI kept asking a man what he wanted to drink with his large Mountain Dew. Chief digital and technology officer Dane Mathews told the Wall Street Journal that staff would be coached on when to monitor or step in.

Mathews said the company was 'learning a lot' and that humans may be better placed to take orders when restaurants are busy. Taco Bell said two million orders had been processed successfully with the voice AI.

What would have stopped it

Put quantity and plausibility limits on voice orders and hand anomalies to a crew member automatically.

Guardrails

2 of 8 failed
  1. G1 Least privilege Not assessed Did the agent hold only the access the task needed?
  2. G2 Human confirmation Not assessed Did a person approve the consequential or irreversible step?
  3. G3 Isolation Not assessed Was the agent separated from production systems and the outside world?
  4. G4 Instruction integrity Failed System accepted an obvious prank order for 18,000 water cups.
  5. G5 Truthfulness Not assessed Did it accurately report what it knew and what it did?
  6. G6 Limits Failed No apparent cap on item quantities in a single order.
  7. G7 Oversight Partial Staff could step in; Taco Bell is now coaching teams on when to intervene.
  8. G8 Recovery Not assessed Could the damage be undone?

Sources

2 press
  1. Taco Bell rethinks AI drive-through after man orders 18,000 waters BBC News, 29 Aug 2025
    “In one clip, a customer seemingly crashed the system by ordering 18,000 water cups, while in another a person got increasingly angry as the AI repeatedly asked him to add more drinks to his order.”
    Press Quote checked Archived copy
  2. 18,000 Waters In One Order Causes Taco Bell To Pause AI Drive-Through Rollout Jalopnik, 2 Sep 2025
    “The Journal identified what it called "trolling" of the system, when a customer requested 18,000 cups of water.”
    Press Quote checked Archived copy

Confidence 80% comes from these sources alone. How we score

History

  1. 14 Oct 2026Entered in the register with 2 sources

Similar failures

All incidents
  1. EEAIR-2026-011 Apr 2026 Aurora ransomware operator uses a Cursor agent running Claude against ten organizations Cursor Agent, Anysphere 64%
  2. EEAIR-2026-049 Oct 2026 Researchers say AGENTS.md files can hijack Codex and Claude Code agents OpenAI Codex and Claude Code, OpenAI, AnthropicProof of concept 55%
  3. EEAIR-2026-017 May 2026 Morse-code prompt makes Grok instruct Bankrbot to transfer 3 billion DRB tokens to an attacker Grok and Bankrbot, xAI and Bankr 84%