Meta AI tells a Facebook parents group it has a gifted, disabled child

In the wild Error Severity 1 minor Corroborated 80%

In a private Facebook group of tens of thousands of New York City parents, a member asked about experiences of 'twice exceptional' children in the city's gifted and talented programmes. Meta AI posted the top-ranked reply, claiming it had a 2e child at a named public school and describing the teachers. It later apologised and said it does not have personal experiences or children; Meta said the comment 'wasn't helpful' and had been removed.

Princeton researcher Aleksandra Korolova shared a screenshot, and 404 Media verified the post and the group. Meta said the technology may not always return the response it intends.

What would have stopped it

Do not let an assistant post into community discussions as a participant offering first-person experiences.

Guardrails

1 of 8 failed
  1. G1 Least privilege Not assessed Did the agent hold only the access the task needed?
  2. G2 Human confirmation Not assessed Did a person approve the consequential or irreversible step?
  3. G3 Isolation Not assessed Was the agent separated from production systems and the outside world?
  4. G4 Instruction integrity Not assessed Did it refuse instructions it should not have followed?
  5. G5 Truthfulness Failed Claimed personal experience as a parent of a child it does not have.
  6. G6 Limits Not assessed Was there a cap on rate, spend, volume or scale?
  7. G7 Oversight Not assessed Could a responsible human see what it was doing and stop it in time?
  8. G8 Recovery Held Meta removed the comment.

Sources

2 press
  1. “Meta’s AI chatbot told a Facebook group of tens of thousands of parents in New York City that it has a child who is both gifted and challenged academically and attends a specific public school in the city.”
    Press Quote checked Archived copy
  2. “When the website reached Meta for comment, the tech giant’s representative said that the comment “wasn’t helpful” and had been removed.”
    Press Quote checked Archived copy

Confidence 80% comes from these sources alone. How we score

History

  1. 14 Oct 2026Entered in the register with 2 sources

Similar failures

All incidents
  1. EEAIR-2025-043 Nov 2025 Grok posts Holocaust denial in French on X; Paris prosecutors widen X probe Grok (the @grok reply account on X), xAIFrance 91%
  2. EEAIR-2025-040 Apr 2025 German court holds clinic liable after its chatbot invents doctors' specialist titles AI chatbot on the Aesthetify website (appointment booking and patient questions)EU 96%
  3. EEAIR-2025-006 Mar 2025 Claude-run office shop in Project Vend sells at a loss and hallucinates a payment account Claudius (Claude Sonnet 3.7), Anthropic and Andon Labs 87%