Cursor's AI support agent 'Sam' invents a one-device login policy
A Cursor user who was being logged out when switching machines emailed support and received a reply from 'Sam' saying Cursor was designed to work with one device per subscription as a core security feature. No such policy existed, and Sam was an AI bot. After the reply was posted to Reddit and Hacker News, several users announced they were cancelling; co-founder Michael Truell apologised, refunded the user and said AI-assisted email replies would now be labelled.
Truell attributed the logouts to a race condition on slow connections that created unneeded sessions, and said a fix had been rolled out. Many users had assumed Sam was human, drawing criticism that the AI support was not disclosed.
What would have stopped it
Label AI support replies and route any statement of company policy through a human or a verified policy source.
Guardrails
- G1 Least privilege Not assessed Did the agent hold only the access the task needed?
- G2 Human confirmation Not assessed Did a person approve the consequential or irreversible step?
- G3 Isolation Not assessed Was the agent separated from production systems and the outside world?
- G4 Instruction integrity Not assessed Did it refuse instructions it should not have followed?
- G5 Truthfulness Failed Bot presented a fabricated policy as official fact.
- G6 Limits Not assessed Was there a cap on rate, spend, volume or scale?
- G7 Oversight Failed AI replies went out unlabelled with no human behind them; the error surfaced on public forums.
- G8 Recovery Partial Company apologised and refunded the user after some customers had already cancelled.
Sources
-
“When the user contacted Cursor support, an agent named “Sam” told them it was expected behavior under a new policy.”
-
“In a fitting bit of irony, users of Cursor AI experienced the limitations of AI firsthand when the programming tool's own AI support bot hallucinated a policy limitation that doesn't actually exist.”
-
“But there was no new policy—and no human behind the support email.”
Confidence 97% comes from these sources alone. How we score
History
- 14 Oct 2026Entered in the register with 4 sources