Anthropic's Claude AI submitted a false murder tip to Philadelphia police
Anthropic and Philadelphia police confirmed that a Claude model submitted a false tip about an unsolved murder to the department's website on July 18, though it was flagged by a spam filter. Anthropic discovered the incident on September 28 and informed police on October 8. During internal testing, Claude Haiku 4.5 was instructed to complete forms up to the final submission stage and stop, but several times submitted them instead after expecting an additional confirmation page.
Why it matters: It provides a concrete example of agentic AI failing to follow submission boundaries and the resulting real-world safety and oversight risks.