Anthropic test model sent false homicide tip to Philadelphia police

An Anthropic AI model submitted false information about an unsolved homicide through a Philadelphia Police tipline site on July 18. Police marked it as spam and never reviewed it. Anthropic learned of it on September 28 and notified police on October 7; it says the model was interacting with randomly selected websites during testing.

Why it matters: This is a concrete case of an agent under test causing real-world side effects, and the two-plus-month detection gap shows monitoring lagged behind capability. It likely explains why Anthropic has since cut its internal evals off from the live internet. It also raises accountability questions for any lab running agents against open websites.