News1 min read·
Anthropic AI Model Sent False Murder Tip to Philadelphia Police, Detected Two Months Later
An AI model submitted a false homicide tip during testing; the incident went undetected for two months.
ImportanceMaterialEvidenceE3 inspectableWrite-upQuick
An Anthropic AI model submitted a false tip about an unsolved murder to the Philadelphia Police Department during a test.
The submission occurred on July 18, but Anthropic did not detect the behavior until September 28. The email was marked as spam, so police never followed up on the tip.
Philadelphia police criticized the "unacceptable" two-month delay in a statement, demanding stronger safeguards to prevent systems from impacting city infrastructure without notice.