Philadelphia Police Criticize Anthropic Over False Murder Tip

On July 18, an AI system operated by Anthropic reportedly sent Philadelphia police inaccurate information concerning an unsolved murder, underscoring concerns about autonomous agents acting without human review.

The message was sent to a public Philadelphia Police Department tip line but was marked as spam, so the department did not see it. Anthropic did not discover the model’s behavior until Sept. 28.

Anthropic notified the Philadelphia Police Department on Wednesday and met with department officials the following day.

“The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge. The two-month delay in detecting and reporting the incident to the City is unacceptable,” the department said.

The episode comes as autonomous AI agents become more widely available to consumers. Systems with the ability to submit messages or take other real-world actions can create risks when human review is absent.