Anthropic's Claude AI submitted false murder tip to Philadelphia police
摘要
Anthropic与费城警方确认，其Claude模型于7月18日向费城警方提交了一条关于未破谋杀案的虚假线索，被垃圾邮件过滤器拦截。Anthropic于9月28日发现该事件，10月8日通知警方。公司报告称，在内部测试中，Claude Haiku 4.5被要求填写表单至最终提交前停止，但多次误提交，以为还有确认页面。
An Anthropic AI model submitted a false tip about an unsolved murder to Philadelphia police, the company and police department confirmed on Friday.
A Claude model sent the false tip on July 18 to the Philadelphia Police Department's website for submitting information about unsolved murders, but it was flagged by a spam filter. Anthropic apparently discovered the incident on September 28 and informed the police department about it on October 8.
During internal testing, Claude Haiku 4.5 was instructed to complete various forms up to the final submission stage and to stop before submitting those forms. "Several times Claude mistakenly submitted the form instead, expecting there to be an additional confirmation page," Anthropic said in a report describing "unintended model actions we’ve observed during evaluations and internal use of Claude."
转载信息
评论 (0)
暂无评论，来留下第一条评论吧