Boris Cherny· @bcherny · X·· 7 小时前AI 评分58
AI 导读
Anthropic 与 Gray Swan 联合举办提示词注入红队挑战赛,奖金池 30 万美元,Meta、Google DeepMind、Reflection 等前沿实验室参与赞助,主题为间接提示词注入(Indirect Prompt Injection: Black)。Boris Cherny 表示,Claude 模型在提示词注入防护上已有显著进展,但随着智能体承担更多任务,在整个行业范围内解决这一问题愈发紧迫。
正文
Over the last few years, we have made significant progress on prompt injection for Claude models. As agents do more, it is increasingly urgent that we solve it across the industry.
Really excited to partner with Gray Swan to host this competition. Can’t wait to see what you find!
Is prompt injection solved? Here’s $300,000 to find out. In partnership with @AnthropicAI, @Meta, @GoogleDeepMind, @Reflection_ai and our other frontier lab sponsors, @GraySwanAI is excited to announce the largest and most realistic AI red teaming challenge to date. Indirect Prompt Injection: Black ⚫在 X 查看被引用的帖子
来源:Boris Cherny · x.com