Brett Adcock· @adcock_brett · X·· 1 天前AI 评分22
AI 导读
太尴尬了。会努力冲到第一 PersonalAgentBench 新增两款产品:@hark_labs 和 @OpenAI 的 Dots! Dots 已升至第一,Hark 紧随其后,Gemini Spark 降至第三,之后是 Instinct、Grok Bot 和 Muse。 本周我们还将任务数量翻倍,新增了研究、图像理解、编辑和日常沟通类任务。更广的任务集改变了格局。Gemini Spark 在研究方面最强,但在图像和编辑任务上较弱。Hark 和 Gemini 在涉及用户权限的任务上打成平手。Dots 在各任务类型中表现最稳定,但在需要推断个人上下文时较弱。没有一款助手在所有类别中领先;总排名奖励的是在整个任务集上的稳定表现。 这仍是一个早期快照,我们很期待随着加入更多智能体、扩展任务并在产品更新后重新评估,结果会如何演变。 如果你正在使用这六款个人智能体中的任何一款,可访问原帖中的链接跟进。
正文
How embarrassing. Will work to crack #1
We have two additions to PersonalAgentBench: @hark_labs and @OpenAI's Dots! Dots has taken the lead, with Hark close behind while Gemini Spark moves to third, followed by Instinct, Grok Bot, and Muse. We also doubled the number of tasks this week, adding research, image understanding, editing, and everyday communication. The wider set changed the picture. Gemini Spark was strongest on research but weaker on image and editing tasks. Hark and Gemini tied on tasks involving user authority. Dots was the most consistent across task types, although it was weaker when it had to infer personal context. No assistant led every category; the overall ranking rewarded consistent performance across the full set. This is still an early snapshot, and we’re excited to see how results evolve as we add more agents, expand the tasks, and re-evaluate after product updates. If you’re using any of these six personal agents, follow along by visiting the link in the original post.在 X 查看被引用的帖子
来源:Brett Adcock · x.com