swyx· @swyx · X·· 9 小时前AI 评分75
AI 导读
DeepSeek 开源自研推理框架 DeepInfer，称其支撑 DeepSeek-V4.1-Flash 的大规模推理服务，单集群吞吐达 155 万亿 token/天，单卡收入为每小时 38 美元（按非高峰价格计算）。swyx 指出 DeepSeek 在知乎发布了更多细节，并称按 GPU 每小时约 5-10 美元的成本估算，DeepSeek 按其定价可对应约 80% 的服务利润率。
正文
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff
"Based on this framework, we have implemented a high-throughput, low-latency large-scale inference service for DeepSeek V4.1 Flash. Currently, the service throughput of a single cluster is 155 trillion tokens/day, and the overall revenue is $38 per card per hour (based on off-peak prices)."
it costs roughtly $5-10 per gpu hour so depseek is claiming 80% serving margin at THEIR prices lololololol
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源：swyx · x.com