New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问我要运行推理，需要什么显卡配置 #241

Open

XksA-me opened this issue Jan 8, 2025 · 2 comments

XksA-me commented Jan 8, 2025

用多少卡4090可以哇，或者H100需要多少卡

mgisr commented Jan 8, 2025

”DeepSeek-V3 采用 FP8 训练，并开源了原生 FP8 权重。“
参数量按700B算的话，大约就是700GB显存。

Author

XksA-me commented Jan 8, 2025

”DeepSeek-V3 采用 FP8 训练，并开源了原生 FP8 权重。“ 参数量按700B算的话，大约就是700GB显存。

谢谢回复

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment