Basic information
Model repository: deepseek-ai/DeepSeek-R1
Organization: deepseek-ai
Tasks: Not provided
Architecture and runtime
Model type: deepseek_v3
Architecture: Not provided
Libraries: safetensors, pytorch
Base models: Not provided
Current revision: master
License and update history
License: mit
Created: 2025-09-18
Last updated: 2025-09-19
Hardware requirements
参考配置（非官方最低要求）：官方模型卡列出总参数 671B，每个 token 激活参数约 37B。全模型 FP8 权重约 680 GB，BF16 约 1.35 TB。FP8 分布式推理可先按约 800 GB 合计显存估算，并额外预留 KV cache 与运行时显存。工作站也可考虑较小的蒸馏版本。 Inference reference: the official card lists 671B total and about 37B active parameters per token. Full-model FP8 weights are roughly 680 GB and BF16 roughly 1.35 TB. Use distributed multi-GPU inference; allow at least about 800 GB aggregate VRAM for FP8, plus KV-cache/runtime headroom. This is an estimate, not an official minimum; distilled variants are more suitable for workstations.
Download links
Basic usage example
启动 vLLM 多卡服务 / Start multi-GPU vLLM server
# Example for a multi-GPU host; size parallelism to the available hardware.
pip install -U "vllm>=0.23.0" openai
vllm serve deepseek-ai/DeepSeek-R1 \
--tensor-parallel-size 8 \
--pipeline-parallel-size 2 \
--max-model-len 32768 \
--trust-remote-code调用 OpenAI 兼容接口 / Call the OpenAI-compatible API
from openai import OpenAI
client = OpenAI(api_key="EMPTY", base_url="http://localhost:8000/v1")
response = client.chat.completions.create(
model="deepseek-ai/DeepSeek-R1",
messages=[{"role": "user", "content": "请简要解释混合专家模型（MoE）的工作方式。"}],
max_tokens=512,
)
print(response.choices[0].message.content)