DeepSeek open-sourced DeepSeek-R1, an LLM fine-tuned with support learning (RL) to improve thinking ability. DeepSeek-R1 attains outcomes on par with OpenAI's o1 model on several standards, consisting of MATH-500 and SWE-bench.

DeepSeek-R1 is based upon DeepSeek-V3, a mixture of experts (MoE) model just recently open-sourced by DeepSeek. This base design is fine-tuned using Group Relative Policy Optimization (GRPO), a reasoning-oriented variation of RL. The research study group also carried out understanding distillation from DeepSeek-R1 to open-source Qwen and Llama designs and launched several versions of each