▲ 2.9k today20.2k starsPython
DeepInfer delivers high-throughput inference for DeepSeek models
What is DeepInfer?
DeepInfer is an open‑source Python framework that runs DeepSeek‑V4.1‑Flash models at production speed. It bundles optimized kernels, parallel attention and a zero‑overhead batch scheduler so you can serve large language models offline without hand‑crafting low‑level code.
Who it is for
If you need to run DeepSeek LLMs in production or on‑prem, DeepInfer lets you get fast, deterministic results without building the inference stack yourself.
The numbers
| Project | deepseek-ai/DeepInfer |
|---|---|
| Type | Repo |
| GitHub stars | 20.2k |
| Gained in a day | ▲ 2,892 |
| Language | Python |
| First spotted by Early Signal | 23 Oct 2026 04:58 UTC |
| Seen on | GitHub new, Hacker News |