▲ 351 today9.4k starsCHN ×2
2.78-trillion-parameter Kimi K3 runs on a laptop CPU
What is kimi-k3-in-c?
The repo implements inference for the 2.78-trillion-parameter Kimi K3 model in plain C99, requiring no GPU, BLAS libraries, or special frameworks. It can generate text on a single CPU using as little as 8 GB of RAM, streaming the 1.56 TB checkpoint from disk.
Who it is for
Developers and researchers who want to experiment with massive language models on modest hardware can run the model locally without costly cloud GPUs.