▲ 152 today7.5k starsRustHN ×3
Open-source inference engine claims 2× speed boost on any hardware
What is magnitude?
Magnitude auto-tunes low-level kernels for each model so they run as fast as your CPU, GPU, or Apple Silicon can handle. It bundles a desktop app and CLI, and plugs into popular AI agents with a single click.
Who it is for
If you run local LLMs and want them to be noticeably faster without paying for a cloud service, Magnitude gives you a free, private way to squeeze extra performance.
How to try it
curl -fsSL https://magnitude.dev/install.sh | sh