▲ 608 today2.7k starsRustHN ×1
Rust inference engine uzu promises zero-latency on-device AI
What is uzu?
uzu is a Rust-based inference engine that runs AI models directly inside your application without sending data to the cloud. It offers a simple high-level API, supports many models, and leverages Apple’s unified memory for fast, private inference.
Who it is for
Developers who need fast, private AI in their apps can drop uzu in and run models locally at no extra inference cost.