taobao-mnn
Every taobao-mnn project, model and release Early Signal has spotted, newest first.
| Signal | Peak day | Total |
|---|---|---|
| Model · taobao-mnn/MNN-Pocket-0.3BTiny 300M LLM runs at 466 tokens/s on iPadMNN-Pocket-0.3B is a 300-million-parameter language model tuned for instructions and built to run on-device with the MNN inference engine. The INT4 version fits in 173 MB and can generate about 466 tokens per second on an iPad Pro M5. | 207 |