AdvertiseWatchSubscribe
Last scan 55 h agoMonday, November 16, 2026

328 points69 comments

LLMs now run on old TV boxes and decade-old iPads

LLMs

I'm making LLMs work on small and old devices: preview

What is I'm making LLMs work on small and old devices?

smolmaxxing finds the biggest language model a low-end device can actually run and then pushes it further with custom kernels, smarter memory handling and weight streaming. It demonstrates a 0.8 B-parameter model at 16 tok/s on a cheap TV box and a 1.7 B model at 25 tok/s on a 2013 iPad.

Who it is for

If you have spare hardware, you can get useful LLM inference without buying a new GPU.

The morning email · free

Get tomorrow's biggest AI launches before everyone else.

One short email each morning: what launched, why it matters, how to try it. Five minutes, no spam, unsubscribe any time.

The story so far

Early Signal first spotted I'm making LLMs work on small and old devices on November 12, 2026, with 328 points. On its busiest day it gained 83 points. Early Signal files it under LLMs.

Get the signal first.

Join the list for the morning email: the day's biggest AI launches, explained in five minutes. Unsubscribe any time.

Prefer a reader? Follow the RSS feed.