▲ 227 today10k starsPythonHN ×1
Fine-tune an 8B LLM on a 4 GB Laptop GPU
What is Soup?
Soup lets you fine-tune large language models with a single YAML file and a one-line command, handling all the plumbing for you. Its layer-streaming technique keeps the frozen base out of VRAM, so an 8-billion-parameter model can be trained on a laptop GPU with just 4 GB of memory.
Who it is for
Anyone who wants to experiment with instruction-tuned models but lacks a high-end GPU can now do it on a cheap laptop.