← All Posts

JustVugg/colibri — 34,067 Stars

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk.

shorts ID: shorts-JustVugg-colibri #shorts#justvugg#colibri

Watch Episode

About This Repo#

JustVugg/colibri — 34,067 ⭐ | C

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk.

Narration#

colibri. Run frontier AI models on the hardware you already own. Pure C, zero dependencies. Instead of loading everything into memory, it streams each expert from disk on demand, so a seven hundred billion parameter model fits on a normal laptop. CPU, CUDA, Metal — all from one tiny engine. Thirty-four thousand stars. Open source.

Watch#