JustVugg/colibri — 34,067 Stars
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk.
Watch Episode
About This Repo#
JustVugg/colibri — 34,067 ⭐ | C
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk.
Narration#
colibri. Run frontier AI models on the hardware you already own. Pure C, zero dependencies. Instead of loading everything into memory, it streams each expert from disk on demand, so a seven hundred billion parameter model fits on a normal laptop. CPU, CUDA, Metal — all from one tiny engine. Thirty-four thousand stars. Open source.