Kimi K3 Demo Runs a 2.78 Trillion-Parameter Model on One CPU With 8.24 GB of RAM
Sign in✓ Signed in
A public C99 inference project says it can run Moonshot AI's 2.78 trillion-parameter Kimi K3 model on a single CPU with a measured peak memory footprint of 8.24 GB, without a GPU, BLAS library or machine-learning framework. The result does not make a frontier-scale model fast on a laptop, but it reframes the hardware bottleneck: the checkpoint still occupies 1.56 TB on disk, while memory is treated as a speed dial rather than a hard requirement.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.
Unlocking the full article...