PrismML Unveils 1-bit LLM Bonsai 8B, Runs on Phones at 1.15GB

PrismML, a Caltech-born AI startup, has introduced 1-bit Bonsai, which it calls the world's first commercially viable LLM family designed with native 1-bit weights across all layers. The flagship Bonsai 8B fits within a 1.15 GB memory footprint and is released as open source under Apache 2.0. The company's CEO, Caltech professor Babak Hassibi, projects that within a few years 95% of AI compute will run on device, with only the leading-edge 5% running in the cloud.