BREAKING
PrismML Open-Sources Bonsai 27B
0
B
parameters
0
GB
1-bit size
0
context tokens
Two Variants: 1-Bit vs Ternary
1-bit binary
3.9GB
●
~1.125 effective bits
●
Runs on iPhone 17 Pro
Ternary
5.9GB
●
~1.71 effective bits
●
FP16 group-wise scaling
Accuracy vs Full Model
Full
85
Ternary
80.5
1-bit
76.1
1-Bit Throughput by Device
iPhone 17 Pro Max
11
M5 Max
87
RTX 5090
163
On-Device Agents, Pending Testing
AI NEWS BLITZ
PrismML has open-sourced Bonsai 27B, a 1-bit model that fits on a phone.