BREAKING
PrismML Unveils 1-bit LLM Bonsai 8B
0
B
parameters
0
GB
memory footprint
0
bench avg
0
x
smaller
0
x
faster
0
x
more efficient
Inference Speed by Device
iPhone 17 Pro Max
44
M4 Pro MacBook
131
RTX 4090
368
1-bit vs Ternary Bonsai 8B
Bonsai 8B (1-bit)
1.15 GB
●
Bench avg 70.5
●
Density 1.06/GB
Ternary (1.58-bit)
1.75 GB
●
Bench avg 75.5
●
Values -1, 0, 1
Edge AI Shift Gains Momentum
AI NEWS BLITZ
PrismML has revealed Bonsai 8B, a native 1-bit language model that runs on phones.