Bonsai 27B on a Phone: How 1‑bit & Ternary Quantization Make Agentic AI Possible
Bonsai 27B is a 27B-class multimodal model announced by PrismML that they claim can run on a phone by using 1-bit or ternary weight formats with group-wise FP16 scaling. The architecture also includes on-device vision support and speculative decoding to make long agentic loops practical without shipping user data to the cloud.