Bonsai-2 crunches 27B models down to 6GB with ternary weights
prism-ml just launched Bonsai-2, a collection of radically compressed models that restrict weights to -1, 0, and +1. The approach shrinks a 27B-parameter base model to under 6GB—slashing its footprint by over 9x while preserving baseline performance on consumer-grade GPUs and Apple silicon.