Ternary Bonsai 2 (2B, 4B, and 9B) released on Hugging Face, with the 2B able to run entirely locally in the browser at up to 500 tok/s on an M4 Max using custom WebGPU kernels.
Read original on r/LocalLLaMA ↗Models on HF: https://huggingface.co/collections/prism-ml/bonsai-2-small WebGPU demo: https://huggingface.co/spaces/webml-community/ternary-bonsai-2-hermes-webgpu submitted by /u/xenovatech [link] [comments]
Original headline: "Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels."
Timeline
- October 15, 2026 Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. r/LocalLLaMA
- October 15, 2026 Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5 r/LocalLLaMA