Bonsai 27B: A 27B-Parameter LLM That Fits on an iPhone
Bonsai 27B compresses a 27B-parameter Qwen3.6 model to 3.9GB using native 1-bit weights and runs on an iPhone at 11 tok/s. Here's what it gives up.
Bonsai 27 b
Blog posts tagged “Bonsai 27B”
Blog posts tagged “Bonsai 27B”
Bonsai 27B compresses a 27B-parameter Qwen3.6 model to 3.9GB using native 1-bit weights and runs on an iPhone at 11 tok/s. Here's what it gives up.