Bonsai-27B
12 records across 5 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M3 Ultra | Bonsai-27B | 1bit | oMLX | 56.2 | 377.5 | – | – | 4096 | 2026-10-06 | community | – | source |
| M3 Ultra | Bonsai-27B | 1bit | oMLX | 56.2 | 377.5 | – | – | 4096 | 2026-10-06 | community | – | source |
| M5 Max | Bonsai-27B | 1bit | oMLX | 52.5 | 459.9 | – | – | 4096 | 2026-10-13 | community | – | source |
| M5 Max | Bonsai-27B | 1bit | oMLX | 51.9 | 289.2 | – | – | 1024 | 2026-10-13 | community | – | source |
| M3 Ultra | Bonsai-27B | 1bit | oMLX | 48.9 | 363.8 | – | – | 16384 | 2026-10-06 | community | – | source |
| M3 Ultra | Bonsai-27B | 1bit | oMLX | 48.9 | 363.8 | – | – | 16384 | 2026-10-06 | community | – | source |
| M4 | Bonsai-27B | 1bit | oMLX | 14.9 | 43.9 | – | – | 1024 | 2026-10-12 | community | – | source |
| M4 | Bonsai-27B | 1bit | oMLX | 14.4 | 54.1 | – | – | 4096 | 2026-10-12 | community | – | source |
| M3 | Bonsai-27B | 1bit | oMLX | 12.4 | 39.2 | – | – | 1024 | 2026-10-11 | community | – | source |
| M3 | Bonsai-27B | 1bit | oMLX | 12.1 | 38.2 | – | – | 1024 | 2026-10-11 | community | – | source |
| M3 | Bonsai-27B | 1bit | oMLX | 11.7 | 38.4 | – | – | 1024 | 2026-10-11 | community | – | source |
| M1 Pro | Bonsai-27B | 1bit | oMLX | 9.5 | 56.8 | – | – | 32768 | 2026-10-11 | community | – | source |