Ternary-Bonsai-2-9B
18 records across 4 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M5 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 74.9 | 967.8 | – | – | 1024 | 2026-10-17 | community | – | source |
| M5 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 74.9 | 967.8 | – | – | 1024 | 2026-10-17 | community | – | source |
| M5 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 70.8 | 1090.0 | – | – | 4096 | 2026-10-17 | community | – | source |
| M5 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 70.8 | 1090.0 | – | – | 4096 | 2026-10-17 | community | – | source |
| M3 Max | Ternary-Bonsai-2-9B | 2bit | oMLX | 64.8 | 449.1 | – | – | 1024 | 2026-10-17 | community | – | source |
| M3 Max | Ternary-Bonsai-2-9B | 2bit | oMLX | 56.0 | 493.9 | – | – | 4096 | 2026-10-17 | community | – | source |
| M5 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 55.0 | 871.2 | – | – | 1024 | 2026-10-18 | community | contradiction | source |
| M4 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 52.7 | 305.0 | – | – | 1024 | 2026-10-17 | community | – | source |
| M4 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 52.6 | 320.2 | – | – | 1024 | 2026-10-17 | community | – | source |
| M5 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 50.5 | 853.9 | – | – | 4096 | 2026-10-18 | community | contradiction | source |
| M3 Max | Ternary-Bonsai-2-9B | 2bit | oMLX | 45.1 | 439.7 | – | – | 8192 | 2026-10-17 | community | – | source |
| M4 Pro | Ternary-Bonsai-2-9B | 2bit | oMLX | 27.0 | 283.4 | – | – | 16384 | 2026-10-17 | community | – | source |
| M4 | Ternary-Bonsai-2-9B | 2bit | oMLX | 25.1 | 193.7 | – | – | 4096 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-9B | 2bit | oMLX | 24.6 | 172.6 | – | – | 1024 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-9B | 2bit | oMLX | 24.3 | 168.5 | – | – | 1024 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-9B | 2bit | oMLX | 23.2 | 168.5 | – | – | 4096 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-9B | 2bit | oMLX | 23.2 | 170.7 | – | – | 4096 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-9B | 2bit | oMLX | 20.7 | 157.7 | – | – | 8192 | 2026-10-16 | community | – | source |