Ternary-Bonsai-2-4B
14 records across 3 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M5 Pro | Ternary-Bonsai-2-4B | 2bit | oMLX | 123.6 | 1978.0 | – | – | 1024 | 2026-10-17 | community | – | source |
| M5 Pro | Ternary-Bonsai-2-4B | 2bit | oMLX | 112.7 | 1974.0 | – | – | 4096 | 2026-10-17 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 48.1 | 349.3 | – | – | 1024 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 48.1 | 349.3 | – | – | 1024 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 34.6 | 342.0 | – | – | 4096 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 34.6 | 342.0 | – | – | 4096 | 2026-10-16 | community | – | source |
| M1 | Ternary-Bonsai-2-4B | 2bit | oMLX | 27.9 | 184.8 | – | – | 1024 | 2026-10-16 | community | – | source |
| M1 | Ternary-Bonsai-2-4B | 2bit | oMLX | 27.3 | 196.9 | – | – | 1024 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 26.3 | 329.3 | – | – | 8192 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 26.3 | 329.3 | – | – | 8192 | 2026-10-16 | community | – | source |
| M1 | Ternary-Bonsai-2-4B | 2bit | oMLX | 25.4 | 194.8 | – | – | 4096 | 2026-10-16 | community | – | source |
| M1 | Ternary-Bonsai-2-4B | 2bit | oMLX | 25.0 | 188.0 | – | – | 4096 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 18.3 | 286.0 | – | – | 16384 | 2026-10-16 | community | – | source |
| M4 | Ternary-Bonsai-2-4B | 2bit | oMLX | 18.3 | 286.0 | – | – | 16384 | 2026-10-16 | community | – | source |