Qwythos-9B-v2
22 records across 2 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M4 Max | Qwythos-9B-v2 | OptiQ-4bit | oMLX | 68.1 | 895.5 | – | – | 1024 | 2026-10-13 | community | – | source |
| M4 Max | Qwythos-9B-v2 | OptiQ-4bit | oMLX | 66.4 | 932.4 | – | – | 4096 | 2026-10-13 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 40.9 | 423.8 | – | – | 4096 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 40.9 | 423.8 | – | – | 4096 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 38.7 | 391.3 | – | – | 8192 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 38.7 | 391.3 | – | – | 8192 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 8bit | oMLX | 38.0 | 508.3 | – | – | 4096 | 2026-10-07 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 8bit | oMLX | 38.0 | 507.9 | – | – | 4096 | 2026-10-07 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 37.8 | 485.1 | – | – | 1024 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 37.8 | 485.1 | – | – | 1024 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 36.3 | 379.0 | – | – | 16384 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 36.3 | 379.0 | – | – | 16384 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 33.0 | 340.4 | – | – | 32768 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 33.0 | 340.4 | – | – | 32768 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 25.3 | 293.1 | – | – | 65536 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 25.3 | 293.1 | – | – | 65536 | 2026-10-08 | community | – | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 24.7 | 341.9 | – | – | 1024 | 2026-10-08 | community | contradiction | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 24.4 | 356.7 | – | – | 4096 | 2026-10-08 | community | contradiction | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 24.4 | 342.8 | – | – | 8192 | 2026-10-08 | community | contradiction | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 22.4 | 315.9 | – | – | 16384 | 2026-10-08 | community | contradiction | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 18.7 | 301.4 | – | – | 32768 | 2026-10-08 | community | contradiction | source |
| M2 Max | Qwythos-9B-v2 | 4bit | oMLX | 16.3 | 253.8 | – | – | 65536 | 2026-10-08 | community | contradiction | source |