granite-4.2-3b
6 records across 2 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M5 Pro | granite-4.2-3b | 4bit | oMLX | 110.6 | 3759.0 | – | – | 1024 | 2026-10-12 | community | – | source |
| M5 Pro | granite-4.2-3b | 4bit | oMLX | 99.0 | 3706.0 | – | – | 4096 | 2026-10-12 | community | – | source |
| M5 Pro | granite-4.2-3b | 4bit | oMLX | 78.1 | 3447.0 | – | – | 8192 | 2026-10-12 | community | – | source |
| M5 Pro | granite-4.2-3b | 4bit | oMLX | 64.2 | 2943.0 | – | – | 16384 | 2026-10-12 | community | – | source |
| M2 | granite-4.2-3b | 4bit | oMLX | 11.8 | 68.5 | – | – | 1024 | 2026-10-15 | community | – | source |
| M2 | granite-4.2-3b | 4bit | oMLX | 9.8 | 64.7 | – | – | 4096 | 2026-10-15 | community | – | source |