gemma-3-12b-it
3 records across 2 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M4 Max | gemma-3-12b-it | 4bit | oMLX | 55.3 | 543.8 | – | – | 4096 | 2026-10-17 | community | – | source |
| M4 Max | gemma-3-12b-it | 4bit | oMLX | 48.5 | 485.4 | – | – | 16384 | 2026-10-17 | community | – | source |
| M1 | gemma-3-12b-it | 4bit | oMLX | 1.6 | 12.4 | – | – | 16384 | 2026-10-10 | community | – | source |