Gemma 3 27B
5 records across 4 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M5 Max (128 GB) | Gemma 3 27B | Q6_K | llama.cpp | 20 | 391 | – | – | 8192 | – | sourced | – | source |
| M4 Max (128 GB) | Gemma 3 27B | Q8_0 | LM Studio | 14.49 | – | – | 1.71 | 131072 | – | sourced | – | source |
| M4 Max (128 GB) | Gemma 3 27B | Q8_0 | LM Studio | 12.99 | – | – | 0.79 | 10000 | – | sourced | – | source |
| M3 Ultra (512 GB) | Gemma 3 27B | bf16 | LM Studio | 11.19 | – | – | 1.72 | 128000 | – | sourced | – | source |
| M4 (32 GB) | Gemma 3 27B | Q4_0 | llama.cpp | 5.72 | 47.51 | – | – | 512 | – | sourced | – | source |