Qwen 3 4B
6 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M4 Max (40-core GPU, 64 GB) | Qwen 3 4B | Q4_G32 | MLX | 149.07 | 2838.42 | – | – | 2048 | – | sourced | – | source |
| M4 Max (40-core GPU, 64 GB) | Qwen 3 4B | Q4 | MLX | 148.08 | 2976.68 | – | – | 2048 | – | sourced | – | source |
| M4 Max (40-core GPU, 64 GB) | Qwen 3 4B | Q5 | MLX | 143.2 | 2736.15 | – | – | 2048 | – | sourced | – | source |
| M4 Max (40-core GPU, 64 GB) | Qwen 3 4B | Q5_G32 | MLX | 142.98 | 2754.53 | – | – | 2048 | – | sourced | – | source |
| M4 Max (40-core GPU, 64 GB) | Qwen 3 4B | Q6 | MLX | 136.58 | 2735.69 | – | – | 2048 | – | sourced | – | source |
| M4 Max (40-core GPU, 64 GB) | Qwen 3 4B | Q8 | MLX | 111.55 | 1780.63 | – | – | 2048 | – | sourced | – | source |