14 records across 2 models
(quants: Q4_K - Medium, Q8_0).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|
| M3 Max (GPU count not published, 64 GB) | Llama 3.3 70B | Q4_K - Medium | llama.cpp | 8.15 | 67.86 | – | – | 258 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Llama 3.3 70B | Q4_K - Medium | llama.cpp | 7.48 | 65.17 | – | – | 8013 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Llama 3.3 70B | Q4_K - Medium | llama.cpp | 7 | 59.5 | – | – | 16001 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Llama 3.3 70B | Q4_K - Medium | llama.cpp | 6.13 | 50.32 | – | – | 32170 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 10.41 | 153.63 | – | 1.72 | 264 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 10.29 | 164.83 | – | 4.39 | 723 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 10.28 | 171.37 | – | 2.63 | 450 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 10.19 | 169.15 | – | 7.21 | 1219 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 10.09 | 166.81 | – | 11.14 | 1858 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 9.89 | 162.22 | – | 18.36 | 2979 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 9.67 | 154.16 | – | 30.29 | 4669 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 9.2 | 140.11 | – | 56.73 | 7948 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 8.6 | 127.96 | – | 97.03 | 12416 | – | sourced | – | source |
| M3 Max (GPU count not published, 64 GB) | Qwen 3 32B | Q8_0 | llama.cpp | 7.58 | 111.18 | – | 181.44 | 20172 | – | sourced | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085