RTX A6000
28 records across 7 models (quants: Gyro-M, Gyro-S, MXFP4, Q4_K).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX A6000 | gpt-oss 20B 20B | MXFP4 | llama.cpp | 108.4 | 3490.6 | – | – | 4096 | – | sourced | – | source |
| RTX A6000 | gpt-oss 20B 20B | MXFP4 | llama.cpp | 91.2 | 2649.2 | – | – | 16384 | – | sourced | – | source |
| RTX A6000 | gpt-oss 20B 20B | MXFP4 | llama.cpp | 74.4 | 1891.2 | – | – | 32768 | – | sourced | – | source |
| RTX A6000 | gpt-oss 20B 20B | MXFP4 | llama.cpp | 53.3 | 1207.2 | – | – | 65536 | – | sourced | – | source |
| RTX A6000 | gpt-oss 20B 20B | MXFP4 | llama.cpp | 33.4 | 702.8 | – | – | 131072 | – | sourced | – | source |
| RTX A6000 | Llama 3.3 70B 70B | Q4_K | llama.cpp | 12.6 | 423.0 | – | – | 4096 | – | sourced | – | source |
| RTX A6000 | Llama 3.3 70B 70B | Q4_K | llama.cpp | 9.1 | 280.3 | – | – | 16384 | – | sourced | – | source |
| RTX A6000 | Qwen3 14B 14B | Q4_K | llama.cpp | 53.8 | 1713.3 | – | – | 4096 | – | sourced | – | source |
| RTX A6000 | Qwen3 14B 14B | Q4_K | llama.cpp | 40.7 | 1529.0 | – | – | 16384 | – | sourced | – | source |
| RTX A6000 | Qwen3 14B 14B | Q4_K | llama.cpp | 30.8 | 1063.4 | – | – | 32768 | – | sourced | – | source |
| RTX A6000 | Qwen3 14B 14B | Q4_K | llama.cpp | 20.5 | 668.9 | – | – | 65536 | – | sourced | – | source |
| RTX A6000 | Qwen3 14B 14B | Q4_K | llama.cpp | 12.1 | 382.4 | – | – | 131072 | – | sourced | – | source |
| RTX A6000 | Qwen3 30B A3B 30B | Q4_K | llama.cpp | 131.2 | 2142.4 | – | – | 4096 | – | sourced | – | source |
| RTX A6000 | Qwen3 30B A3B 30B | Q4_K | llama.cpp | 75.4 | 1901.1 | – | – | 16384 | – | sourced | – | source |
| RTX A6000 | Qwen3 30B A3B 30B | Q4_K | llama.cpp | 48.1 | 1275.6 | – | – | 32768 | – | sourced | – | source |
| RTX A6000 | Qwen3 30B A3B 30B | Q4_K | llama.cpp | 27.6 | 764.2 | – | – | 65536 | – | sourced | – | source |
| RTX A6000 | Qwen3 30B A3B 30B | Q4_K | llama.cpp | 14.8 | 429.2 | – | – | 131072 | – | sourced | – | source |
| RTX A6000 | Qwen3 32B 32B | Q4_K | llama.cpp | 24.6 | 736.2 | – | – | 4096 | – | sourced | – | source |
| RTX A6000 | Qwen3 32B 32B | Q4_K | llama.cpp | 18.3 | 704.8 | – | – | 16384 | – | sourced | – | source |
| RTX A6000 | Qwen3 32B 32B | Q4_K | llama.cpp | 13.5 | 502.7 | – | – | 32768 | – | sourced | – | source |
| RTX A6000 | Qwen3 32B 32B | Q4_K | llama.cpp | 8.7 | 319.0 | – | – | 65536 | – | sourced | – | source |
| RTX A6000 | Qwen3 8B 8B | Q4_K | llama.cpp | 90.5 | 2756.0 | – | – | 4096 | – | sourced | – | source |
| RTX A6000 | Qwen3 8B 8B | Q4_K | llama.cpp | 64.3 | 2428.0 | – | – | 16384 | – | sourced | – | source |
| RTX A6000 | Qwen3 8B 8B | Q4_K | llama.cpp | 44.6 | 1593.3 | – | – | 32768 | – | sourced | – | source |
| RTX A6000 | Qwen3 8B 8B | Q4_K | llama.cpp | 27.9 | 951.0 | – | – | 65536 | – | sourced | – | source |
| RTX A6000 | Qwen3 8B 8B | Q4_K | llama.cpp | 16.0 | 527.9 | – | – | 131072 | – | sourced | – | source |
| RTX A6000 | Qwen3.8-Flash-Next 126B | Gyro-S | llama.cpp (CUDA) | 57.4 | 740 | – | – | tg128 | 2026-10-05 | community | – | source |
| RTX A6000 | Qwen3.8-Flash-Next 126B | Gyro-M | llama.cpp (CUDA) | 52.3 | – | – | – | tg128 | 2026-10-05 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085