RTX PRO 6000
69 records across 12 models (quants: BF16, NVFP4, Q4_0, Q4_K_M, Q8_0, Ternary PQ2_0, Ternary PTQ1_0, UD-IQ1_S, unspecified).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX PRO 6000 | Falcon-H1-7B 7B | Q4_K_M | llama.cpp (CUDA) | 1417.1 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Falcon-H1-7B 7B | Q8_0 | llama.cpp (CUDA) | 1318.3 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Falcon-H1-7B 7B | BF16 | llama.cpp (CUDA) | 1188.2 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Falcon-H1-7B 7B | Q4_K_M | llama.cpp (CUDA) | 1067.9 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Falcon-H1-7B 7B | Q8_0 | llama.cpp (CUDA) | 963.3 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Falcon-H1-7B 7B | BF16 | llama.cpp (CUDA) | 771.5 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | gemma-4-26B-A4B-it | Q8_0 | llama.cpp (CUDA) | 288.11 | 8625.75 | – | – | 400000 | 2026-09-27 | community | – | source |
| RTX PRO 6000 | gemma-4-26B-A4B-it | Q8_0 | llama.cpp (CUDA) | 273.42 | 2982.14 | – | – | 400000 | 2026-09-27 | community | – | source |
| RTX PRO 6000 | GLM-5.3-Flash | UD-IQ1_S | llama.cpp | 84.3 | – | – | – | 8192 | 2026-10-06 | community | – | source |
| RTX PRO 6000 | GLM-5.3-Flash | UD-IQ1_S | llama.cpp | 80.1 | – | – | – | 32768 | 2026-10-06 | community | – | source |
| RTX PRO 6000 | GLM-5.3-Flash | UD-IQ1_S | llama.cpp | 75.3 | – | – | – | 8192 | 2026-10-06 | community | – | source |
| RTX PRO 6000 | GLM-5.3-Flash | UD-IQ1_S | llama.cpp | 72.3 | – | – | – | 32768 | 2026-10-06 | community | – | source |
| RTX PRO 6000 | GLM-5.3-Flash | UD-IQ1_S | llama.cpp | 71.9 | – | – | – | 32768 | 2026-10-06 | community | – | source |
| RTX PRO 6000 | GLM-5.3-Flash | UD-IQ1_S | llama.cpp | 24.6 | – | – | – | 32768 | 2026-10-06 | community | – | source |
| RTX PRO 6000 | granite-4.0-h-tiny | Q4_K_M | llama.cpp (CUDA) | 2541.9 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | granite-4.0-h-tiny | BF16 | llama.cpp (CUDA) | 2287.6 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | granite-4.0-h-tiny | Q4_K_M | llama.cpp (CUDA) | 2192.4 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | granite-4.0-h-tiny | BF16 | llama.cpp (CUDA) | 1427.0 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | llama 7B | Q4_0 | llama.cpp (CUDA) | 270.0 | 11443.35 | – | – | tg128 | 2026-01-22 | community | – | source |
| RTX PRO 6000 | llama 7B | Q4_0 | llama.cpp (CUDA) | 269.96 | 12231.9 | – | – | tg128 | 2026-01-22 | community | – | source |
| RTX PRO 6000 | mamba2-2.7b 2.7B | Q4_K_M | llama.cpp (CUDA) | 1638.9 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | mamba2-2.7b 2.7B | BF16 | llama.cpp (CUDA) | 1508.0 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | mamba2-2.7b 2.7B | Q4_K_M | llama.cpp (CUDA) | 953.0 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | mamba2-2.7b 2.7B | BF16 | llama.cpp (CUDA) | 630.9 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 3159.1 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 2132.4 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 1959.8 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 1542.0 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 1234.1 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 1035.5 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 333.2 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Nemotron 3 Nano 30B-A3B 30B | NVFP4 | llama.cpp (CUDA) | 332.0 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 6000 | Qwen3.5-35B-A3B | Q8_0 | llama.cpp | – | 13653.58 | – | – | 2048 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.5-35B-A3B | Q8_0 | llama.cpp | – | 16459.56 | – | – | 2048 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.5-35B-A3B | Q8_0 | llama.cpp | – | 14090.26 | – | – | 4096 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.5-35B-A3B | Q8_0 | llama.cpp | – | 16595.47 | – | – | 4096 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.8-27B | Q8_0 | llama.cpp (CUDA) | 102.08 | 2778.22 | – | – | 400000 | 2026-09-27 | community | – | source |
| RTX PRO 6000 | Qwen3.8-27B | Q8_0 | llama.cpp (CUDA) | 90.29 | 1106.13 | – | – | 400000 | 2026-09-27 | community | – | source |
| RTX PRO 6000 | Qwen3.8-27B | Q8_0 | llama.cpp | – | 4470.39 | – | – | 2048 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.8-27B | Q8_0 | llama.cpp | – | 4757.2 | – | – | 2048 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.8-27B | Q8_0 | llama.cpp | – | 4442.45 | – | – | 4096 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.8-27B | Q8_0 | llama.cpp | – | 4699.08 | – | – | 4096 | 2026-10-13 | sourced | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1640.9 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1628.3 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1493.9 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1491.0 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1293.8 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1282.8 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1215.2 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1214.0 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1176.1 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 1175.5 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 836.4 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 831.4 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | NVFP4 | vLLM | 817 | – | – | – | – | 2026-10-07 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | NVFP4 | vLLM | 718 | – | – | – | – | 2026-10-07 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 653.9 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 643.8 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | NVFP4 | vLLM | 395 | – | – | – | – | 2026-10-07 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 348.6 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 348.5 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 236.1 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 235.6 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 110.2 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen3.8-Flash-Next | unspecified | vLLM | 110.2 | – | – | – | tg1024 | 2026-10-01 | community | – | source |
| RTX PRO 6000 | Qwen4-exp | unspecified | llama.cpp (CUDA) | – | 3867 | – | – | 131072 | 2026-10-03 | community | – | source |
| RTX PRO 6000 | Qwen4-exp | unspecified | llama.cpp (CUDA) | – | 4038 | – | – | 131072 | 2026-10-03 | community | – | source |
| RTX PRO 6000 | Ternary-Bonsai-2-27B | Ternary PQ2_0 | llama.cpp (CUDA) | 124.8 | 4020 | – | – | tg128 | 2026-09-16 | community | – | source |
| RTX PRO 6000 | Ternary-Bonsai-2-27B | Ternary PTQ1_0 | llama.cpp (CUDA) | 117.9 | 1972 | – | – | tg128 | 2026-09-16 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085