RTX PRO 4000 Blackwell
7 records across 3 models (quants: EXL2 6.0bpw H6, Q4_0, Q4_K_M).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX PRO 4000 Blackwell | llama 7B | Q4_0 | llama.cpp (CUDA) | 136.38 | 5674.44 | – | – | tg128 | 2025-11-21 | community | – | source |
| RTX PRO 4000 Blackwell | llama 7B | Q4_0 | llama.cpp (CUDA) | 131.66 | 4992.83 | – | – | tg128 | 2025-11-21 | community | – | source |
| RTX PRO 4000 Blackwell | llama 7B | Q4_0 | llama.cpp (CUDA) | 92.54 | 4078.52 | – | – | tg128 | 2026-05-13 | community | – | source |
| RTX PRO 4000 Blackwell | llama 7B | Q4_0 | llama.cpp (CUDA) | 89.73 | 3628.68 | – | – | tg128 | 2026-05-13 | community | – | source |
| RTX PRO 4000 Blackwell | Qwen2.5-7B-Instruct | EXL2 6.0bpw H6 | ExLlamaV2 | 47 | – | – | – | – | 2026-03-16 | community | – | source |
| RTX PRO 4000 Blackwell | Qwen3.5-9B 9B | Q4_K_M | llama.cpp (CUDA) | 90 | – | – | – | – | 2026-08 | community | – | source |
| RTX PRO 4000 Blackwell | Qwen3.5-9B 9B | Q4_K_M | llama.cpp (CUDA) | 61 | – | – | – | – | 2026-08 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085