nemotron_h_moe 31B.A3.5B
8 records across 2 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX Pro 6000 Blackwell | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp | 447.63 | – | – | – | 8192 | 2026-10-01 | community | – | source |
| RTX Pro 6000 Blackwell | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp | 432.58 | – | – | – | 8192 | 2026-10-01 | community | – | source |
| RTX Pro 6000 Blackwell | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp | 314.14 | – | – | – | – | 2026-10-01 | community | – | source |
| RTX Pro 6000 Blackwell | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp | 313.28 | – | – | – | – | 2026-10-01 | community | – | source |
| GB10 | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp (Vulkan) | 64.5 | 1661.48 | – | – | tg128 | 2026-01-17 | community | – | source |
| GB10 | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp (CUDA) | 61.76 | 2135.98 | – | – | tg128 | 2026-01-17 | community | – | source |
| RTX Pro 6000 Blackwell | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp | – | 11485.61 | – | – | – | 2026-10-01 | community | – | source |
| RTX Pro 6000 Blackwell | nemotron_h_moe 31B.A3.5B | Q4_K - Medium | llama.cpp | – | 11474.42 | – | – | – | 2026-10-01 | community | – | source |