Radeon RX 6700 XT
4 records across 2 models (quants: IQ4_NL, Q4_0).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Radeon RX 6700 XT | gemma-4-12b-it 12B | IQ4_NL | llama.cpp (Vulkan) | 40.92 | 354.4 | – | – | – | 2026-08 | community | – | source |
| Radeon RX 6700 XT | gemma-4-12b-it 12B | IQ4_NL | llama.cpp (ROCm) | 34.6 | 653.9 | – | – | – | 2026-08 | community | – | source |
| Radeon RX 6700 XT | llama 7B | Q4_0 | llama.cpp (Vulkan) | 83.88 | 1051.2 | – | – | tg128 | 2025-09-16 | community | – | source |
| Radeon RX 6700 XT | llama 7B | Q4_0 | llama.cpp (Vulkan) | 81.86 | 1010.9 | – | – | tg128 | 2025-09-16 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085