Mistral Small 4
4 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Radeon AI PRO R9700 | Mistral Small 4 | IQ4_XS | llama.cpp (Vulkan) | 31.56 | – | – | – | 128 | 2026-10-07 | community | – | source |
| Radeon AI PRO R9700 | Mistral Small 4 | IQ4_XS | llama.cpp (Vulkan) | 2.99 | – | – | – | 128 | 2026-10-07 | community | – | source |
| Radeon AI PRO R9700 | Mistral Small 4 | IQ4_XS | llama.cpp (Vulkan) | – | 242.75 | – | – | 512 | 2026-10-07 | community | – | source |
| Radeon AI PRO R9700 | Mistral Small 4 | IQ4_XS | llama.cpp (Vulkan) | – | 240.0 | – | – | 512 | 2026-10-07 | community | – | source |