Devstral Small 2 24B
8 records across 3 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M3 Ultra (256 GB) | Devstral Small 2 24B | 4bit | MLX | 47 | – | – | – | – | – | sourced | – | source |
| M1 Ultra (64 GB) | Devstral Small 2 24B | 4bit | MLX | 29.68 | – | – | 6.63 | – | – | sourced | – | source |
| M1 Ultra (64 GB) | Devstral Small 2 24B | Q4_K - Medium | llama.cpp | 25.3 | – | – | 5.89 | – | – | sourced | – | source |
| M1 Ultra (64 GB) | Devstral Small 2 24B | Q8 | llama.cpp | 23.37 | – | – | 5.66 | – | – | sourced | – | source |
| M1 Ultra (64 GB) | Devstral Small 2 24B | 8bit | MLX | 22.32 | – | – | 7.57 | – | – | sourced | – | source |
| M4 (16 GB) | Devstral Small 2 24B | Q4_0 | llama.cpp | 3.3641 | – | – | 2.6874 | – | – | sourced | – | source |
| M4 (16 GB) | Devstral Small 2 24B | Q4_1 | llama.cpp | 0.0542 | – | – | 17.48 | – | – | sourced | – | source |
| M4 (16 GB) | Devstral Small 2 24B | Q4_K - Medium | llama.cpp | 0.0198 | – | – | 65.32 | – | – | sourced | – | source |