Qwen2.5-0.5B
8 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | 33.84 | – | – | – | tg128 | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | 32.42 | – | – | – | tg128 | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | 29.37 | – | – | – | tg128 | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | 27.28 | – | – | – | tg128 | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | – | 93.49 | – | – | – | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | – | 173.68 | – | – | – | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | – | 233.22 | – | – | – | 2026-10-06 | community | – | source |
| Raspberry Pi 5 | Qwen2.5-0.5B | Q4_0 | llama.cpp (CPU) | – | 289.92 | – | – | – | 2026-10-06 | community | – | source |