A10
22 records across 2 models (quants: AWQ, BF16).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| A10 | Qwen2.5-7B | AWQ | SGLang | 1544.94 | – | – | – | 8192 | 2025-04 | community | – | source |
| A10 | Qwen2.5-7B | AWQ | vLLM | 961.05 | – | – | – | 8192 | 2025-04 | community | – | source |
| A10 | Qwen2.5-7B | AWQ | SGLang | 333.00 | – | – | – | 8192 | 2025-04 | community | – | source |
| A10 | Qwen2.5-7B | AWQ | vLLM | 259.53 | – | – | – | 8192 | 2025-04 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 656.60 | – | – | – | tg512 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 607.98 | – | – | – | tg1024 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 469.62 | – | – | – | tg512 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 433.77 | – | – | – | tg512 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 424.58 | – | – | – | tg512 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 423.26 | – | – | – | tg1024 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 413.54 | – | – | – | tg512 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 401.26 | – | – | – | tg512 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 395.12 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 377.98 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 369.19 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 337.17 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 278.73 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | vLLM | 249.99 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 239.82 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | AWQ | SGLang | 238.21 | – | – | – | tg3096 | 2025-05 | community | – | source |
| A10 | Qwen3 4B | BF16 | vLLM | 138.3 | – | – | – | – | 2026-10-01 | community | – | source |
| A10 | Qwen3 4B | BF16 | vLLM | 132.6 | – | – | – | – | 2026-10-01 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085