Qwen2.5-VL-7B
7 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 2632.88 | – | – | – | – | 2025-09 | community | – | source |
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 2451.80 | – | – | – | – | 2025-09 | community | – | source |
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 1795.85 | – | – | – | – | 2025-09 | community | – | source |
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 1517.21 | – | – | – | – | 2025-09 | community | – | source |
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 713.45 | – | – | – | – | 2025-09 | community | – | source |
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 709.00 | – | – | – | – | 2025-09 | community | – | source |
| A100 | Qwen2.5-VL-7B 7B VLM | BF16 | vLLM | 76.46 | – | – | – | – | 2025-09 | community | – | source |