A100-SXM4-80GB
85 records across 6 models (quants: BF16).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 15804.1 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 20223.1 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 21393.1 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 21907.9 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 8592.1 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 14870.2 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 19341.7 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 21462.7 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 1853.8 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 4607.7 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 9212.9 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 13345.6 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 16495.5 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 26B-A4B | BF16 | vLLM | – | 17685.1 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 30314.2 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 38015.2 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 40572.3 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 30697.3 | – | – | 4096 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 35937.9 | – | – | 4096 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 25433.3 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 35480.8 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 37836.3 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 39380.0 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 12762.8 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 27009.7 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 31879.1 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 36008.9 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 2489.8 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 8692.8 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 13812.5 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 21129.3 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 30383.4 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 32728.3 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 35480.8 | – | – | – | 2026-10-08 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E2B | BF16 | vLLM | – | 67488.9 | – | – | – | 2026-10-08 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 19742.0 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 22494.2 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 23855.8 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 20097.0 | – | – | 4096 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 22062.9 | – | – | 4096 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 18361.2 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 22787.7 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 23480.9 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 23924.9 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 8918.4 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 16890.1 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 20515.7 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 22436.7 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 1666.5 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 5943.5 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 9302.1 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 13435.8 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 20474.2 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 21364.6 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 22787.7 | – | – | – | 2026-10-08 | community | – | source |
| A100-SXM4-80GB | Gemma 4 E4B | BF16 | vLLM | – | 34290.8 | – | – | – | 2026-10-08 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8268.4 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8906.6 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 9141.9 | – | – | 2048 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 7900.1 | – | – | 4096 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8435.7 | – | – | 4096 | 2026-10-13 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8271.5 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 9456.8 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 9922.0 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 10004.8 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 4339.0 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 7754.7 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8859.6 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 9818.5 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 893.6 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 2914.4 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 4529.7 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 6409.1 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8137.0 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-12b-it | BF16 | vLLM | – | 8549.3 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-26B-A4B-it | BF16 | vLLM | 5493.9 | – | – | – | – | 2026-10-08 | community | – | source |
| A100-SXM4-80GB | gemma-4-26B-A4B-it | BF16 | vLLM | 4582.2 | – | – | – | – | 2026-10-08 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 3566.7 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 3835.8 | – | – | 1024 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 1906.1 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 3173.0 | – | – | 512 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 398.2 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 1266.7 | – | – | 128 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 3306.2 | – | – | 4096 | 2026-10 | community | – | source |
| A100-SXM4-80GB | gemma-4-31B-it | BF16 | vLLM | – | 3390.3 | – | – | 4096 | 2026-10 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085