GeForce RTX 3080
9 records across 1 models (quants: Q4_0).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 143.88 | 5438.27 | – | – | tg128 | 2026-04-03 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 139.95 | 5569.56 | – | – | tg128 | 2025-08-01 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 139.65 | 5013.86 | – | – | tg128 | 2025-08-01 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 135.07 | 4901.77 | – | – | tg128 | 2025-08-23 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 132.18 | 4293.66 | – | – | tg128 | 2025-08-23 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 93.42 | 3275.48 | – | – | tg128 | 2026-08-08 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 92.45 | 3211.59 | – | – | tg128 | 2025-12-22 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 90.78 | 2970.97 | 149.0 | – | tg128 | 2025-12-22 | community | – | source |
| GeForce RTX 3080 | llama 7B | Q4_0 | llama.cpp (CUDA) | 90.6 | 2875.02 | – | – | tg128 | 2026-08-08 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085