GeForce RTX 5090
28 records across 1 models (quants: Q4_0).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 315.3 | 17107.92 | – | – | tg128 | 2025-12-04 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 314.0 | 14805.32 | – | – | tg128 | 2025-12-04 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 312.33 | 16070.88 | – | – | tg128 | 2025-11-08 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 301.92 | 15505.79 | – | – | tg128 | 2025-12-09 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 300.4 | 14970.15 | – | – | tg128 | 2025-10-23 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 299.92 | 14036.03 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 299.85 | 14013.74 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 298.18 | 13951.14 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 297.98 | 14131.49 | – | – | tg128 | 2025-12-04 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 297.87 | 14988.21 | – | – | tg128 | 2025-12-04 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 294.95 | 13964.52 | – | – | tg128 | 2025-11-08 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 290.02 | 14073.41 | – | – | tg128 | 2025-10-23 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 287.55 | 13451.73 | – | – | tg128 | 2025-12-09 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 286.51 | 16195.14 | – | – | tg128 | 2025-09-26 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 285.51 | 15602.75 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 284.03 | 16053.65 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 283.69 | 15915.61 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 280.28 | 13143.45 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 277.21 | 14142.08 | – | – | tg128 | 2025-09-26 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 266.7 | 15094.35 | – | – | tg128 | 2025-11-07 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 248.57 | 16041.54 | – | – | tg128 | 2025-08-02 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 239.62 | 14751.98 | – | – | tg128 | 2025-08-02 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 164.31 | 7603.2 | – | – | tg128 | 2026-09-16 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 158.14 | 7641.89 | – | – | tg128 | 2026-05-26 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 157.84 | 6663.79 | 150.0 | – | tg128 | 2026-09-16 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 156.49 | 6667.06 | – | – | tg128 | 2026-05-26 | community | – | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 117.16 | 5007.9 | – | – | tg128 | 2026-05-26 | community | contradiction | source |
| GeForce RTX 5090 | llama 7B | Q4_0 | llama.cpp (CUDA) | 112.36 | 5056.95 | – | – | tg128 | 2026-05-26 | community | contradiction | source |
All rows cite their source. Provenance: community 40018 sourced 1085