GeForce RTX 5060 Ti
18 records across 1 models (quants: Q4_0).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 97.32 | 4613.86 | – | – | tg128 | 2026-03-06 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 95.84 | 3731.36 | – | – | tg128 | 2026-05-08 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 95.69 | 4427.42 | – | – | tg128 | 2026-05-08 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 95.1 | 4430.01 | – | – | tg128 | 2026-05-08 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 93.9 | 3912.3 | – | – | tg128 | 2026-03-06 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 93.46 | 4195.53 | – | – | tg128 | 2025-08-02 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 92.75 | 3541.12 | – | – | tg128 | 2026-05-08 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 92.52 | 3733.17 | – | – | tg128 | 2026-05-08 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 90.94 | 3737.25 | – | – | tg128 | 2025-08-02 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 90.61 | 3359.51 | – | – | tg128 | 2026-05-08 | community | – | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 66.59 | 572.26 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 63.79 | 518.53 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 53.96 | 1037.02 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 53.65 | 428.35 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 52.85 | 416.06 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 51.3 | 913.16 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 34.71 | 189.5 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
| GeForce RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 34.19 | 188.88 | – | – | tg128 | 2026-05-08 | community | contradiction | source |
All rows cite their source. Provenance: community 40018 sourced 1085