RTX 5060 Ti
73 records across 11 models (quants: IQ4_XS - 4.25 bpw, PQ2_0, PTQ1_0, Q4_0, Q4_K_M, Q6_K, Q8_0, UD-IQ3_S, UD-Q6_K).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 127.8 | – | – | – | 32768 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 127.3 | – | – | – | 131072 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 114.8 | – | – | – | 245760 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 112.4 | – | – | – | 196608 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 111.8 | – | – | – | 229376 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 79.7 | – | – | – | 262144 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 47.9 | – | – | – | 262144 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 13.3 | – | – | – | 262144 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | Bonsai 2 27B | PQ2_0 | llama.cpp | 11.0 | – | – | – | 524288 | 2026-10-10 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (CUDA) | 14.6 | 577.31 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (CUDA) | 14.59 | 573.75 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (CUDA) | 14.41 | 549.87 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (CUDA) | 14.35 | 542.01 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (Vulkan) | 10.61 | 112.31 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (Vulkan) | 9.76 | 438.01 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (Vulkan) | 9.73 | 423.66 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (Vulkan) | 8.48 | 426.57 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (Vulkan) | 8.45 | 412.37 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | deci 70B | IQ4_XS - 4.25 bpw | llama.cpp (Vulkan) | 6.73 | 55.4 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | gemma-4-31B-it 31B | Q6_K | llama.cpp (CUDA) | 0.62 | 41.84 | – | – | – | 2026-08 | community | – | source |
| RTX 5060 Ti | granite-4.2-8b 8B | Q8_0 | llama.cpp (Vulkan) | 42.1 | – | – | – | tg128 | 2026-10-05 | community | – | source |
| RTX 5060 Ti | granite-4.2-8b 8B | Q8_0 | llama.cpp (Vulkan) | 41.9 | – | – | – | tg128 | 2026-10-05 | community | – | source |
| RTX 5060 Ti | granite-4.2-8b 8B | Q8_0 | llama.cpp (Vulkan) | – | 2955 | – | – | – | 2026-10-05 | community | – | source |
| RTX 5060 Ti | granite-4.2-8b 8B | Q8_0 | llama.cpp (Vulkan) | – | 2437 | – | – | – | 2026-10-05 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 104.42 | 1907.81 | – | – | tg128 | 2025-11-04 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 102.66 | 1986.47 | – | – | tg128 | 2025-11-04 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 102.31 | 1741.01 | – | – | tg128 | 2025-11-04 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 101.35 | 1678.98 | – | – | tg128 | 2025-11-04 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 95.98 | 3848.92 | – | – | tg128 | 2026-02-03 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 94.3 | 4034.65 | – | – | tg128 | 2025-04-24 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 93.76 | 3713.27 | – | – | tg128 | 2025-11-04 | community | contradiction | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 93.3 | 4163.39 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 92.19 | 3342.62 | – | – | tg128 | 2026-02-03 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 91.85 | 3720.85 | – | – | tg128 | 2025-11-04 | community | contradiction | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 91.56 | 4073.37 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 91.41 | 3240.12 | – | – | tg128 | 2025-11-04 | community | contradiction | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 90.95 | 3728.09 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 89.87 | 3917.29 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 89.75 | 3526.38 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (CUDA) | 89.57 | 3648.71 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 87.05 | 3248.01 | – | – | tg128 | 2025-11-04 | community | contradiction | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 83.26 | 3492.22 | – | – | tg128 | 2025-04-22 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 81.48 | 3211.73 | – | – | tg128 | 2025-04-22 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 78.1 | 3504.54 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 74.8 | 3386.08 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 74.52 | 3060.78 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 74.47 | 3226.8 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 62.05 | 2199.15 | – | – | tg128 | 2026-02-03 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 60.02 | 689.59 | – | – | tg128 | 2026-02-03 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 49.44 | 2021.05 | – | – | tg128 | 2026-02-03 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 47.35 | 511.59 | – | – | tg128 | 2026-02-03 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 43.79 | 2784.46 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | llama 7B | Q4_0 | llama.cpp (Vulkan) | 42.47 | 2718.32 | – | – | tg128 | 2025-07-30 | community | – | source |
| RTX 5060 Ti | Qwen3 30B A3B 30B-A3B | Q4_K_M | llama.cpp (CUDA) | 35.4 | 149.6 | – | – | tg128 | 2026-10-05 | community | – | source |
| RTX 5060 Ti | Qwen3 30B A3B 30B-A3B | Q4_K_M | llama.cpp (CUDA) | 19.7 | 64.0 | – | – | tg128 | 2026-10-05 | community | – | source |
| RTX 5060 Ti | Qwen3-Embedding-8B 8B | Q8_0 | llama.cpp (Vulkan) | – | 2798 | – | – | – | 2026-10-05 | community | – | source |
| RTX 5060 Ti | Qwen3-Embedding-8B 8B | Q8_0 | llama.cpp (Vulkan) | – | 2348 | – | – | – | 2026-10-05 | community | – | source |
| RTX 5060 Ti | Qwen3-Reranker-8B 8B | Q8_0 | llama.cpp (Vulkan) | – | 2790 | – | – | – | 2026-10-05 | community | – | source |
| RTX 5060 Ti | Qwen3-Reranker-8B 8B | Q8_0 | llama.cpp (Vulkan) | – | 2337 | – | – | – | 2026-10-05 | community | – | source |
| RTX 5060 Ti | Qwen3.6-35B-A3B 35B-A3B | UD-Q6_K | llama.cpp (CUDA) | 5.49 | 108.23 | – | – | – | 2026-08 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B 27B | UD-IQ3_S | llama.cpp (CUDA) | 38.8 | – | – | – | – | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B | UD-IQ3_S | llama.cpp | 38.8 | – | – | – | 65536 | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B 27B | UD-IQ3_S | llama.cpp (CUDA) | 26.55 | – | – | – | – | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B | UD-IQ3_S | llama.cpp | 26.55 | – | – | – | 65536 | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B | UD-IQ3_S | llama.cpp | 19 | – | – | – | 128000 | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B 27B | UD-IQ3_S | llama.cpp (CUDA) | 2.01 | – | – | – | – | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B 27B | UD-IQ3_S | llama.cpp (CUDA) | 2.01 | – | – | – | – | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B | UD-IQ3_S | llama.cpp | 2.01 | – | – | – | 65536 | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B | UD-IQ3_S | llama.cpp | 2.01 | – | – | – | 65536 | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B 27B | UD-IQ3_S | llama.cpp (CUDA) | 1.67 | – | – | – | – | 2026-09 | community | – | source |
| RTX 5060 Ti | Qwen3.8-27B | UD-IQ3_S | llama.cpp | 1.67 | – | – | – | 65536 | 2026-09 | community | – | source |
| RTX 5060 Ti | Ternary-Bonsai-2-27B 27B | PTQ1_0 | llama.cpp (CUDA) | 44.68 | 464.81 | – | – | – | 2026-09 | community | – | source |
| RTX 5060 Ti | Ternary-Bonsai-2-27B 27B | PTQ1_0 | llama.cpp (CUDA) | 8.1 | 21.87 | – | – | 154855 | 2026-09 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085