RTX 3060
30 records across 4 models (quants: Q4_0, Q4_K - Medium, Q8_0, as-published).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX 3060 | gpt-oss 20B MXFP4 MoE | as-published | llama.cpp (Vulkan) | 18.65 | 324.21 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | gpt-oss 20B MXFP4 MoE | as-published | llama.cpp (Vulkan) | 16.18 | 184.9 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 80.59 | 2012.88 | – | – | tg128 | 2025-11-23 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 75.94 | 1815.7 | – | – | tg128 | 2025-11-23 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 73.71 | 1685.14 | – | – | tg128 | 2025-12-03 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 70.78 | 2229.42 | – | – | tg128 | 2025-06-17 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 68.38 | 2020.4 | – | – | tg128 | 2025-06-17 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 68.34 | 1122.04 | – | – | tg128 | 2025-12-03 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 67.11 | 1826.49 | – | – | tg128 | 2025-06-17 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 66.12 | 1715.17 | – | – | tg128 | 2025-08-23 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 65.63 | 1730.33 | – | – | tg128 | 2025-08-23 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 64.76 | 1681.81 | – | – | tg128 | 2025-06-17 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 54.28 | 1298.03 | – | – | tg128 | 2025-01-21 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 52.66 | 428.54 | – | – | tg128 | 2025-11-26 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 50.23 | 439.87 | – | – | tg128 | 2025-11-26 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 49.03 | 1059.76 | – | – | tg128 | 2025-03-20 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 20.18 | 254.09 | – | – | tg128 | 2025-03-20 | community | – | source |
| RTX 3060 | llama 7B | Q4_K - Medium | llama.cpp (Vulkan) | 11.8 | 218.01 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 10.81 | 90.15 | – | – | tg128 | 2025-03-20 | community | contradiction | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 9.79 | 72.76 | – | – | tg128 | 2025-12-03 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 9.48 | 74.29 | – | – | tg128 | 2025-12-03 | community | – | source |
| RTX 3060 | llama 7B | Q4_K - Medium | llama.cpp (Vulkan) | 9.4 | 1081.37 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 7.69 | 91.04 | – | – | tg128 | 2025-12-03 | community | – | source |
| RTX 3060 | llama 7B | Q4_0 | llama.cpp (Vulkan) | 7.33 | 90.13 | – | – | tg128 | 2025-12-03 | community | – | source |
| RTX 3060 | llama 8B | Q4_K - Medium | llama.cpp (Vulkan) | 12.11 | 230.26 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | llama 8B | Q4_K - Medium | llama.cpp (Vulkan) | 9.06 | 1061.32 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | qwen3moe 30B.A3B | Q4_K - Medium | llama.cpp (Vulkan) | 22.79 | 212.78 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | qwen3moe 30B.A3B | Q8_0 | llama.cpp (Vulkan) | 15.52 | 171.43 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | qwen3moe 30B.A3B | Q4_K - Medium | llama.cpp (Vulkan) | 15.47 | 113.21 | – | – | tg128 | 2025-11-18 | community | – | source |
| RTX 3060 | qwen3moe 30B.A3B | Q8_0 | llama.cpp (Vulkan) | 8.69 | 86.32 | – | – | tg128 | 2025-11-18 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085