GeForce RTX 3060
14 records across 1 models (quants: Q4_0).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 78.19 | 2452.67 | – | – | tg128 | 2025-11-23 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 76.92 | 2407.67 | – | – | tg128 | 2025-08-21 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 75.58 | 2407.93 | – | – | tg128 | 2026-08-21 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 75.57 | 2137.5 | – | – | tg128 | 2025-08-21 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 75.17 | 2118.17 | – | – | tg128 | 2025-11-23 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 74.98 | 2401.11 | – | – | tg128 | 2025-08-23 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 73.75 | 2343.25 | – | – | tg128 | 2025-08-18 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 73.74 | 2346.54 | – | – | tg128 | 2026-02-19 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 72.09 | 2111.39 | – | – | tg128 | 2026-08-21 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 71.66 | 1921.04 | – | – | tg128 | 2025-08-18 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 71.17 | 2239.81 | – | – | tg128 | 2025-08-18 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 71.14 | 2020.41 | – | – | tg128 | 2025-08-23 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 70.52 | 2070.83 | – | – | tg128 | 2026-02-19 | community | – | source |
| GeForce RTX 3060 | llama 7B | Q4_0 | llama.cpp (CUDA) | 69.01 | 2028.81 | – | – | tg128 | 2025-08-18 | community | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085