RTX 4060 Ti 16GB
12 records across 3 models (quants: MXFP4, Q4_K).
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RTX 4060 Ti 16GB | gpt-oss 20B 20B | MXFP4 | llama.cpp | 63.2 | 3274.2 | – | – | 4096 | – | sourced | – | source |
| RTX 4060 Ti 16GB | gpt-oss 20B 20B | MXFP4 | llama.cpp | 57.8 | 2552.9 | – | – | 16384 | – | sourced | – | source |
| RTX 4060 Ti 16GB | gpt-oss 20B 20B | MXFP4 | llama.cpp | 51.5 | 1964.9 | – | – | 32768 | – | sourced | – | source |
| RTX 4060 Ti 16GB | gpt-oss 20B 20B | MXFP4 | llama.cpp | 41.1 | 1332.2 | – | – | 65536 | – | sourced | – | source |
| RTX 4060 Ti 16GB | gpt-oss 20B 20B | MXFP4 | llama.cpp | 31.1 | 780.2 | – | – | 131072 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 14B 14B | Q4_K | llama.cpp | 27.4 | 1645.7 | – | – | 4096 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 14B 14B | Q4_K | llama.cpp | 22.4 | 917.6 | – | – | 16384 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 14B 14B | Q4_K | llama.cpp | 17.9 | 541.4 | – | – | 32768 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 8B 8B | Q4_K | llama.cpp | 45.8 | 2675.2 | – | – | 4096 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 8B 8B | Q4_K | llama.cpp | 34.3 | 1480.8 | – | – | 16384 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 8B 8B | Q4_K | llama.cpp | 25.5 | 760.3 | – | – | 32768 | – | sourced | – | source |
| RTX 4060 Ti 16GB | Qwen3 8B 8B | Q4_K | llama.cpp | 13.0 | 392.1 | – | – | 65536 | – | sourced | – | source |
All rows cite their source. Provenance: community 40018 sourced 1085