RTX 4060 Ti 16GB

12 records across 3 models (quants: MXFP4, Q4_K).

hardwaremodelquantbackendtok/spp tok/sWttft sctx/tgdateclassflagssource
RTX 4060 Ti 16GBgpt-oss 20B 20BMXFP4llama.cpp63.23274.2––4096–sourced–source
RTX 4060 Ti 16GBgpt-oss 20B 20BMXFP4llama.cpp57.82552.9––16384–sourced–source
RTX 4060 Ti 16GBgpt-oss 20B 20BMXFP4llama.cpp51.51964.9––32768–sourced–source
RTX 4060 Ti 16GBgpt-oss 20B 20BMXFP4llama.cpp41.11332.2––65536–sourced–source
RTX 4060 Ti 16GBgpt-oss 20B 20BMXFP4llama.cpp31.1780.2––131072–sourced–source
RTX 4060 Ti 16GBQwen3 14B 14BQ4_Kllama.cpp27.41645.7––4096–sourced–source
RTX 4060 Ti 16GBQwen3 14B 14BQ4_Kllama.cpp22.4917.6––16384–sourced–source
RTX 4060 Ti 16GBQwen3 14B 14BQ4_Kllama.cpp17.9541.4––32768–sourced–source
RTX 4060 Ti 16GBQwen3 8B 8BQ4_Kllama.cpp45.82675.2––4096–sourced–source
RTX 4060 Ti 16GBQwen3 8B 8BQ4_Kllama.cpp34.31480.8––16384–sourced–source
RTX 4060 Ti 16GBQwen3 8B 8BQ4_Kllama.cpp25.5760.3––32768–sourced–source
RTX 4060 Ti 16GBQwen3 8B 8BQ4_Kllama.cpp13.0392.1––65536–sourced–source

All rows cite their source. Provenance: community 40018 sourced 1085

← all hardware