RTX 5060 Ti 16GB

15 records across 5 models (quants: 2.6763bpw, IQ3_S, IQ4_XS, MXFP4, Q4_K).

hardware	model	quant	backend	tok/s	pp tok/s	W	ttft s	ctx/tg	date	class	flags	source
RTX 5060 Ti 16GB	gpt-oss 20B 20B	MXFP4	llama.cpp	92.1	3585.2	–	–	4096	–	sourced	–	source
RTX 5060 Ti 16GB	gpt-oss 20B 20B	MXFP4	llama.cpp	82.4	2753.3	–	–	16384	–	sourced	–	source
RTX 5060 Ti 16GB	gpt-oss 20B 20B	MXFP4	llama.cpp	73.2	1737.7	–	–	32768	–	sourced	–	source
RTX 5060 Ti 16GB	gpt-oss 20B 20B	MXFP4	llama.cpp	58.1	1102.3	–	–	65536	–	sourced	–	source
RTX 5060 Ti 16GB	gpt-oss 20B 20B	MXFP4	llama.cpp	43.8	685.3	–	–	131072	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 14B 14B	Q4_K	llama.cpp	41.1	1743.0	–	–	4096	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 14B 14B	Q4_K	llama.cpp	32.9	942.6	–	–	16384	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 14B 14B	Q4_K	llama.cpp	25.9	621.0	–	–	32768	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 8B 8B	Q4_K	llama.cpp	69.2	2965.1	–	–	4096	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 8B 8B	Q4_K	llama.cpp	51.4	1447.9	–	–	16384	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 8B 8B	Q4_K	llama.cpp	38.9	915.1	–	–	32768	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3 8B 8B	Q4_K	llama.cpp	25.8	529.8	–	–	65536	–	sourced	–	source
RTX 5060 Ti 16GB	Qwen3.6-35B-A3B	2.6763bpw	llama.cpp (CUDA)	24.9	716	–	–	353993	2026-09	community	–	source
RTX 5060 Ti 16GB	Qwen3.8-27B	IQ4_XS	llama.cpp (KVMem fork)	33	466	–	–	262144	2026-09	community	–	source
RTX 5060 Ti 16GB	Qwen3.8-27B	IQ3_S	llama.cpp (KVMem fork)	30	437	–	–	262144	2026-09	community	–	source

All rows cite their source. Provenance: community 40018 sourced 1085