2 A10

17 records across 2 models (quants: AWQ).

hardware	model	quant	backend	tok/s	pp tok/s	W	ttft s	ctx/tg	date	class	flags	source
2 A10	Qwen2.5-7B	AWQ	SGLang	1157.76	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen2.5-7B	AWQ	SGLang	1151.33	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen2.5-7B	AWQ	vLLM	1074.01	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen2.5-7B	AWQ	vLLM	1025.81	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen2.5-7B	AWQ	SGLang	853.94	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen2.5-7B	AWQ	SGLang	511.92	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1822.21	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1816.33	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1811.35	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1757.90	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1534.72	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1519.86	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1217.92	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1131.43	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1117.99	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1115.89	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	422.97	–	–	–	8192	2025-04	community	–	source

All rows cite their source. Provenance: community 40018 sourced 1085