Qwen7B-awq

23 records across 2 hardware.

hardware	model	quant	backend	tok/s	pp tok/s	W	ttft s	ctx/tg	date	class	flags	source
4 A10	Qwen7B-awq	AWQ	SGLang	2560.58	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	SGLang	2540.23	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	SGLang	2526.98	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	SGLang	2123.63	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	SGLang	2119.20	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	SGLang	2086.65	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	vLLM	1914.26	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	vLLM	1887.62	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1822.21	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1816.33	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1811.35	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1757.90	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	vLLM	1566.10	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1534.72	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	vLLM	1534.41	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1519.86	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	vLLM	1318.94	–	–	–	8192	2025-04	community	–	source
4 A10	Qwen7B-awq	AWQ	vLLM	1309.40	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1217.92	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	vLLM	1131.43	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1117.99	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	1115.89	–	–	–	8192	2025-04	community	–	source
2 A10	Qwen7B-awq	AWQ	SGLang	422.97	–	–	–	8192	2025-04	community	–	source

← all models