16× A100-SXM4-40GB

4 records across 1 models (quants: FP8).

hardware	model	quant	backend	tok/s	pp tok/s	W	ttft s	ctx/tg	date	class	flags	source
16× A100-SXM4-40GB	K-EXAONE-236B-A23B	FP8	vLLM	1081	–	–	–	–	2026-10-06	sourced	–	source
16× A100-SXM4-40GB	K-EXAONE-236B-A23B	FP8	vLLM	1062	–	–	–	–	2026-10-06	sourced	–	source
16× A100-SXM4-40GB	K-EXAONE-236B-A23B	FP8	vLLM	970	–	–	–	–	2026-10-06	sourced	–	source
16× A100-SXM4-40GB	K-EXAONE-236B-A23B	FP8	vLLM	940	–	–	–	–	2026-10-06	sourced	–	source

All rows cite their source. Provenance: community 40018 sourced 1085