Ternary-Bonsai-27B

40 records across 10 hardware.

hardware	model	quant	backend	tok/s	pp tok/s	W	ttft s	ctx/tg	date	class	flags	source
M5 Max	Ternary-Bonsai-27B	2bit	oMLX	58.5	872.7	–	–	1024	2026-10-17	community	–	source
M5 Max	Ternary-Bonsai-27B	2bit	oMLX	57.8	986.6	–	–	4096	2026-10-17	community	–	source
M5 Max	Ternary-Bonsai-27B	2bit	oMLX	47.7	840.6	–	–	4096	2026-10-17	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	43.8	311.3	–	–	1024	2026-10-09	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	43.7	312.5	–	–	1024	2026-10-14	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	42.9	338.6	–	–	4096	2026-10-09	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	42.7	337.8	–	–	4096	2026-10-14	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	42.3	321.2	–	–	4096	2026-10-07	community	–	source
M5 Max	Ternary-Bonsai-27B	2bit	oMLX	42.0	720.9	–	–	16384	2026-10-17	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	38.2	301.5	–	–	16384	2026-10-07	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	34.0	479.3	–	–	1024	2026-10-17	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	33.2	528.9	–	–	4096	2026-10-17	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	32.4	475.7	–	–	1024	2026-10-07	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	32.0	409.5	–	–	1024	2026-10-15	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	31.9	422.7	–	–	1024	2026-10-16	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	31.6	506.0	–	–	4096	2026-10-07	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	31.3	487.1	–	–	1024	2026-10-09	community	–	source
M4 Max	Ternary-Bonsai-27B	2bit	oMLX	31.3	181.6	–	–	1024	2026-10-10	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	31.1	435.5	–	–	4096	2026-10-16	community	–	source
M2 Max	Ternary-Bonsai-27B	2bit	oMLX	30.5	197.6	–	–	4096	2026-10-14	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	30.4	442.7	–	–	4096	2026-10-09	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	28.9	385.6	–	–	8192	2026-10-09	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	26.5	384.1	–	–	16384	2026-10-09	community	–	source
M4 Pro	Ternary-Bonsai-27B	2bit	oMLX	25.4	131.6	–	–	1024	2026-10-12	community	–	source
M4 Pro	Ternary-Bonsai-27B	2bit	oMLX	24.7	135.8	–	–	4096	2026-10-12	community	–	source
M5 Pro	Ternary-Bonsai-27B	2bit	oMLX	24.2	372.9	–	–	32768	2026-10-09	community	–	source
M2 Max	Ternary-Bonsai-27B	2bit	oMLX	23.0	184.2	–	–	1024	2026-10-14	community	–	source
M6	Ternary-Bonsai-27B	2bit	oMLX	18.5	321.5	–	–	1024	2026-10-08	community	–	source
M6	Ternary-Bonsai-27B	2bit	oMLX	18.0	333.0	–	–	4096	2026-10-08	community	–	source
M5	Ternary-Bonsai-27B	2bit	oMLX	17.4	222.8	–	–	1024	2026-10-13	community	–	source
M5 Max	Ternary-Bonsai-27B	2bit	oMLX	17.2	394.6	–	–	131072	2026-10-17	community	–	source
M3 Pro	Ternary-Bonsai-27B	2bit	oMLX	17.2	102.8	–	–	1024	2026-10-17	community	–	source
M5	Ternary-Bonsai-27B	2bit	oMLX	17.0	233.1	–	–	4096	2026-10-08	community	–	source
M5	Ternary-Bonsai-27B	2bit	oMLX	14.4	212.9	–	–	16384	2026-10-08	community	–	source
M1 Pro	Ternary-Bonsai-27B	2bit	oMLX	13.4	80.1	–	–	4096	2026-10-06	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	13.4	317.9	–	–	4096	2026-10-11	community	contradiction outlier	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	13.4	317.9	–	–	4096	2026-10-11	community	contradiction outlier	source
M1 Pro	Ternary-Bonsai-27B	2bit	oMLX	12.1	77.6	–	–	16384	2026-10-06	community	–	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	11.5	310.9	–	–	1024	2026-10-11	community	contradiction outlier	source
M2 Ultra	Ternary-Bonsai-27B	2bit	oMLX	11.5	310.9	–	–	1024	2026-10-11	community	contradiction outlier	source

← all models