Mellum2-12B-A2.5B-Instruct
53 records across 3 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 135.8 | 1857.0 | – | – | 1024 | 2026-10-07 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 134.4 | 1737.0 | – | – | 4096 | 2026-10-07 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 128.8 | 1073.0 | – | – | 1024 | 2026-10-08 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 125.2 | 3980.0 | – | – | 8192 | 2026-10-08 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 125.0 | 2680.0 | – | – | 4096 | 2026-10-08 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 124.5 | 1870.0 | – | – | 8192 | 2026-10-07 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 120.0 | 2002.0 | – | – | 1024 | 2026-10-15 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 119.0 | 3888.0 | – | – | 4096 | 2026-10-08 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 118.8 | 3677.0 | – | – | 1024 | 2026-10-08 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 118.5 | 1859.0 | – | – | 1024 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 116.8 | 3807.0 | – | – | 16384 | 2026-10-08 | community | – | source |
| M4 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 116.5 | 1037.0 | – | – | 1024 | 2026-10-17 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 113.1 | 1925.0 | – | – | 4096 | 2026-10-12 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 112.5 | 1926.0 | – | – | 4096 | 2026-10-15 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 108.5 | 3877.0 | – | – | 8192 | 2026-10-08 | community | contradiction | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 106.7 | 1800.0 | – | – | 16384 | 2026-10-07 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 106.0 | 1874.0 | – | – | 8192 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 105.1 | 3373.0 | – | – | 32768 | 2026-10-08 | community | – | source |
| M4 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 105.0 | 860.6 | – | – | 16384 | 2026-10-17 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 103.5 | 2337.0 | – | – | 1024 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 103.5 | 2337.0 | – | – | 1024 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 97.9 | 3138.0 | – | – | 4096 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 97.9 | 3138.0 | – | – | 4096 | 2026-10-12 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 95.1 | 1697.0 | – | – | 16384 | 2026-10-12 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 95.1 | 1846.0 | – | – | 8192 | 2026-10-15 | community | contradiction | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 94.0 | 3767.0 | – | – | 16384 | 2026-10-08 | community | contradiction | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 92.6 | 1731.0 | – | – | 16384 | 2026-10-15 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 91.4 | 3299.0 | – | – | 8192 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 91.4 | 3299.0 | – | – | 8192 | 2026-10-12 | community | – | source |
| M4 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 87.5 | 1002.0 | – | – | 1024 | 2026-10-17 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 84.0 | 1289.0 | – | – | 32768 | 2026-10-07 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 81.3 | 3148.0 | – | – | 16384 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 81.3 | 3148.0 | – | – | 16384 | 2026-10-12 | community | – | source |
| M4 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 80.6 | 820.0 | – | – | 16384 | 2026-10-17 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 79.2 | 1530.0 | – | – | 32768 | 2026-10-15 | community | – | source |
| M4 Pro | Mellum2-12B-A2.5B-Instruct | 8bit | oMLX | 79.2 | 1070.0 | – | – | 1024 | 2026-10-17 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 76.5 | 1304.0 | – | – | 32768 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 72.6 | 3330.0 | – | – | 32768 | 2026-10-08 | community | contradiction | source |
| M4 Pro | Mellum2-12B-A2.5B-Instruct | 8bit | oMLX | 70.7 | 831.8 | – | – | 16384 | 2026-10-17 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 66.5 | 2870.0 | – | – | 32768 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 66.5 | 2870.0 | – | – | 32768 | 2026-10-12 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 56.5 | 1200.0 | – | – | 65536 | 2026-10-15 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 53.9 | 1099.0 | – | – | 65536 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 51.8 | 2646.0 | – | – | 65536 | 2026-10-08 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 50.6 | 990.6 | – | – | 65536 | 2026-10-07 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 48.3 | 2300.0 | – | – | 65536 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 48.3 | 2300.0 | – | – | 65536 | 2026-10-12 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 35.9 | 881.4 | – | – | 131072 | 2026-10-12 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 34.4 | 804.8 | – | – | 131072 | 2026-10-07 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | mxfp4 | oMLX | 32.4 | 1922.0 | – | – | 131072 | 2026-10-08 | community | – | source |
| M3 Max | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 31.7 | 764.4 | – | – | 131072 | 2026-10-15 | community | contradiction | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 31.5 | 1749.0 | – | – | 131072 | 2026-10-12 | community | – | source |
| M5 Pro | Mellum2-12B-A2.5B-Instruct | 6bit | oMLX | 31.5 | 1749.0 | – | – | 131072 | 2026-10-12 | community | – | source |