Llama-3-Groq-8B-Tool-Use
10 records across 3 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M5 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 61.1 | 492.8 | – | – | 1024 | 2026-10-13 | community | – | source |
| M5 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 59.8 | 1749.0 | – | – | 1024 | 2026-10-09 | community | – | source |
| M5 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 55.7 | 479.3 | – | – | 4096 | 2026-10-13 | community | – | source |
| M5 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 55.1 | 1727.0 | – | – | 4096 | 2026-10-09 | community | – | source |
| M4 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 53.1 | 475.1 | – | – | 1024 | 2026-10-13 | community | – | source |
| M4 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 49.6 | 376.5 | – | – | 1024 | 2026-10-09 | community | – | source |
| M4 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 47.9 | 457.4 | – | – | 4096 | 2026-10-13 | community | – | source |
| M4 Pro | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 44.2 | 352.2 | – | – | 4096 | 2026-10-09 | community | – | source |
| M4 | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 22.8 | 236.4 | – | – | 1024 | 2026-10-06 | community | – | source |
| M4 | Llama-3-Groq-8B-Tool-Use | 4bit | oMLX | 20.8 | 226.8 | – | – | 4096 | 2026-10-06 | community | – | source |