Meta Llama 3 8B
18 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 310.76 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 348.75 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 404.1 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 404.85 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 499.45 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 498.73 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 461.94 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 461.13 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 481.94 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 537.13 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 593.97 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 594.73 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 660.72 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 661.46 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 794.69 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 795.33 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 867.15 | – | – | 2048 | 2026-10-05 | community | – | source |
| A800M | Meta Llama 3 8B | IQ4_NL | llama.cpp (ROCm) | – | 867.05 | – | – | 2048 | 2026-10-05 | community | – | source |