llama 7B all
1 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M3 Max | llama 7B all | F32 | llama.cpp (Metal) | 13.43 | 644.56 | – | – | tg128 | 2023-12-28 | community | – | source |
1 records across 1 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M3 Max | llama 7B all | F32 | llama.cpp (Metal) | 13.43 | 644.56 | – | – | tg128 | 2023-12-28 | community | – | source |