qwen-2-5-14b-instruct
52 records across 52 hardware.
| hardware | model | quant | backend | tok/s | pp tok/s | W | ttft s | ctx/tg | date | class | flags | source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M3 Ultra (80-core GPU, 256 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 36.711573666666666 | 568.2534414444444 | – | 2.077086245444445 | – | – | sourced | – | source |
| M2 Ultra (76-core GPU, 128 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 36.626677 | 470.5342577777778 | – | 2.484028763888889 | – | – | sourced | – | source |
| M3 Ultra (80-core GPU, 512 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 35.80064133333334 | 577.4241827222222 | – | 2.0507156840555556 | – | – | sourced | – | source |
| M3 Ultra (60-core GPU, 96 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 34.43578599999999 | 444.62243322222224 | – | 2.672898578888889 | – | – | sourced | – | source |
| M5 Max (32-core GPU, 36 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 34.28566722222222 | 343.244466 | – | 3.5801585140000003 | – | – | sourced | – | source |
| M2 Ultra (60-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 34.21236922222223 | 381.12729266666673 | – | 3.0647734165555556 | – | – | sourced | – | source |
| M1 Ultra (64-core GPU, 128 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 32.417089222222224 | 371.7215576111111 | – | 3.126813851888889 | – | – | sourced | – | source |
| M4 Max (40-core GPU, 48 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 30.13459711111111 | 347.03543255555553 | – | 3.4913595508333337 | – | – | sourced | – | source |
| M4 Max (40-core GPU, 128 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 28.74764654814815 | 326.6194374666667 | – | 3.7867302675777776 | – | – | sourced | – | source |
| M1 Ultra (48-core GPU, 128 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 27.773420277777777 | 289.8969081111111 | – | 4.044066250166667 | – | – | sourced | – | source |
| M4 Max (40-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 25.874467866666663 | 286.74860906666663 | – | 4.498645011088889 | – | – | sourced | – | source |
| M3 Max (40-core GPU, 128 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 25.48905755555555 | 302.37069566666673 | – | 4.070913819333334 | – | – | sourced | – | source |
| M2 Max (38-core GPU, 96 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 25.230792444444447 | 252.470057 | – | 4.798504768333334 | – | – | sourced | – | source |
| M4 Max (32-core GPU, 36 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 24.60766388888889 | 273.40494424444444 | – | 4.441582821466667 | – | – | sourced | – | source |
| M2 Max (38-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 21.958976814814815 | 222.7697787777778 | – | 5.511166165148148 | – | – | sourced | – | source |
| M3 Max (30-core GPU, 96 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 20.766045 | 238.76133155555556 | – | 5.162620243055555 | – | – | sourced | – | source |
| M2 Max (38-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 20.586609111111116 | 225.5740881111111 | – | 4.983570564777778 | – | – | sourced | – | source |
| M1 Max (32-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 20.07296611111111 | 195.8191797407407 | – | 6.301562639796296 | – | – | sourced | – | source |
| M3 Max (30-core GPU, 36 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 19.768525888888888 | 226.180183 | – | 5.407046111222224 | – | – | sourced | – | source |
| M1 Max (32-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 19.01644427777778 | 185.93018677777775 | – | 6.8818776490777775 | – | – | sourced | – | source |
| M4 Pro (20-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 18.008562833333333 | 182.97843991666667 | – | 6.9151872395 | – | – | sourced | – | source |
| M4 Pro (20-core GPU, 24 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 17.982970555555557 | 190.44284311111113 | – | 6.6294910853968245 | – | – | sourced | – | source |
| M4 Pro (20-core GPU, 48 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 17.981375188034185 | 189.7956117692308 | – | 6.62966483617094 | – | – | sourced | – | source |
| M1 Max (24-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 17.355148333333332 | 155.93443555555555 | – | 7.862980407555557 | – | – | sourced | – | source |
| M4 Pro (16-core GPU, 48 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 16.762545222222222 | 161.09253933333332 | – | 7.843727675888888 | – | – | sourced | – | source |
| M4 Pro (16-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 16.132661555555554 | 151.01082800000003 | – | 8.460523194444445 | – | – | sourced | – | source |
| M4 Pro (16-core GPU, 24 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 15.160405666666666 | 144.2954926666667 | – | 8.903966308944444 | – | – | sourced | – | source |
| M1 Max (24-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 15.135508527777777 | 140.19277200000002 | – | 8.830140840277778 | – | – | sourced | – | source |
| M2 Max (30-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 14.487775777777776 | 149.0023927777778 | – | 7.678328407666665 | – | – | sourced | – | source |
| M2 Pro (19-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 14.116209888888887 | 137.32948566666667 | – | 9.101328361111113 | – | – | sourced | – | source |
| M3 Max (40-core GPU, 64 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 13.801572 | 200.82679227777783 | – | 6.657162884277778 | – | – | sourced | – | source |
| M2 Pro (16-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 13.350706388888891 | 118.980526 | – | 10.621650037111111 | – | – | sourced | – | source |
| M3 Pro (14-core GPU, 36 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 12.10437772222222 | 119.77962366666664 | – | 10.648140152777778 | – | – | sourced | – | source |
| M3 Pro (18-core GPU, 36 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 11.988618277777778 | 147.43616580555556 | – | 8.729495730361112 | – | – | sourced | – | source |
| M1 Pro (16-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 11.90798088888889 | 106.6591231111111 | – | 11.83519856488889 | – | – | sourced | – | source |
| M3 Pro (14-core GPU, 18 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 11.886003166666669 | 117.03684152777775 | – | 10.918680665472221 | – | – | sourced | – | source |
| M3 Pro (18-core GPU, 18 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 11.63579448148148 | 144.77590885185188 | – | 8.883480046185184 | – | – | sourced | – | source |
| M1 Pro (16-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 11.619242305555556 | 104.4587133888889 | – | 12.083205306861112 | – | – | sourced | – | source |
| M5 (10-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 11.536774722222225 | 110.4192515 | – | 11.637239780333331 | – | – | sourced | – | source |
| M1 Pro (14-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 10.8301478 | 92.4920569777778 | – | 13.4879233686 | – | – | sourced | – | source |
| M1 Pro (14-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 10.399665111111112 | 88.86977233333333 | – | 14.166348648222224 | – | – | sourced | – | source |
| M4 (10-core GPU, 24 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 9.238281555555554 | 93.30326355555556 | – | 13.714502268555552 | – | – | sourced | – | source |
| M4 (10-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 8.726884422222223 | 83.05415 | – | 15.662719702777778 | – | – | sourced | – | source |
| M4 (10-core GPU, 32 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 8.58771625925926 | 79.33710781481481 | – | 15.81842497840741 | – | – | sourced | – | source |
| M2 (10-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 8.076025111111111 | 74.75765844444444 | – | 17.296274291666677 | – | – | sourced | – | source |
| M1 Ultra (GPU count not published, 128 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 7.9883163333333345 | 38.83732133333333 | – | 32.935429014111115 | – | – | sourced | – | source |
| M2 (10-core GPU, 24 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 7.345236666666668 | 70.25649544444445 | – | 18.027677185222224 | – | – | sourced | – | source |
| M4 (8-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 7.234274277777778 | 61.06916633333333 | – | 20.47596530788889 | – | – | sourced | – | source |
| M2 (8-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 6.960648666666668 | 59.9820798888889 | – | 21.432082513888886 | – | – | sourced | – | source |
| M3 (10-core GPU, 24 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 6.133619851851852 | 65.80348074074074 | – | 19.91686526244444 | – | – | sourced | – | source |
| M1 (8-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 5.429473666666667 | 53.26808444444444 | – | 24.55238074088889 | – | – | sourced | – | source |
| M1 (7-core GPU, 16 GB) | qwen-2-5-14b-instruct | Q4_K - Medium | llamafile | 4.806673055555556 | 40.612479388888886 | – | 30.980614497666668 | – | – | sourced | – | source |