RTX 5090

152 records across 22 models (quants: APEX-I-MiniPlus V2.1, BF16, F16, Gyro-M, Gyro-S, MXFP4, MXFP4 (experts), NVFP4, Q4_0, Q4_K, Q4_K_M, Q4_K_S, Q4_blend2, Q4_blend4, Q4_blend5, Q6_K, Ternary PQ2_0, Ternary PTQ1_0).

hardwaremodelquantbackendtok/spp tok/sWttft sctx/tgdateclassflagssource
RTX 5090DeepSeek-V4.1-Flash MXFP4 (experts)llama.cpp (JigSawPT DSV4.1 port)21.3––––2026-09community–source
RTX 5090DeepSeek-V4.1-Flash MXFP4 (experts)llama.cpp (JigSawPT DSV4.1 port)21––––2026-09community–source
RTX 5090DeepSeek-V4.1-Flash MXFP4 (experts)llama.cpp (JigSawPT DSV4.1 port)6.2––––2026-09community–source
RTX 5090DeepSeek-V4.1-Flash MXFP4 (experts)llama.cpp (JigSawPT DSV4.1 port)5.1––––2026-09community–source
RTX 5090Gemma 4 12B Q4_K_Mllama.cpp279.09––––2026-10-12sourced–source
RTX 5090Gemma 4 12B Q4_K_Mllama.cpp278.37––––2026-10-12sourced–source
RTX 5090Gemma4 26B 26BQ4_Kllama.cpp180.38799.2––4096–sourced–source
RTX 5090Gemma4 26B 26BQ4_Kllama.cpp167.27733.2––16384–sourced–source
RTX 5090Gemma4 26B 26BQ4_Kllama.cpp159.46292.6––32768–sourced–source
RTX 5090Gemma4 26B 26BQ4_Kllama.cpp149.44360.6––65536–sourced–source
RTX 5090Gemma4 26B 26BQ4_Kllama.cpp130.22839.1––131072–sourced–source
RTX 5090Gemma4 26B 26BQ4_Kllama.cpp106.01707.2––262144–sourced–source
RTX 5090Gemma4 31B 31BQ4_Kllama.cpp61.13395.0––4096–sourced–source
RTX 5090Gemma4 31B 31BQ4_Kllama.cpp59.22794.3––16384–sourced–source
RTX 5090Gemma4 31B 31BQ4_Kllama.cpp55.42229.1––32768–sourced–source
RTX 5090Gemma4 31B 31BQ4_Kllama.cpp51.61459.3––65536–sourced–source
RTX 5090Gemma4 31B 31BQ4_Kllama.cpp43.4900.2––131072–sourced–source
RTX 5090gpt-oss 20B 20BQ4_Kllama.cpp298.29443.8––4096–sourced–source
RTX 5090gpt-oss 20B 20BQ4_Kllama.cpp249.27168.1––16384–sourced–source
RTX 5090gpt-oss 20B 20BQ4_Kllama.cpp215.15183.1––32768–sourced–source
RTX 5090gpt-oss 20B 20BQ4_Kllama.cpp169.03019.7––65536–sourced–source
RTX 5090gpt-oss 20B 20BQ4_Kllama.cpp112.01636.4––131072–sourced–source
RTX 5090KAT-Coder-V2.5 APEX-I-MiniPlus V2.1llama.cpp2472800–––2026-09-18community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)509.6––––2026-10-03community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)500.7––––2026-10-03community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)375.1––––2026-10-03community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)231.9312761.21––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)230.7012850.64––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)173.4312352.17––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)162.9512388.47––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)161.7912420.45––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)153.5412369.44––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)144.2211739.74––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)139.9011799.41––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)134.1211914.27––tg1282026-04-04community–source
RTX 5090Llama 3.1 8B Q4_K_Mllama.cpp (CUDA)125.4411309.70––tg1282026-04-04community–source
RTX 5090llama 7B Q4_0llama.cpp (Vulkan)273.6811796.38––tg1282025-10-11community–source
RTX 5090llama 7B Q4_0llama.cpp (Vulkan)263.6310381.64––tg1282025-10-11community–source
RTX 5090llama 7B Q4_0llama.cpp (Vulkan)154.316011.18160.0–tg1282026-09-17community–source
RTX 5090llama 7B Q4_0llama.cpp (Vulkan)149.415546.39––tg1282026-09-17community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)58.613649––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)56.733548––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)55.843547––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)55.603512––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)55.163577––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)51.69–––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)46.62–––327682026-04-01community–source
RTX 5090Qwen 3.5 27B Q6_Kllama.cpp (CUDA)38.88–––327682026-04-01community–source
RTX 5090Qwen2.5-7B-Instruct 7BBF16vLLM1404.7––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BF16llama.cpp (CUDA)1045.8––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BF16llama.cpp (CUDA)705.9––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BF16llama.cpp (CUDA)700.9––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BF16llama.cpp (CUDA)101.4––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BF16llama.cpp (CUDA)100.1––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BF16llama.cpp (CUDA)99.8––––2026-08community–source
RTX 5090Qwen2.5-7B-Instruct 7BBF16vLLM92.9––––2026-08community–source
RTX 5090Qwen3 14B 14BQ4_Kllama.cpp123.86497.6––4096–sourced–source
RTX 5090Qwen3 14B 14BQ4_Kllama.cpp102.74473.1––16384–sourced–source
RTX 5090Qwen3 14B 14BQ4_Kllama.cpp82.42908.4––32768–sourced–source
RTX 5090Qwen3 14B 14BQ4_Kllama.cpp57.61707.2––65536–sourced–source
RTX 5090Qwen3 14B 14BQ4_Kllama.cpp37.2908.4––131072–sourced–source
RTX 5090Qwen3 32B 32BQ4_Kllama.cpp61.42931.3––4096–sourced–source
RTX 5090Qwen3 32B 32BQ4_Kllama.cpp50.92077.2––16384–sourced–source
RTX 5090Qwen3 32B 32BQ4_Kllama.cpp43.81451.1––32768–sourced–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)235.00–––tg1282026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)234.35–––tg1282026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)234.31–––tg1282026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)215.63–––tg1282026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)212.66–––40962026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)211.93–––40962026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)211.85–––40962026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)171.85–––163842026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)169.06–––163842026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)168.94–––163842026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)164.41–––40962026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)134.39–––327682026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)131.24–––327682026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)131.09–––327682026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)100.54–––163842026-10community–source
RTX 5090Qwen3 8B Q4_K_Mllama.cpp (CUDA)65.07–––327682026-10community–source
RTX 5090Qwen3.5 35B 35BMXFP4llama.cpp165.26605.2––4096–sourced–source
RTX 5090Qwen3.5 35B 35BMXFP4llama.cpp148.36142.3––16384–sourced–source
RTX 5090Qwen3.5 35B 35BMXFP4llama.cpp143.25611.4––32768–sourced–source
RTX 5090Qwen3.5 35B 35BMXFP4llama.cpp133.54624.5––65536–sourced–source
RTX 5090Qwen3.5 35B 35BMXFP4llama.cpp118.23242.6––131072–sourced–source
RTX 5090Qwen3.5 35B 35BMXFP4llama.cpp97.32003.7––262144–sourced–source
RTX 5090Qwen3.5-27B 27BQ4_Kllama.cpp58.83004.1––4096–sourced–source
RTX 5090Qwen3.5-27B 27BQ4_Kllama.cpp55.82721.5––16384–sourced–source
RTX 5090Qwen3.5-27B 27BQ4_Kllama.cpp53.82341.8––32768–sourced–source
RTX 5090Qwen3.5-27B 27BQ4_Kllama.cpp50.11606.4––65536–sourced–source
RTX 5090Qwen3.5-27B 27BQ4_Kllama.cpp44.11019.8––131072–sourced–source
RTX 5090Qwen3.5-27B 27BQ4_K_Mllama.cpp30.091515.83––10242026-09community–source
RTX 5090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–12477.32––20482026-10-13sourced–source
RTX 5090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–14524.81––20482026-10-13sourced–source
RTX 5090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–12978.57––40962026-10-13sourced–source
RTX 5090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–15298.0––40962026-10-13sourced–source
RTX 5090Qwen3.6-27B Q4_K_Mllama.cpp136.59––––2026-10-12sourced–source
RTX 5090Qwen3.6-27B Q4_K_Mllama.cpp130.11––––2026-10-12sourced–source
RTX 5090Qwen3.6-27B 27B hybrid GDN + full attention (MTP head)NVFP4vLLM95.6––––2026-07community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)344.1––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)333.9––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)329.4––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)307.6––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)301.7––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)292.8––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)2818316––tg1282026-10-02community–source
RTX 5090Qwen3.6-35B-A3B Q4_blend4llama.cpp (CUDA)2588137––tg1282026-10-02community–source
RTX 5090Qwen3.6-35B-A3B Q4_blend5llama.cpp (CUDA)2588123––tg1282026-10-02community–source
RTX 5090Qwen3.6-35B-A3B NVFP4llama.cpp (CUDA)2508855––tg1282026-10-02community–source
RTX 5090Qwen3.6-35B-A3B Q4_blend2llama.cpp (CUDA)2478566––tg1282026-10-02community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)227.8––––2026-10-03community–source
RTX 5090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)187.0––––2026-10-03community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp299.21–––1310722026-10-01community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp295.85–––1310722026-10-01community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp291.21–––1310722026-09-30community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp274.54–––1310722026-09-30community–source
RTX 5090Qwen3.8-27B 27BNVFP4llama.cpp (CUDA)152–575––2026-10-04community–source
RTX 5090Qwen3.8-27B Q6_Kllama.cpp (focus-llama)102.7––––2026-09community–source
RTX 5090Qwen3.8-27B 27BNVFP4llama.cpp (CUDA)87.456258.74575–1282026-10-04community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)82.8––––2026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)78.9––––2026-09community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp78.67––––2026-09-30community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp78.49––––2026-09-30community–source
RTX 5090Qwen3.8-27B Q6_Kllama.cpp76.2––––2026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)–6122––163842026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)–8860––163842026-09community–source
RTX 5090Qwen3.8-27B NVFP4NInfer–8466––163842026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)–8499––163842026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)–6518––163842026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)–7065––163842026-09community–source
RTX 5090Qwen3.8-27B NVFP4llama.cpp (CUDA)–7550––163842026-09community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp–3731.18–––2026-09-30community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp–3718.85–––2026-09-30community–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp–4095.61––20482026-10-13sourced–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp–4320.75––20482026-10-13sourced–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp–4114.11––40962026-10-13sourced–source
RTX 5090Qwen3.8-27B Q4_K_Mllama.cpp–4353.09––40962026-10-13sourced–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-SStrata221–––tg1282026-10-05community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-Sllama.cpp (CUDA)218–––tg1282026-10-04community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-Sllama.cpp (CUDA)210–––tg1282026-10-04community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-SStrata209–––tg1282026-10-05community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-Sllama.cpp (CUDA)180–––tg1282026-10-04community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-SStrata140–––tg1282026-10-05community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-MStrata114–––tg1282026-10-05community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-Sllama.cpp (CUDA)1133000––tg1282026-10-04community–source
RTX 5090Qwen3.8-Flash-Next Q4_0llama.cpp (CUDA)67.8–––tg5122026-10-03community–source
RTX 5090Qwen3.8-Flash-Next Q4_0llama.cpp (CUDA)54.5–––tg5122026-10-03community–source
RTX 5090Qwen3.8-Flash-Next Q4_0llama.cpp (CUDA)30.8–––tg5122026-10-03community–source
RTX 5090Qwen3.8-Flash-Next 126BGyro-SStrata–4883–––2026-10-05community–source
RTX 5090qwen3moe 30B.A3B 30B-A3BQ4_K_Mllama.cpp134.184081.2––10242026-09community–source
RTX 5090Ternary-Bonsai-2-27B Ternary PQ2_0llama.cpp (CUDA)129.93893––tg1282026-09-16community–source
RTX 5090Ternary-Bonsai-2-27B Ternary PTQ1_0llama.cpp (CUDA)120.51805––tg1282026-09-16community–source

All rows cite their source. Provenance: community 40018 sourced 1085

← all hardware