RTX 3090

132 records across 14 models (quants: EXL2 5.0bpw, IQ1_S, IQ2_M, IQ2_XXS, IQ3_XXS, MXFP4, PAW 1.54 bpw, PAW 2.17 bpw, PAW 3.5 bpw, Q4_0, Q4_K, Q4_K_M, Q4_K_S, Q8_0, unspecified).

hardwaremodelquantbackendtok/spp tok/sWttft sctx/tgdateclassflagssource
RTX 3090Gemma4 26B 26BQ4_Kllama.cpp119.43625.6––4096–sourced–source
RTX 3090Gemma4 26B 26BQ4_Kllama.cpp115.03068.9––16384–sourced–source
RTX 3090Gemma4 26B 26BQ4_Kllama.cpp107.52453.4––32768–sourced–source
RTX 3090Gemma4 26B 26BQ4_Kllama.cpp98.91765.1––65536–sourced–source
RTX 3090Gemma4 26B 26BQ4_Kllama.cpp83.01147.1––131072–sourced–source
RTX 3090Gemma4 26B 26BQ4_Kllama.cpp64.4671.4––262144–sourced–source
RTX 3090Gemma4 31B 31BQ4_Kllama.cpp34.71155.8––4096–sourced–source
RTX 3090Gemma4 31B 31BQ4_Kllama.cpp33.5913.2––16384–sourced–source
RTX 3090Gemma4 31B 31BQ4_Kllama.cpp31.4723.7––32768–sourced–source
RTX 3090llama 7B Q4_0llama.cpp (CUDA)163.695781.6––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)162.284732.33––tg1282025-09-24community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)160.134298.97––tg1282025-09-24community–source
RTX 3090llama 7B Q4_0llama.cpp (CUDA)159.365100.68––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)157.824409.02––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)156.574892.33––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)151.654356.94––tg1282025-12-11community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)151.654435.33––tg1282025-12-11community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)143.463877.12––tg1282025-12-11community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)142.764033.29––tg1282025-12-11community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)136.814543.96––tg1282025-07-08community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)133.634946.47––tg1282025-07-08community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)126.063384.6––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)125.63336.74––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)123.723301.47––tg1282025-01-08community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)122.614241.77––tg1282025-04-12communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)120.444516.92––tg1282025-04-12communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)118.54368.74––tg1282025-01-16community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)108.45783.94––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)107.324761.91––tg1282025-01-16community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)106.03912.47––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (ROCm)83.55997.21––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (ROCm)73.58426.56––tg1282025-09-01community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)36.82315.39––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)34.16180.97––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)33.9186.24––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)22.8307.71––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)22.41311.56––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)16.5675.59––tg1282025-06-18communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)16.0578.79––tg1282025-06-18communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)10.0976.53––tg1282025-06-18communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)10.0681.59––tg1282025-06-18communitycontradiction outliersource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)8.55117.48––tg1282025-06-18communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)5.8216.62––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)5.7117.7––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)5.6142.12––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)5.5441.26––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)5.4215.22––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)5.3519.18––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)2.8784.19––tg1282025-06-18communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)2.85107.8––tg1282025-06-18communitycontradictionsource
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)2.6723.19––tg1282025-06-18community–source
RTX 3090llama 7B Q4_0llama.cpp (Vulkan)2.6323.19––tg1282025-06-18community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)3166966––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2879335––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2816482––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2787661––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2786970––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2789713––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2776005––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)2566806––tg1282026-10-06community–source
RTX 3090Marco-Mini-Instruct Q4_K_Mllama.cpp (CUDA)1555160––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)30211416––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)29610157––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)29611146––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)2829142––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)2828578––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)27910185––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)2719402––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)2689681––tg1282026-10-06community–source
RTX 3090Marco-Nano-Instruct Q4_K_Mllama.cpp (CUDA)2419378––tg1282026-10-06community–source
RTX 3090Mistral 7BEXL2 5.0bpwExLlamaV2200––––2023-12community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)63.12–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)61.0–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)60.28–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)56.91–––655362026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)56.91–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)56.82–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)53.21–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)49.27–––655362026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)44.79–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)42.45–––655362026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)35.63–––327682026-04-01community–source
RTX 3090Qwen 3.5 9B Q8_0llama.cpp (CUDA)33.43–––655362026-04-01community–source
RTX 3090qwen-2.5-7b Q4_K_Mllama.cpp llama-bench95–––40962026-08-17sourced–source
RTX 3090Qwen3.5 35B 35BMXFP4llama.cpp111.22622.1––4096–sourced–source
RTX 3090Qwen3.5 35B 35BMXFP4llama.cpp107.12381.3––16384–sourced–source
RTX 3090Qwen3.5 35B 35BMXFP4llama.cpp101.22121.6––32768–sourced–source
RTX 3090Qwen3.5 35B 35BMXFP4llama.cpp93.11749.8––65536–sourced–source
RTX 3090Qwen3.5 35B 35BMXFP4llama.cpp79.41288.9––131072–sourced–source
RTX 3090Qwen3.5-27B 27BQ4_Kllama.cpp33.51104.2––4096–sourced–source
RTX 3090Qwen3.5-27B 27BQ4_Kllama.cpp32.3977.4––16384–sourced–source
RTX 3090Qwen3.5-27B 27BQ4_Kllama.cpp31.0848.2––32768–sourced–source
RTX 3090Qwen3.5-27B 27BQ4_Kllama.cpp28.8678.9––65536–sourced–source
RTX 3090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–5672.07––20482026-10-13sourced–source
RTX 3090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–6061.59––20482026-10-13sourced–source
RTX 3090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–5505.49––40962026-10-13sourced–source
RTX 3090Qwen3.5-35B-A3B Q4_K_Sllama.cpp–5683.79––40962026-10-13sourced–source
RTX 3090Qwen3.5-9B IQ1_Sllama.cpp (CUDA)168.1–––163842026-10-04community–source
RTX 3090Qwen3.5-9B IQ2_XXSllama.cpp (CUDA)156.4–––163842026-10-04community–source
RTX 3090Qwen3.5-9B IQ2_Mllama.cpp (CUDA)145.2–––163842026-10-04community–source
RTX 3090Qwen3.5-9B IQ3_XXSllama.cpp (CUDA)138.7–––163842026-10-04community–source
RTX 3090Qwen3.5-9B Q4_K_Mllama.cpp (CUDA)112.5–––163842026-10-04community–source
RTX 3090Qwen3.5-9B unspecifiedllama.cpp (CUDA)78.2–––163842026-10-04community–source
RTX 3090Qwen3.6-35B-A3B PAW 1.54 bpwllama.cpp (CUDA)182.7–––––community–source
RTX 3090Qwen3.6-35B-A3B PAW 1.54 bpwllama.cpp (CUDA)133.7–––––community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1303384––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1213735––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1203597––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1193320––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1182977––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1182997––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1183092––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1183192––tg1282026-10-06community–source
RTX 3090Qwen3.6-35B-A3B Q4_K_Mllama.cpp (CUDA)1172900––tg1282026-10-06community–source
RTX 3090Qwen3.8-27B llama-paw (llama.cpp CUDA fork, trellis codec); -fa on -ctk q4_0 -ctv q4_0 -c 262144; DFlash2 drafter where notedPAW 3.5 bpwllama.cpp (CUDA)129.09–––2621442026-10-01community–source
RTX 3090Qwen3.8-27B PAW 3.5 bpwllama.cpp (CUDA)100.45–––8192–community–source
RTX 3090Qwen3.8-27B PAW 2.17 bpwllama.cpp (CUDA)78.4–––––community–source
RTX 3090Qwen3.8-27B llama-paw (llama.cpp CUDA fork, trellis codec); -fa on -ctk q4_0 -ctv q4_0 -c 262144; DFlash2 drafter where notedPAW 3.5 bpwllama.cpp (CUDA)73.74–––2621442026-10-01community–source
RTX 3090Qwen3.8-27B PAW 2.17 bpwllama.cpp (CUDA)47.8–––191000–community–source
RTX 3090Qwen3.8-27B PAW 3.5 bpwllama.cpp (CUDA)33.5–––262144–community–source
RTX 3090Qwen3.8-27B llama-paw (llama.cpp CUDA fork, trellis codec); -fa on -ctk q4_0 -ctv q4_0 -c 262144; DFlash2 drafter where notedPAW 3.5 bpwllama.cpp (CUDA)30.16–––2621442026-10-01community–source
RTX 3090Qwen3.8-27B PAW 2.17 bpwllama.cpp (CUDA)22.7–––––community–source
RTX 3090Qwen3.8-27B PAW 3.5 bpwllama.cpp (CUDA)19.9–––211000–community–source
RTX 3090Qwen3.8-27B llama-paw (llama.cpp CUDA fork, trellis codec); -fa on -ctk q4_0 -ctv q4_0 -c 262144; DFlash2 drafter where notedPAW 3.5 bpwllama.cpp (CUDA)–982.87––2621442026-10-01community–source
RTX 3090Qwen3.8-27B llama-paw (llama.cpp CUDA fork, trellis codec); -fa on -ctk q4_0 -ctv q4_0 -c 262144; DFlash2 drafter where notedPAW 3.5 bpwllama.cpp (CUDA)–1268.67––2621442026-10-01community–source
RTX 3090Qwen3.8-27B PAW 3.5 bpwllama.cpp (CUDA)–1076.5––262144–community–source
RTX 3090Qwen3.8-27B PAW 3.5 bpwllama.cpp (CUDA)–1215.4––262144–community–source
RTX 3090Qwen3.8-27B PAW 3.5 bpwllama.cpp (CUDA)–563.0––262144–community–source
RTX 3090Qwen3.8-27B Q4_K_Mllama.cpp–1400.46––20482026-10-13sourced–source
RTX 3090Qwen3.8-27B Q4_K_Mllama.cpp–1412.4––20482026-10-13sourced–source
RTX 3090Qwen3.8-27B Q4_K_Mllama.cpp–1337.41––40962026-10-13sourced–source
RTX 3090Qwen3.8-27B Q4_K_Mllama.cpp–1367.46––40962026-10-13sourced–source

All rows cite their source. Provenance: community 40018 sourced 1085

← all hardware