The dataset
41103 measured records, retrieved 2026-10-22. Download and diff: the data is the product, not the site. Reference estimates are kept apart from records (see below).
- records.csv (measured records only)
- records.json (measured records only)
- reference/estimates.json (618 reference estimates, not records)
- reference/cluster.json (11 cluster/multi-node runs, measured and source-cited but out of record scope)
- sources.json (source registry)
Schema
| field | meaning |
|---|---|
id | stable unique slug for the record |
model | model name as published by the source |
params | parameter size, as published (e.g. 8B, 3.8B) |
quant | quantization (e.g. Q4_K_M) |
hardware | chip/hardware identifier (e.g. M5 Max, RTX 4090) |
ram_gb | memory, GB (when the source states it) |
backend | inference backend/engine (llama.cpp, MLX, Ollama, vLLM, …) |
ctx | context depth the benchmark actually ran at (when stated; null when the harness did not fix a context) |
batch | batch size / concurrency (when stated) |
tps | generation tokens/second |
pp_tps | prompt-processing tokens/second (when reported) |
pp_tokens | prompt token length of the prompt test (e.g. 512 for pp512) |
tg_tokens | generation token length of the decode test (e.g. 128 for tg128) |
scope | record scope: empty = in scope; cluster = multi-node/cluster run, reference area only |
ttft_s | time to first token, seconds (when reported) |
power_w | power draw, watts (when reported) |
flags | computed flags: contradiction / outlier (see schema.md rules 4-5) |
date | original measurement date, as published |
provenance | sourced | community | estimated (see schema) |
source_url | URL the number was retrieved from |
source_name | name of the source dataset/page |
retrieved | date this record was retrieved |
quote | exact values as they appear in the source (comma-joined row) |
notes | collector notes |
No record without provenance
Every row carries source_url, retrieved, and quote
(the exact values as published). estimated rows (the source's own model-based
estimates) are reference values, not records: they live in
data/reference/estimates.json, are excluded from record counts, and are only
shown where explicitly labeled (lookup toggle, cross-source checks).
Rules and field semantics: data/schema.md.