How the numbers are made

How to read the board

Index

The mean opinion of a random sample of the items that name a model, among those that hold an opinion, weighted by 1 / the item's sample share, on a 0–100 scale: 0 = all opinions very negative, 50 = neutral, 100 = all very positive. The headline figure pools the last 7 UTC days (fewer while collection is younger, as its label says) and all subreddits, so a shift in the subreddit mix moves it; the model page shows the same figure per subreddit. The daily values are detail. A model's index holds only the opinions that name it (see Models and series). The whole page is that scale: 0 at the left margin, 50 at the centre line, 100 at the right margin, and every number stands where its value is. Some counted opinions are not the author's own opinion of the model; how many is under Limits.050100

n and ±

n is the effective number of opinions behind an index, (Σw)² / Σw², which is below the count when the weights differ; ± a 95% interval, cluster-robust by thread and by account: opinions in one thread tend to agree, and so do one account's opinions across threads, so each thread and each account is a unit of the variance, and the interval widens when there are few threads or accounts, or one of them holds a large share of the opinions; one account alone gives no interval. The ± covers the sample and that clustering only, not the scorer: when the question set changes, the whole history is rescored under the new one, and the switch of the second stage from Claude Haiku to DeepSeek V4.1 Flash (2026-09-27) moved series by up to 6.5 points. Fewer than 10 opinions, or an interval that would span the whole scale: no index, only the n. Fewer than 30, or from fewer than 20 threads or 20 accounts: italic on a dashed interval, an early read. Beside the ±, in words: positive or negative when the whole interval is above or below 50, otherwise no clear lean.6038

Rank

The board ranks the full reads first, by index, then the early reads (fewer than 30 opinions, 20 threads or 20 accounts) below them, by index, so an early read never heads the board; a series is never ranked. On the same index as shown, the model with more opinions ranks first, then the one with more mentions, then the higher index before rounding; two models share a rank ("=2", joined by a bracket) only when all of these are equal. A rank is not a verdict: two models a point or two apart are often within each other's 95% interval, which each row's card shows.

Colour

Sentiment runs cold to warm: grey around 50, shading towards blue below and orange above; only numbers carry it. Mentions bars are grey; lab logos keep their own colours. The status line at the foot of this page uses colour for operational state (amber, red).

Mentions

Posts and comments that name the model, counted in code on every fetched item. Bot and moderator comments are dropped before counting. On the board's axis, every rated model is a tick.

Change

The 7-day index minus the previous 7 days' index, shown only when both windows are full (not thin) and collection covers all of the previous 7 days. Its ± is √(±₁² + ±₂²) of the two windows; a change no larger than its ± is marked within noise.

A sample, not a census

Every number carries its n, and the source is the feeds' latest items only.

Collection

25 subreddits, two RSS feeds each: new posts and the latest comments (the quietest subreddits share one feed per kind), one request at a time, at most one a minute (one every three minutes for a day after Reddit asks to slow down). Each feed is fetched as often as its pace needs, from every 10 minutes to every 6 hours (posts up to 12). A feed returns at most 100 items; when all 100 are new, the next 100 are fetched too, so the busiest comment feeds are covered almost in full. What remains is a sample, not a census. Nothing before a subreddit's first fetch counts; RSS has no archive. Comments by bot and moderator accounts (AutoModerator, mod teams, reminder bots) are dropped on arrival.

• r/LocalLLaMA
• r/ClaudeAI
• r/ClaudeCode
• r/OpenAI
• r/ChatGPT
• r/singularity
• r/MachineLearning
• r/Bard
• r/GeminiAI
• r/grok
• r/DeepSeek
• r/Qwen_AI
• r/LocalLLM
• r/kimi
• r/ZaiGLM
• r/codex
• r/LLMDevs
• r/SillyTavernAI
• r/claude
• r/Anthropic
• r/ChatGPTPro
• r/ChatGPTCoding
• r/opencodeCLI
• r/GithubCopilot
• r/cursor

Mentions

Counted in code on every item: an alias of a series or a model in the item's own text (a post's title and body, a comment's body), with coding-tool names (Claude Code, Codex, Cursor, Pragma, Claude Cowork) removed first; "Codex" right after a version number ("GPT-5.3 Codex") is a model and stays. Series marked mentions only are counted but not yet scored: they join the judges' question with the next question set. A family series (claude, gpt, gemini) counts only when no specific series of the same lab is named. Series totals count distinct items, so an item naming two of its models counts once for the series.

Models and series

A model is one entry of the model list ("Claude Opus 5.5"); a series ("Claude Opus") groups models for navigation and matching and has no index, change or rank of its own. The models are found in code. Which models exist comes from OpenRouter's public model list and, for models it no longer carries, Epoch AI's, both read daily, and for open-weight models neither has, the labs' own Hugging Face pages, where a model counts once 5 items in 7 days name it; batch, free and dated snapshots count as one model, and a Pro/Flash/Max variant is its own model only once it has 5 mentions. A series the registry lacks (the name before a listed model's number, "Llama" in "Llama 3.3") is added by itself once 10 items in 7 days name one of its models, and is scored from then on. A mention goes to the most specific model named ("Opus 5.5" is never "Opus 5"). Each model an item names gets its own opinion; a comment in a thread whose title names a model of a series the comment names no model of is asked about the title's model. An item that names only the series ("Opus") is a mention of the series and gets no opinion: which model was meant is not guessed. A generation named after its models ("GPT-6", "MiMo V2.6") with no entry of its own is not a model here. The family series ("Claude", "GPT / ChatGPT", "Gemini") are brand mentions: items naming the brand with no series; a model named with no series ("GPT-4o") belongs to them. Gemini has two series, Gemini Pro and Gemini Flash, as Claude has Opus and Sonnet. Version-like names that are not in the list ("Sonnet 5.5") are counted separately, on Upcoming.

Sentiment

Every item that names a model (in its text or thread title) is scored while that fits the model budget of $45 a month. Should the volume outgrow it, a fixed-seed random sample is scored instead: each series gets its own share, recomputed daily from the last 7 days; the series with the fewest items stay in full, and every other series gets the same expected number of scored items. An item takes the largest share among the series it names, and its opinion is weighted by 1 / that share (1 when everything is scored), so a heavy series' index is not tilted toward the items that also name a thin series.

Code lists every model an item names; a small language model, pinned to one version, answers for each one whether the author judges it. Those it passes go to DeepSeek V4.1 Flash one model at a time, which decides whether the author states their own opinion of that model and scores it 1–5, so a comparison gives an opinion for each model it judges. A model that is only the yardstick for another ("better than Sol") gets no opinion from it, and neither does an image, video or audio generator sharing a model's name (Grok Imagine). Complaints about the app, limits or plans do not count.

The index maps the mean of those scores linearly to 0–100, weighted as above. Day = the item's publish time, UTC. The model page also shows each day's own index with its own interval, with no value below 10 opinions; the release date is in the title line. A day of the 7 is marked above or below the week only when it and the rest of the week are full reads and the gap between them clears both intervals combined, widened for the number of days tested (Bonferroni), so a page shows a mark by chance about 1 time in 20. Today is tested as it fills, so its mark is provisional until the day ends. The landing's mover line names a model only when its page marks today or yesterday and the gap also clears the bar widened for every model-day the landing tests at once.

Benchmarks

Each model page lists outside measurements beside Reddit's index, read once a day: Arena's blind head-to-head votes (the style-controlled text arena and Code Arena, from the LMArena leaderboard dataset, CC BY 4.0), the Artificial Analysis indices as OpenRouter passes them on, Epoch AI's Capabilities Index (CC BY), and OpenRouter's prices and limits. A source that ran a model at several reasoning efforts shows each; the one with the most votes stands for the model. None of them feeds the index.

Limits

• The numbers come from the feeds' latest items; every one that names a model is scored while that fits the budget.
• The index describes the people who post about a model in these subreddits, not everyone who uses it. Those with a complaint or something to boast about write more, and one account can write many opinions; nothing is weighted for expertise or activity. A busy account widens the interval instead: it is clustered by account as well as by thread (since 2026-10-04, past figures included), and a model whose opinions come from fewer than 20 accounts is an early read. The interval covers the sample, not that selection. The same model can read quite differently in two subreddits, which is why its page shows each one, and its interval's note says how many accounts wrote the week's opinions.
• Only named bot and moderator accounts are dropped. Other bots, paid posts and coordinated campaigns are not detected.
• Not every counted opinion is one. On 2026-11-01, 160 opinions the pipeline counted were drawn at random from the kept text and judged by two independent reviewers (Claude models that did not see the pipeline's answer; a third settled disagreements). The reviewers could not tell for 0, and of the other 160, 144 were the author's own opinion of that model: 90 % (95 % interval 84–94 %).
• Post and comment text is kept 90 days and never shown here. A thread's title shows for 7 days after its last counted opinion, so the title of a thread deleted on Reddit can stay that long; write to [email protected] to have one removed.

Contact

Questions, corrections or a model we miss: [email protected].

Right now

Last Reddit fetch

5m ago

Sample

scoring every item that names a model