Method
How every case is triaged.
Public posts from the sources below, fetched politely, newest first.
Claude judges each against one fixed definition, quoting the post.
Kept only if that quote is found verbatim in the stored post.
The window every number on this page uses.
Grouped into failure patterns; only aggregates are published.
Sources
7,076 github1,140 hackernews425 cursor forum319 stackoverflow169 bubble forum150 vercel forum130 netlify forum82 fly forum55 freecodecamp forum
We search public forums (Stack Overflow, GitHub issues, Hacker News and vendor community forums) with the same number of queries for each of 12 stages of going live, from deploys and configuration to sign-in, payments, data, performance, AI APIs, email, domains and abuse, so no area is over-sampled by how we search.
Each post is judged by a model given one fixed definition (a first-person report of the author's own app failing in production or at launch) and a fixed list of categories. It is not told who publishes this report. A verdict counts only if it comes with a quote that we find word for word in the stored post.
For every case we keep the post as fetched, its hash, the fetch time and a copy of the page (985 of 1103 also in the Internet Archive), so any number here can be traced to its sources even if a post is later edited or deleted. We publish only aggregates: no names, handles or quotes.
Limits: English-language public forums only, and people who post about a failure are not a random sample of all apps. Counts can overlap between patterns. Gemmein publishes this report and sells a backend; the collection and judging above are blind to that, and each pattern says plainly when Gemmein has nothing to do with it.
How we check this data
Every day a sample of already-judged posts, spread evenly across sources and across "case" and "not a case" verdicts, is judged a second time by a reader that is never shown the first verdict. Where the two disagree, a third pass looks at the post and our stored copy of the page and settles it; the case is then kept, corrected or excluded.
800 posts re-checked since 2026-10-07; the two readers agreed on 82.5% (last 30 days: 83.0% of 700). 63 correction(s) so far: 35 verdict, 25 category, 3 duplicate. Identical cross-posts count once. Of the re-checked posts, 18 had since been removed or moved (2 of them backed by our stored copy).
Source mix of the counted cases: github 64%, stackoverflow 11%, vercel forum 8%, netlify forum 6%, fly forum 5%, hackernews 2%, bubble forum 2%, cursor forum 1%, freecodecamp forum 0%. One source is above 40%, so collection is being widened to other neutral forums. Guides are re-read against the current official documentation at least every 14 days (19 reviewed in the last 14); each shows its review date and what changed.
Corrections log (latest 12)
- 2026-11-10 · category · github: other → performance & scaling
- 2026-11-10 · category · github: config & secrets → abuse & security
- 2026-11-09 · category · github: other → files & storage
- 2026-11-09 · verdict · github: case → not
- 2026-11-09 · verdict · github: case → not
- 2026-11-08 · verdict · github: case → not
- 2026-11-08 · category · stackoverflow: config & secrets → deploy & build
- 2026-11-08 · verdict · github: case → not
- 2026-11-08 · category · stackoverflow: other → config & secrets
- 2026-11-07 · verdict · bubble forum: case → not
- 2026-11-06 · verdict · fly forum: not → case
- 2026-11-06 · category · github: sign-in & sessions → other