Note: the game-rule checks described below were pushed after this PR merged, so they are not part of it. They are in #37.
Adds the receiving side for runs from the r/fourthwing Dragonkind megathread comments, a new source reddit comment.
How the data arrives
The threshing-reddit scraper reads the megathreads every 6 hours. It delivers by pull request only: it opens (or updates) one PR from data/reddit-comments that changes data/public/reddit_comments.json, for a person to review. It never pushes to main and never merges itself.
Each run is the "Report a run" answers: the option labels of collection/specs/report_form.yaml. The scraper checks them against this repo's live form before sending. Kept per run: comment id, thread id, day, answers, and a result-page id if linked. No usernames, no comment text.
What changes here
collection/pipeline.yaml: a reddit_comments source with extract kind delivered. The atlas fetches nothing; update skips it with a note.
collection/etl/runs.py: the coder. It shares one answers_row() with the reported coder (that refactor is byte-identical: runs_clean.csv is unchanged).
Every row is flagged "read from a Reddit comment", plus "automatically, not checked by hand" until a correction touches it.
A result page that a comment already carries is not counted again as a reddit thread row.
collection/manual/reddit_comments.yaml: reject / fix / add, applied at build time, so a correction never waits for the threads to change.
Dictionary, SOURCES.md, collection README, croissant: the new source value and file.
Tests: hand corrections, flags, dictionary validity, and the delivered source being skipped by update.
data/public/reddit_comments.json starts empty; the first scraper PR fills it.
Game-rule checks (second commit)
Runs answered through "Report a run" (reported and reddit comment) now get the checks the community form gets in core/atlas/coding.py. Each broken rule is a data_flags entry; the run is kept.
First dragon: outside the documented pool for the company and direction.
Encounter dragon: a bond or burn by a dragon the encounter doesn't have. This uses a new encounter_colours table in core/spec/form.yaml; Orange/Brown after the two Greens is allowed, as a Green's rescue.
Valley Green: a Green on a valley run.
Cadet path: an outcome off its scream path; fight answers or a post-fight path on a run that didn't help; a second fight move without assessing.
Early death: died before the hour, yet reached the tree, the valley or an encounter.
Route model:planner/policy.yaml gains drop_flagged. Flagged runs of reddit comment stay out of the model; the "read from a Reddit comment" note doesn't count. A hand fix in collection/manual/reddit_comments.yaml that clears the flags brings a run back. This has no effect until reddit comment is added to sources; reported is unchanged.
On the first 82 scraped runs: 6 are flagged (shadow with Brown/Red, Green after jumping on the Red, Red in the meadow, Orange first for Alone/Center, cadet-path mixes).
Not in this PR
Route model and statistics: they don't use the source until reddit comment is named in planner/policy.yamlsources / analysis/stats/measures.yaml.
> **Note:** the game-rule checks described below were pushed after this PR merged, so they are not part of it. They are in #37.
Adds the receiving side for runs from the r/fourthwing Dragonkind megathread comments, a new source `reddit comment`.
## How the data arrives
The [threshing-reddit](https://git.kenschiano.net/DragonKind/threshing-reddit) scraper reads the megathreads every 6 hours. It delivers by **pull request only**: it opens (or updates) one PR from `data/reddit-comments` that changes `data/public/reddit_comments.json`, for a person to review. It never pushes to `main` and never merges itself.
Each run is the **"Report a run" answers**: the option labels of `collection/specs/report_form.yaml`. The scraper checks them against this repo's live form before sending. Kept per run: comment id, thread id, day, answers, and a result-page id if linked. No usernames, no comment text.
## What changes here
- **`collection/pipeline.yaml`**: a `reddit_comments` source with extract kind `delivered`. The atlas fetches nothing; `update` skips it with a note.
- **`collection/etl/runs.py`**: the coder. It shares one `answers_row()` with the `reported` coder (that refactor is byte-identical: `runs_clean.csv` is unchanged).
- Every row is flagged "read from a Reddit comment", plus "automatically, not checked by hand" until a correction touches it.
- A result page that a comment already carries is not counted again as a `reddit thread` row.
- **`collection/manual/reddit_comments.yaml`**: `reject` / `fix` / `add`, applied at build time, so a correction never waits for the threads to change.
- **Dictionary, `SOURCES.md`, collection README, croissant**: the new source value and file.
- **Tests**: hand corrections, flags, dictionary validity, and the delivered source being skipped by `update`.
`data/public/reddit_comments.json` starts empty; the first scraper PR fills it.
## Game-rule checks (second commit)
Runs answered through "Report a run" (`reported` and `reddit comment`) now get the checks the community form gets in `core/atlas/coding.py`. Each broken rule is a `data_flags` entry; the run is kept.
- **First dragon:** outside the documented pool for the company and direction.
- **Encounter dragon:** a bond or burn by a dragon the encounter doesn't have. This uses a new `encounter_colours` table in `core/spec/form.yaml`; Orange/Brown after the two Greens is allowed, as a Green's rescue.
- **Valley Green:** a Green on a valley run.
- **Cadet path:** an outcome off its scream path; fight answers or a post-fight path on a run that didn't help; a second fight move without assessing.
- **Early death:** died before the hour, yet reached the tree, the valley or an encounter.
**Route model:** `planner/policy.yaml` gains `drop_flagged`. Flagged runs of `reddit comment` stay out of the model; the "read from a Reddit comment" note doesn't count. A hand fix in `collection/manual/reddit_comments.yaml` that clears the flags brings a run back. This has no effect until `reddit comment` is added to `sources`; `reported` is unchanged.
**On the first 82 scraped runs:** 6 are flagged (shadow with Brown/Red, Green after jumping on the Red, Red in the meadow, Orange first for Alone/Center, cadet-path mixes).
## Not in this PR
**Route model and statistics:** they don't use the source until `reddit comment` is named in `planner/policy.yaml` `sources` / `analysis/stats/measures.yaml`.
## Checks
`python -m collection build --check`, 89 Python tests, 17 JS tests, and graph.json unchanged.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
The threshing-reddit scraper (DragonKind/threshing-reddit) reads the runs
riders describe in the r/fourthwing megathreads and delivers them here by
pull request as data/public/reddit_comments.json: each run is the "Report a
run" answers (option labels of collection/specs/report_form.yaml), with the
comment id and day only; no usernames, no comment text.
- pipeline.yaml: a reddit_comments source of extract kind "delivered" (the
atlas fetches nothing; `update` skips it with a note)
- runs.py: the coder, sharing one answers_row() with the reported coder;
every row is flagged as read from a Reddit comment (and "not checked by
hand" until corrected); a result page a comment already carries is not
counted twice as a "reddit thread" row
- collection/manual/reddit_comments.yaml: reject / fix / add, applied at
build time
- dictionary, SOURCES, README, croissant: the new source
The route model and statistics do not use the source until it is named in
planner/policy.yaml / analysis/stats/measures.yaml.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Adds the receiving side for runs from the r/fourthwing Dragonkind megathread comments, a new source
reddit comment.How the data arrives
The threshing-reddit scraper reads the megathreads every 6 hours. It delivers by pull request only: it opens (or updates) one PR from
data/reddit-commentsthat changesdata/public/reddit_comments.json, for a person to review. It never pushes tomainand never merges itself.Each run is the "Report a run" answers: the option labels of
collection/specs/report_form.yaml. The scraper checks them against this repo's live form before sending. Kept per run: comment id, thread id, day, answers, and a result-page id if linked. No usernames, no comment text.What changes here
collection/pipeline.yaml: areddit_commentssource with extract kinddelivered. The atlas fetches nothing;updateskips it with a note.collection/etl/runs.py: the coder. It shares oneanswers_row()with thereportedcoder (that refactor is byte-identical:runs_clean.csvis unchanged).reddit threadrow.collection/manual/reddit_comments.yaml:reject/fix/add, applied at build time, so a correction never waits for the threads to change.SOURCES.md, collection README, croissant: the new source value and file.update.data/public/reddit_comments.jsonstarts empty; the first scraper PR fills it.Game-rule checks (second commit)
Runs answered through "Report a run" (
reportedandreddit comment) now get the checks the community form gets incore/atlas/coding.py. Each broken rule is adata_flagsentry; the run is kept.encounter_colourstable incore/spec/form.yaml; Orange/Brown after the two Greens is allowed, as a Green's rescue.Route model:
planner/policy.yamlgainsdrop_flagged. Flagged runs ofreddit commentstay out of the model; the "read from a Reddit comment" note doesn't count. A hand fix incollection/manual/reddit_comments.yamlthat clears the flags brings a run back. This has no effect untilreddit commentis added tosources;reportedis unchanged.On the first 82 scraped runs: 6 are flagged (shadow with Brown/Red, Green after jumping on the Red, Red in the meadow, Orange first for Alone/Center, cadet-path mixes).
Not in this PR
Route model and statistics: they don't use the source until
reddit commentis named inplanner/policy.yamlsources/analysis/stats/measures.yaml.Checks
python -m collection build --check, 89 Python tests, 17 JS tests, and graph.json unchanged.🤖 Generated with Claude Code