Receive runs from the Reddit megathread comments (source "reddit comment")
CI / test (pull_request) Successful in 46s
CI / test (pull_request) Successful in 46s
The threshing-reddit scraper (DragonKind/threshing-reddit) reads the runs riders describe in the r/fourthwing megathreads and delivers them here by pull request as data/public/reddit_comments.json: each run is the "Report a run" answers (option labels of collection/specs/report_form.yaml), with the comment id and day only; no usernames, no comment text. - pipeline.yaml: a reddit_comments source of extract kind "delivered" (the atlas fetches nothing; `update` skips it with a note) - runs.py: the coder, sharing one answers_row() with the reported coder; every row is flagged as read from a Reddit comment (and "not checked by hand" until corrected); a result page a comment already carries is not counted twice as a "reddit thread" row - collection/manual/reddit_comments.yaml: reject / fix / add, applied at build time - dictionary, SOURCES, README, croissant: the new source The route model and statistics do not use the source until it is named in planner/policy.yaml / analysis/stats/measures.yaml. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,15 @@
|
||||
# Hand corrections to the runs read from the r/fourthwing megathread comments (data/public/reddit_comments.json).
|
||||
# The threshing-reddit scraper reads them automatically; every new run it finds is listed, with a link to its
|
||||
# comment, in the pull request that brings it in. Check them there and correct them here. Applied when the
|
||||
# runs are built (`python -m collection build`), so a correction never waits for the threads to change.
|
||||
#
|
||||
# reject: comment ids whose "run" is not a run (a joke, a friend's run, two runs told as one). An id without
|
||||
# its "-n" suffix rejects every run read from that comment.
|
||||
# fix: comment id -> answers that replace the ones read (form option labels from
|
||||
# collection/specs/report_form.yaml; null removes an answer). A fixed run counts as checked by hand.
|
||||
# add: runs the reader missed: { id, thread, posted: YYYY-MM-DD, answers: {...} }
|
||||
# No usernames: the comment id is enough to find the comment again.
|
||||
version: 1
|
||||
reject: []
|
||||
fix: {}
|
||||
add: []
|
||||
Reference in New Issue
Block a user