Reddit comment runs in the route model and the odds; Black report gate wording; cite both megathreads
- planner/policy.yaml: `reddit comment` is a model source. Only runs that break a game rule (the rule_flags checks) are left out; partial runs are kept. Its own reporting-bias group, and out of the low-bias sample (riders posting a run pick the notable ones). 77 of the 82 runs are used. - analysis/stats/measures.yaml: the site statistics use every source answered in the form's terms (form, "Report a run", Reddit comments). - analysis/black/evidence.py: a shadow run is "off the gates" only when an answer contradicts a gate (3); runs that do not say are counted separately (14). - croissant isBasedOn lists both megathreads (pipeline.yaml `cite`). - Rebuilt: policy.json, stats.json, BLACK.md, black.json, croissant.json. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
75f11378e2
commit
d606ed1651
@@ -31,18 +31,21 @@ def low_bias(r, lb=CONFIG["low_bias"]):
|
||||
"""Kept in the low-bias sample: every run of an always-kept source, bulk logs, and riders not chasing a rare dragon."""
|
||||
if r["source"] in lb["always"]:
|
||||
return True
|
||||
if r["source"] in (lb.get("never") or ()):
|
||||
return False
|
||||
if r["source"] == "reddit spreadsheet" and "bulk" in lb["entries_kept"] and r["entry"] not in (None, "Form"):
|
||||
return True
|
||||
return r["goal"] not in lb["rare_goals"]
|
||||
|
||||
|
||||
def drop_flagged(runs, cfg=CONFIG.get("drop_flagged") or {}):
|
||||
"""Without the flagged runs of the sources read automatically from free text (planner/policy.yaml drop_flagged)."""
|
||||
sources, keep = set(cfg.get("sources") or ()), tuple(cfg.get("except") or ())
|
||||
"""Without the runs of the sources read automatically from free text that break a game rule
|
||||
(planner/policy.yaml drop_flagged): every other run is kept, however partial."""
|
||||
sources, rules = set(cfg.get("sources") or ()), tuple(cfg.get("rules") or ())
|
||||
|
||||
def problems(r):
|
||||
return [f for f in (r.get("data_flags") or "").split("; ") if f and not f.startswith(keep)] if keep else [f for f in (r.get("data_flags") or "").split("; ") if f]
|
||||
return [r for r in runs if r["source"] not in sources or not problems(r)]
|
||||
def impossible(r):
|
||||
return any(rule in f for f in (r.get("data_flags") or "").split("; ") for rule in rules)
|
||||
return [r for r in runs if r["source"] not in sources or not impossible(r)]
|
||||
|
||||
|
||||
def clean(o):
|
||||
|
||||
+15
-6
@@ -6,21 +6,29 @@
|
||||
version: 1
|
||||
|
||||
# the `source` values of data/public/runs_clean.csv the model learns from
|
||||
sources: [reddit spreadsheet, reported, bot]
|
||||
sources: [reddit spreadsheet, reported, bot, reddit comment]
|
||||
|
||||
# Sources read automatically from free text: a run with any data flag (a broken game rule, an unrecognised answer)
|
||||
# is left out of the model, since the flag may mean the text was misread or misremembered. Flags that only say where
|
||||
# the run came from (`except`, matched at the start of a flag) do not count. A hand fix that clears the flags
|
||||
# brings the run back. Applies once the source is also listed in `sources` above.
|
||||
# Sources read automatically from free text: only a run that breaks one of the game's rules (the checks of
|
||||
# collection/etl/runs.py rule_flags, matched as text inside its flags) is left out of the model, since it cannot have
|
||||
# happened as read. Every other run is kept, however partial. A hand fix that clears the flag brings the run back.
|
||||
# The first-sighting pool is not here: form runs outside it are kept too, so these are kept for the same reason.
|
||||
drop_flagged:
|
||||
sources: [reddit comment]
|
||||
except: ["read from a Reddit comment"]
|
||||
rules:
|
||||
- "encounter, which has only"
|
||||
- "Green recorded on a Valley run"
|
||||
- "does not follow"
|
||||
- "fight answers on a run that did not help"
|
||||
- "a path after the fight on a run without a fight"
|
||||
- "a second fight move without pausing to assess"
|
||||
- "died before the hour, yet reached"
|
||||
|
||||
# Two samples. "all" is every run above. "lowBias" leaves out runs where a rare sighting is more likely to have
|
||||
# been reported than a miss: form submissions and reports from riders chasing Blue or Black. The bot logs every
|
||||
# run, and bulk-pasted logs record every run of the players who kept them, so both stay in.
|
||||
low_bias:
|
||||
always: [bot] # sources whose every run is kept
|
||||
never: [reddit comment] # riders posting a run in a thread pick the notable ones, like rare-chasers
|
||||
entries_kept: [bulk] # spreadsheet rows whose `entry` is not "Form" (bulk-pasted logs)
|
||||
rare_goals: [Blue, Black, Blue or Black]
|
||||
|
||||
@@ -46,3 +54,4 @@ reporting_bias:
|
||||
- { name: "form, chasing Blue/Black", when: { source: reddit spreadsheet, goal: rare } }
|
||||
- { name: "form, other", when: { source: reddit spreadsheet } }
|
||||
- { name: reported, when: { source: reported }, same_as: "form, other" }
|
||||
- { name: reddit comments, when: { source: reddit comment } } # self-selected: its own reporting rate
|
||||
|
||||
Reference in New Issue
Block a user