Files
ekcSchianoandClaude Opus 5.5 46c1f00150
CI / test (pull_request) Successful in 41s
Impossible runs: one definition, left out of the route model and the site statistics (#21, #22)
- core/spec/form.yaml impossible_flags: the flags that mean a run cannot have happened as recorded (a dragon an
  encounter does not have, a Green or the Black in the valley, two bonds, two burns, a cadet path that does not
  follow, an early death that still reached the hour...). atlas.runs.impossible() reads it.
- The route model and the site statistics (and the riders' paths) leave those runs out, from every source; every
  other run is used, however partial. The runs stay in runs_clean.csv, flagged. 80 runs: 75 form, 5 Reddit.
  Route-model odds move by at most 0.2 points.
- collection/etl/runs.py: the community form gets the same game-rule checks as "Report a run" and the Reddit
  comments (10 form rows newly flagged); new rule: the Black in the valley.
- The first-sighting pool stays a flag only: it is what riders have seen, not a rule.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ
2026-11-19 16:03:45 +00:00

48 lines
3.6 KiB
YAML

# Which runs the route model (data/public/policy.json) learns from. planner/build_policy.py reads this file.
#
# The model estimates the game's rolls (first dragon, deaths, shadow, meadow dragon, bond chances) given the choices
# made before them, so any run that records its choices and what happened can teach it, whoever chose the route.
# Deliberate deaths (Malek, the bot's "no shadow" / "no Blue" burns) are never counted as failed bond attempts.
version: 1
# the `source` values of data/public/runs_clean.csv the model learns from
sources: [reddit spreadsheet, reported, bot, reddit comment]
# Every run of the sources above is used, however partial, except a run that cannot have happened as recorded
# (core/spec/form.yaml impossible_flags: it breaks one of the game's rules). Such runs stay in runs_clean.csv, flagged;
# a hand fix that clears the flag brings a Reddit or reported run back. The site statistics use the same rule.
drop_impossible: true
# Two samples. "all" is every run above. "lowBias" leaves out runs where a rare sighting is more likely to have
# been reported than a miss: form submissions and reports from riders chasing Blue or Black. The bot logs every
# run, and bulk-pasted logs record every run of the players who kept them, so both stay in.
low_bias:
always: [bot] # sources whose every run is kept
never: [reddit comment] # riders posting a run in a thread pick the notable ones, like rare-chasers
entries_kept: [bulk] # spreadsheet rows whose `entry` is not "Form" (bulk-pasted logs)
rare_goals: [Blue, Black, Blue or Black]
# Reporting bias (core/atlas/bias.py). A rider is more likely to write up a run with a shadow or a meadow Blue than
# one without, so those sightings are over-represented in form submissions. For each rare roll below and each group
# that is not complete, the model estimates how many times more often the group reports the rare outcome than the
# complete groups do (rho, with a 90% range), and counts each rare outcome it reports as 1/rho. The group's pattern
# across routes is kept; its overall level comes from complete logging. Assumes the bias is the same on every route.
reporting_bias:
rolls: { shadow: "yes", meadow: Blue } # roll: its rare outcome
min_runs: 30 # fewer runs than this in a group (or the complete groups): borrow
min_complete_rare: 5 # fewer rare outcomes than this in complete logs: the bias cannot be
# estimated, so the roll is learned from complete logs only, unless
# `borrow` names another roll for it
# An assumption, not an estimate: complete logs have never seen the shadow, so its reporting bias cannot be
# measured. Each group is taken to over-report the shadow as much as it over-reports the meadow Blue. Without
# this, form submissions are left out of the shadow roll and the first-attempt effect (seen only in them) is
# lost. Remove the line to go back to complete logs only; the bot's first-attempt runs will replace it.
borrow: { shadow: meadow }
groups: # first match wins
- { name: bot, when: { source: bot }, complete: true }
- { name: bulk logs, when: { source: reddit spreadsheet, entry_not: Form }, complete: true }
- { name: "form, chasing Blue/Black", when: { source: reddit spreadsheet, goal: rare } }
- { name: "form, other", when: { source: reddit spreadsheet } }
- { name: reported, when: { source: reported }, same_as: "form, other" }
- { name: reddit comments, when: { source: reddit comment } } # self-selected: its own reporting rate