CI / test (pull_request) Successful in 2m0s
Reported and Reddit-comment runs now get the checks the community form gets in core/atlas/coding.py, as data_flags (the run is kept): - first dragon outside the documented pool for the company/direction - a bond or burn by a dragon the encounter does not have (new encounter_colours table in core/spec/form.yaml; Orange/Brown after the two Greens allowed, as a Green's rescue) - a Green on a valley run - a cadet outcome off its scream path, fight answers or a post-fight path on a run that did not help, a second fight move without assessing - died before the hour, yet reached the tree/valley or an encounter planner/policy.yaml drop_flagged: flagged runs of sources read from free text (reddit comment) stay out of the route model; provenance notes do not count as flags. No effect today: the source is not in `sources` yet. On the first 82 scraped runs: 6 flagged. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
49 lines
3.6 KiB
YAML
49 lines
3.6 KiB
YAML
# Which runs the route model (data/public/policy.json) learns from. planner/build_policy.py reads this file.
|
|
#
|
|
# The model estimates the game's rolls (first dragon, deaths, shadow, meadow dragon, bond chances) given the choices
|
|
# made before them, so any run that records its choices and what happened can teach it, whoever chose the route.
|
|
# Deliberate deaths (Malek, the bot's "no shadow" / "no Blue" burns) are never counted as failed bond attempts.
|
|
version: 1
|
|
|
|
# the `source` values of data/public/runs_clean.csv the model learns from
|
|
sources: [reddit spreadsheet, reported, bot]
|
|
|
|
# Sources read automatically from free text: a run with any data flag (a broken game rule, an unrecognised answer)
|
|
# is left out of the model, since the flag may mean the text was misread or misremembered. Flags that only say where
|
|
# the run came from (`except`, matched at the start of a flag) do not count. A hand fix that clears the flags
|
|
# brings the run back. Applies once the source is also listed in `sources` above.
|
|
drop_flagged:
|
|
sources: [reddit comment]
|
|
except: ["read from a Reddit comment"]
|
|
|
|
# Two samples. "all" is every run above. "lowBias" leaves out runs where a rare sighting is more likely to have
|
|
# been reported than a miss: form submissions and reports from riders chasing Blue or Black. The bot logs every
|
|
# run, and bulk-pasted logs record every run of the players who kept them, so both stay in.
|
|
low_bias:
|
|
always: [bot] # sources whose every run is kept
|
|
entries_kept: [bulk] # spreadsheet rows whose `entry` is not "Form" (bulk-pasted logs)
|
|
rare_goals: [Blue, Black, Blue or Black]
|
|
|
|
# Reporting bias (core/atlas/bias.py). A rider is more likely to write up a run with a shadow or a meadow Blue than
|
|
# one without, so those sightings are over-represented in form submissions. For each rare roll below and each group
|
|
# that is not complete, the model estimates how many times more often the group reports the rare outcome than the
|
|
# complete groups do (rho, with a 90% range), and counts each rare outcome it reports as 1/rho. The group's pattern
|
|
# across routes is kept; its overall level comes from complete logging. Assumes the bias is the same on every route.
|
|
reporting_bias:
|
|
rolls: { shadow: "yes", meadow: Blue } # roll: its rare outcome
|
|
min_runs: 30 # fewer runs than this in a group (or the complete groups): borrow
|
|
min_complete_rare: 5 # fewer rare outcomes than this in complete logs: the bias cannot be
|
|
# estimated, so the roll is learned from complete logs only, unless
|
|
# `borrow` names another roll for it
|
|
# An assumption, not an estimate: complete logs have never seen the shadow, so its reporting bias cannot be
|
|
# measured. Each group is taken to over-report the shadow as much as it over-reports the meadow Blue. Without
|
|
# this, form submissions are left out of the shadow roll and the first-attempt effect (seen only in them) is
|
|
# lost. Remove the line to go back to complete logs only; the bot's first-attempt runs will replace it.
|
|
borrow: { shadow: meadow }
|
|
groups: # first match wins
|
|
- { name: bot, when: { source: bot }, complete: true }
|
|
- { name: bulk logs, when: { source: reddit spreadsheet, entry_not: Form }, complete: true }
|
|
- { name: "form, chasing Blue/Black", when: { source: reddit spreadsheet, goal: rare } }
|
|
- { name: "form, other", when: { source: reddit spreadsheet } }
|
|
- { name: reported, when: { source: reported }, same_as: "form, other" }
|