Files
ekcSchianoandClaude Opus 5.5 46c1f00150
CI / test (pull_request) Successful in 41s
Impossible runs: one definition, left out of the route model and the site statistics (#21, #22)
- core/spec/form.yaml impossible_flags: the flags that mean a run cannot have happened as recorded (a dragon an
  encounter does not have, a Green or the Black in the valley, two bonds, two burns, a cadet path that does not
  follow, an early death that still reached the hour...). atlas.runs.impossible() reads it.
- The route model and the site statistics (and the riders' paths) leave those runs out, from every source; every
  other run is used, however partial. The runs stay in runs_clean.csv, flagged. 80 runs: 75 form, 5 Reddit.
  Route-model odds move by at most 0.2 points.
- collection/etl/runs.py: the community form gets the same game-rule checks as "Report a run" and the Reddit
  comments (10 form rows newly flagged); new rule: the Black in the valley.
- The first-sighting pool stays a flag only: it is what riders have seen, not a rule.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ
2026-11-19 16:03:45 +00:00

40 lines
1.4 KiB
Python

"""Read data/public/runs_clean.csv (written by `python -m collection build`) as typed records.
Every analysis reads the runs from this one published file. Types come from data/dictionary.yaml: integers and
booleans are parsed, empty cells are None (data_flags is "" when a row has no flags).
"""
import csv
from pathlib import Path
import yaml
ROOT = Path(__file__).resolve().parents[2]
PATH = ROOT / "data/public/runs_clean.csv"
with open(ROOT / "data/dictionary.yaml", encoding="utf-8") as _f:
TYPES = {k: v["type"] for k, v in yaml.safe_load(_f)["columns"].items()}
def _parse(col, v):
if v == "":
return "" if col == "data_flags" else None
t = TYPES.get(col, "text")
if t == "integer":
return int(v)
if t == "boolean":
return v == "True"
return v
def impossible(r):
"""A run that cannot have happened as recorded: one of its flags is in core/spec/form.yaml impossible_flags."""
from . import spec
rules = spec.form()["impossible_flags"]
return any(rule in f for f in (r.get("data_flags") or "").split("; ") for rule in rules)
def read(path=PATH, sources=None, drop=("run_id",)):
"""Typed records, optionally only from some sources (the `source` column)."""
with open(path, encoding="utf-8", newline="") as f:
rows = [{k: _parse(k, v) for k, v in r.items() if k not in drop} for r in csv.DictReader(f)]
return [r for r in rows if sources is None or r["source"] in sources]