# collection Getting data in. Everything here turns a source into the shared run format (see `core/`) or into public files under `data/`. | Source | Code | Output | |---|---|---| | Community "Threshing Routes" form (Google Sheet) | `sources/export_raw.py`, then `core/python/clean.py` | `data/public/form_responses.json`, `data/derived/runs_clean.csv` | | Unofficial Dragon Register (Google Sheet) | `sources/export_register.py` | `data/public/register.json` (rider names stay local) | | Community route PDF | `sources/update_sources.py` | `data/derived/pdf_fingerprint.json` only; the PDF is never committed | | DragonKind bot (Ken) | `bot/import-bot.js`, `bot/bot.js` | `data/bot/scenes.json`, `data/bot/trajectories-.jsonl` | | Reddit megathreads | not collected yet | — | `sources/update_sources.py` runs every day from `.github/workflows/update-sources.yml`. It downloads the sheets and the PDF (links in `data/sources.json`), rebuilds the data if anything changed, and opens a pull request that merges itself when CI passes. A broken link opens an issue. The bot importer only ever writes fingerprints, short labels, choice text and outcomes. It refuses anything that looks like game prose or an account identifier. What the bot should log is in `docs/BOT_DATA_PROTOCOL.md`.