Threshing Atlas: monorepo, route graph, bot importer, daily source checks
- apps/atlas: the web page (valley map, route flow, Dragon Register) - packages/core: coding rules and statistics (engine.js) and the shared route graph (graph.js): scene graph, decision-variable graph, bot-to-form crosswalk, Beta credible intervals - packages/ingest: DragonKind bot importer to anonymised trajectories (no prose, no account identifiers); data/bot holds Ken's sample - research/python: independent reference implementation + update_sources.py - tests: JS/Python parity checks and graph/importer unit tests - CI, GitHub Pages deploy, daily check of the community sheets and route PDF - Email addresses in free-text form answers are redacted; the raw spreadsheet is not committed - MIT code licence, CC BY 4.0 data licence Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
0052d1a5fd
commit
c3d067b88c
@@ -0,0 +1,46 @@
|
||||
name: Check sources for new data
|
||||
on:
|
||||
schedule:
|
||||
- cron: "23 10 * * *" # daily
|
||||
workflow_dispatch:
|
||||
permissions:
|
||||
contents: write
|
||||
pull-requests: write
|
||||
jobs:
|
||||
check:
|
||||
runs-on: ubuntu-latest
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
- uses: actions/setup-node@v4
|
||||
with:
|
||||
node-version: 20
|
||||
- uses: actions/setup-python@v5
|
||||
with:
|
||||
python-version: "3.12"
|
||||
- run: pip install -r research/python/requirements.txt
|
||||
- id: check
|
||||
run: python research/python/update_sources.py --report "$RUNNER_TEMP/report.md"
|
||||
- name: Rebuild graph and run tests
|
||||
if: steps.check.outputs.changed == 'true'
|
||||
run: |
|
||||
node scripts/build-graph.js
|
||||
npm test
|
||||
- name: Open a pull request with the new data
|
||||
if: steps.check.outputs.changed == 'true'
|
||||
uses: peter-evans/create-pull-request@v6
|
||||
with:
|
||||
branch: data/source-update
|
||||
delete-branch: true
|
||||
commit-message: "data: update from community sources"
|
||||
title: "New data from the community sources"
|
||||
body-path: ${{ runner.temp }}/report.md
|
||||
labels: data
|
||||
- name: Report a broken source link
|
||||
if: steps.check.outputs.failed != ''
|
||||
env:
|
||||
GH_TOKEN: ${{ github.token }}
|
||||
run: |
|
||||
title="Source check failed: ${{ steps.check.outputs.failed }}"
|
||||
if ! gh issue list --state open --search "$title in:title" --json number --jq '.[0].number' | grep -q .; then
|
||||
gh issue create --title "$title" --body-file "$RUNNER_TEMP/report.md"
|
||||
fi
|
||||
Reference in New Issue
Block a user