Files
threshing-atlas/.github/workflows/update-sources.yml
T
dcd5117373 Data updates: open the PR with ATLAS_BOT_TOKEN and auto-merge it once CI passes (#7)
Changes made with GITHUB_TOKEN do not start other workflows, so a merged data PR would not
redeploy the site. With the ATLAS_BOT_TOKEN secret the workflow opens the PR with it and turns
on auto-merge; without it, it falls back to GITHUB_TOKEN and a manual merge. docs/REPO_SETTINGS.md
lists the settings only the owner can change (auto-merge, the ruleset for main, the token).

Refs #4, #5, #6


Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-03 19:20:30 +00:00

62 lines
2.4 KiB
YAML

name: Check sources for new data
on:
schedule:
- cron: "23 10 * * *" # daily
workflow_dispatch:
permissions:
contents: write
pull-requests: write
issues: write
jobs:
check:
runs-on: ubuntu-latest
env:
# secrets cannot be tested in `if:` directly
HAS_BOT_TOKEN: ${{ secrets.ATLAS_BOT_TOKEN != '' }}
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: 20
- uses: actions/setup-python@v5
with:
python-version: "3.12"
- run: pip install -r research/python/requirements.txt
- id: check
run: python research/python/update_sources.py --report "$RUNNER_TEMP/report.md"
- name: Rebuild graph and run tests
if: steps.check.outputs.changed == 'true'
run: |
node scripts/build-graph.js
npm run policy
npm test
# The PR is opened with ATLAS_BOT_TOKEN (a fine-grained token, see docs/REPO_SETTINGS.md) when it is set:
# changes made with the built-in GITHUB_TOKEN do not start other workflows, so its merge would not
# redeploy the site. Without the secret it falls back to GITHUB_TOKEN and the PR waits for a manual merge.
- name: Open a pull request with the new data
id: pr
if: steps.check.outputs.changed == 'true'
uses: peter-evans/create-pull-request@v6
with:
token: ${{ secrets.ATLAS_BOT_TOKEN || github.token }}
branch: data/source-update
delete-branch: true
commit-message: "data: update from community sources"
title: "New data from the community sources"
body-path: ${{ runner.temp }}/report.md
labels: data
- name: Merge it automatically once CI passes
if: steps.pr.outputs.pull-request-number != '' && env.HAS_BOT_TOKEN == 'true'
env:
GH_TOKEN: ${{ secrets.ATLAS_BOT_TOKEN }}
run: gh pr merge "${{ steps.pr.outputs.pull-request-number }}" --auto --squash
- name: Report a broken source link
if: steps.check.outputs.failed != ''
env:
GH_TOKEN: ${{ github.token }}
run: |
title="Source check failed: ${{ steps.check.outputs.failed }}"
if ! gh issue list --state open --search "$title in:title" --json number --jq '.[0].number' | grep -q .; then
gh issue create --title "$title" --body-file "$RUNNER_TEMP/report.md"
fi