Files
threshing-atlas/data/public/overlap.json
T
ekcSchianoandClaude Opus 5.5 98be27fc1f
CI / test (pull_request) Successful in 40s
Reddit scraper PRs get a review summary; the form/Reddit overlap is measured (#23, #24)
- collection/etl/review_reddit.py (`python -m collection review-reddit`) and .gitea/workflows/reddit-review.yml:
  on every scraper pull request, one comment (refreshed on each push) listing the runs added, changed and gone, the
  runs that break a game rule (left out of the model and stats until corrected), other flags, runs that may also
  be in the form, and result pages already counted; plus how to reject / fix / add. forge.upsert_comment keeps it
  to one comment. collection/README.md: "Reviewing Reddit runs".
- analysis/overlap/overlap.py -> data/public/overlap.json: a Reddit run with at least 4 route answers "matches" a
  form row giving the same answers within a day; chance is the same test a few weeks off. 9 of 36 comparable runs
  match, ~7.3 by chance: about 2 of 82 look reported twice, too few to matter. Nothing is removed. Shown on the
  page's Data & methods tab; in the dataset metadata; checked in test:py; part of `rebuild`.
- Neither the form nor the register records a result-page id, so the only proven copy (comment <-> result page)
  stays the one #18 applies.
- data/public/stats.json: the statistics of #42 (impossible runs left out), which did not make it into that merge.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ
2026-11-19 16:44:52 +00:00

135 lines
1.9 KiB
JSON

{
"schema": 1,
"rule": {
"min_answers": 4,
"window_days": 1,
"baseline_shifts_days": [
-28,
-21,
-14,
14,
21,
28
]
},
"comment_runs": 82,
"comparable": 36,
"matched": 9,
"expected_by_chance": 7.3,
"likely_double": 1.7,
"matches": [
{
"comment": "comment-pdjr7gm",
"form": [
"sheet-8",
"sheet-38"
]
},
{
"comment": "comment-pdq6tsw",
"form": [
"sheet-168",
"sheet-190",
"sheet-398"
]
},
{
"comment": "comment-pe0kwol",
"form": [
"sheet-224"
]
},
{
"comment": "comment-pe2l6mz",
"form": [
"sheet-5",
"sheet-25",
"sheet-107",
"sheet-292",
"sheet-393",
"sheet-471",
"sheet-483",
"sheet-514",
"sheet-520"
]
},
{
"comment": "comment-pe2n3j1",
"form": [
"sheet-195",
"sheet-276"
]
},
{
"comment": "comment-pev3uge",
"form": [
"sheet-870",
"sheet-916",
"sheet-934",
"sheet-960",
"sheet-961",
"sheet-962",
"sheet-975",
"sheet-984",
"sheet-999",
"sheet-1008",
"sheet-1009",
"sheet-1019",
"sheet-1023",
"sheet-1068",
"sheet-1069",
"sheet-1077",
"sheet-1081",
"sheet-1089",
"sheet-1097",
"sheet-1101",
"sheet-1110",
"sheet-1129",
"sheet-1194",
"sheet-1200",
"sheet-1201",
"sheet-1235",
"sheet-1238",
"sheet-1257",
"sheet-1259",
"sheet-1264",
"sheet-1271",
"sheet-1278",
"sheet-1283",
"sheet-1290",
"sheet-1292"
]
},
{
"comment": "comment-pf22tpj",
"form": [
"sheet-1031",
"sheet-1042",
"sheet-1048",
"sheet-1140",
"sheet-1142",
"sheet-1143",
"sheet-1144",
"sheet-1171",
"sheet-1261",
"sheet-1262",
"sheet-1303",
"sheet-1304",
"sheet-1364"
]
},
{
"comment": "comment-pfhmw5d",
"form": [
"sheet-1504"
]
},
{
"comment": "comment-pgzz9hc",
"form": [
"sheet-1714"
]
}
]
}