New data from the community sources (#10)
CI / test (push) Successful in 2m15s

This commit was merged in pull request #10.
This commit is contained in:
2026-11-18 00:00:18 +00:00
parent d17155282a
commit f41bd22439
9 changed files with 2465 additions and 2230 deletions
+26 -26
View File
@@ -6,15 +6,15 @@ Written by `analysis/black/evidence.py` from `data/public/runs_clean.csv`. Count
| Attempt | Form submissions | Bulk logs | Bot |
|---|---|---|---|
| 1 | 90 / 892 (10.1%) | 0 / 28 (0.0%) | 0 / 0 |
| 2 | 0 / 290 (0.0%) | 0 / 21 (0.0%) | 0 / 4 (0.0%) |
| 3 | 0 / 187 (0.0%) | 0 / 14 (0.0%) | 0 / 5 (0.0%) |
| 1 | 91 / 902 (10.1%) | 0 / 29 (0.0%) | 0 / 0 |
| 2 | 0 / 294 (0.0%) | 0 / 21 (0.0%) | 0 / 4 (0.0%) |
| 3 | 0 / 188 (0.0%) | 0 / 14 (0.0%) | 0 / 5 (0.0%) |
| 4-10 | 0 / 510 (0.0%) | 0 / 102 (0.0%) | 0 / 36 (0.0%) |
| 11-30 | 0 / 574 (0.0%) | 0 / 57 (0.0%) | 0 / 137 (0.0%) |
| 31 or more | 1 / 621 (0.2%) | 0 / 0 | 0 / 54 (0.0%) |
| not given | 3 / 1522 (0.2%) | 0 / 112 (0.0%) | 0 / 0 |
| 11-30 | 0 / 582 (0.0%) | 0 / 57 (0.0%) | 0 / 137 (0.0%) |
| 31 or more | 1 / 678 (0.1%) | 0 / 0 | 0 / 54 (0.0%) |
| not given | 3 / 1567 (0.2%) | 0 / 149 (0.0%) | 0 / 0 |
Complete logs (bot and bulk) have 28 first attempts at the tree and 430 later ones, with 0 shadows. Zero in 430 later attempts rules out a rate above 0.7% for them; zero in 28 first attempts only rules out more than 10%.
Complete logs (bot and bulk) have 29 first attempts at the tree and 430 later ones, with 0 shadows. Zero in 430 later attempts rules out a rate above 0.7% for them; zero in 29 first attempts only rules out more than 10%.
## 2. The same route on a first attempt and on a later one
@@ -22,39 +22,39 @@ If the shadow depended only on the choices the form records (company, first dire
| Route | First attempt | Later attempts |
|---|---|---|
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 22 / 92 (23.9%) | 0 / 90 (0.0%) |
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 23 / 93 (24.7%) | 0 / 93 (0.0%) |
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest | 5 / 29 (17.2%) | 0 / 93 (0.0%) |
| Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest | 4 / 28 (14.3%) | 0 / 76 (0.0%) |
| 1 Squadmate / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 2 / 32 (6.2%) | 0 / 64 (0.0%) |
| Alone / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 1 / 34 (2.9%) | 0 / 59 (0.0%) |
| Alone / Center / Assess the situation / Daggers or not (protect squadmate) / Left bullies to the dragons / Forest | 1 / 28 (3.6%) | 0 / 64 (0.0%) |
| 2 Squadmates / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 2 / 45 (4.4%) | 0 / 46 (0.0%) |
| Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 1 / 8 (12.5%) | 1 / 82 (1.2%) |
| 2 Squadmates / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 2 / 43 (4.7%) | 0 / 45 (0.0%) |
| Alone / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 1 / 33 (3.0%) | 0 / 53 (0.0%) |
Across all 325 recorded routes, comparing first and later attempts on the same route: 86 first-attempt shadows where 36.5 would be expected if the attempt did not matter (odds ratio 637.7, z = 12.0). First and later attempts choose almost the same routes, so the difference is not in the recorded choices: it is something about the account, or a choice the form does not record.
Across all 320 recorded routes, comparing first and later attempts on the same route: 87 first-attempt shadows where 36.8 would be expected if the attempt did not matter (odds ratio 646.0, z = 12.1). First and later attempts choose almost the same routes, so the difference is not in the recorded choices: it is something about the account, or a choice the form does not record.
## 3. On one route, is the shadow decided by the cadet's wing, section and squad?
The developer says the Black is decided by choices and by what the site knows about the account, with no dice. If the recorded route and the cadet assignment were all of it, every first attempt with the same route and assignment would agree. On the best-recorded route (Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West; 22 / 92 (23.9%) on first attempts), 25 assignments have two or more runs and 11 of them disagree (some runs with the shadow, some without). So something else decides it: a choice the form does not record, or a fact about the account other than its assignment. No wing, section or squad stands out:
The developer says the Black is decided by choices and by what the site knows about the account, with no dice. If the recorded route and the cadet assignment were all of it, every first attempt with the same route and assignment would agree. On the best-recorded route (Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West; 23 / 93 (24.7%) on first attempts), 26 assignments have two or more runs and 12 of them disagree (some runs with the shadow, some without). So something else decides it: a choice the form does not record, or a fact about the account other than its assignment. No wing, section or squad stands out:
| | shadow / runs |
|---|---|
| wing | Fourth: 5/28, Third: 7/27, First: 6/21, Second: 3/13 |
| section | Claw: 9/31, Flame: 5/30, Tail: 7/28, (blank): 1/3 |
| squad | Second: 11/34, First: 6/29, Third: 4/27 |
| first_sighting | Brown: 11/48, Green: 9/42 |
| sighting_action | Hold still: 10/50, Respect / face it: 4/21, Unknown: 8/14, Weapon: 0/5 |
| wing | Fourth: 5/28, Third: 7/27, First: 6/21, Second: 4/14 |
| section | Claw: 9/31, Flame: 5/30, Tail: 8/29, (blank): 1/3 |
| squad | Second: 12/35, First: 6/29, Third: 4/27 |
| first_sighting | Brown: 12/49, Green: 9/42 |
| sighting_action | Hold still: 10/50, Respect / face it: 5/22, Unknown: 8/14, Weapon: 0/5 |
## 4. There is no single route
The 94 form runs with a shadow (all attempts) took 45 different recorded routes:
The 95 form runs with a shadow (all attempts) took 45 different recorded routes:
- **Company:** Alone 70, 1 Squadmate 12, 2 Squadmates 12
- **First direction:** West 59, Center 20, East 15
- **First move in the fight:** Assess the situation 83, (not recorded) 9, Even the numbers (smaller cadet) 2
- **The dagger:** Engage the smaller cadet 61, (not recorded) 22, Daggers or not (protect squadmate) 11
- **The bullies' fate:** Squadmate's revenge 59, Left bullies to the dragons 24, Killed the bullies yourself 9, Unknown 2
- **The fork:** West 45, Forest 36, East 12, Unknown 1
- **Company:** Alone 71, 1 Squadmate 12, 2 Squadmates 12
- **First direction:** West 60, Center 20, East 15
- **First move in the fight:** Assess the situation 84, (not recorded) 9, Even the numbers (smaller cadet) 2
- **The dagger:** Engage the smaller cadet 62, (not recorded) 22, Daggers or not (protect squadmate) 11
- **The bullies' fate:** Squadmate's revenge 60, Left bullies to the dragons 24, Killed the bullies yourself 9, Unknown 2
- **The fork:** West 46, Forest 36, East 12, Unknown 1
Shadows reported without both gates: 3 (likely mis-entered).
@@ -62,9 +62,9 @@ Shadows reported without both gates: 3 (likely mis-entered).
The riders' notes describe one sequence: follow the shadow, a Blue lands and burns another cadet, the Blue leaves, then the Black appears. The Blue is a trial on the way, not an alternative to the Black.
- Runs that reached the Black: 77, bonded 55.
- Runs that reached the Black: 78, bonded 56.
- Runs that died at the Blue: 15. What their notes say they did: approached the Blue 10, warned the other cadet / intervened 4.
- The answer given to the Black, where the note says (bonded / runs): held its gaze 30/42; lowered eyes 0/7; ignored the sound 0/1.
- The answer given to the Black, where the note says (bonded / runs): held its gaze 29/41; lowered eyes 0/7; ignored the sound 0/1.
Holding its gaze is the only answer recorded with a bond, and it still fails about a quarter of the time. The developer says a rider who knows the system bonds with certainty, so those failures are not explained yet: the notes of the riders who died are too short to show what else they did differently.
+10 -10
View File
@@ -88,8 +88,8 @@
"description": "Every run from every source, one per row, coded into the same columns (collection/etl/runs.py; the form's rules are core/spec/form.yaml). The `source` column says where each run came from.",
"contentUrl": "https://git.kenschiano.net/kathleen/threshing-atlas/raw/branch/main/data/public/runs_clean.csv",
"encodingFormat": "text/csv",
"sha256": "7171151ab23a31d29ffbb30cbde62b29183e6f04c2edf46577aa04f649fe2c68",
"contentSize": "3354446 B"
"sha256": "a6d014f26e8b7a4135c2931f909be5b800b551d6f8a1e9ee3b6532454e7c54cb",
"contentSize": "3432041 B"
},
{
"@type": "cr:FileObject",
@@ -98,8 +98,8 @@
"description": "The community \"Threshing Routes\" form export as published (headers and rows), with email addresses in free-text answers redacted. The source of runs_clean.",
"contentUrl": "https://git.kenschiano.net/kathleen/threshing-atlas/raw/branch/main/data/public/form_responses.json",
"encodingFormat": "application/json",
"sha256": "4e80832e94cf1c7da4b9e7d508d86144385feefe0fce044862d0a0a0ff611b32",
"contentSize": "11996965 B"
"sha256": "8283068ed7cd4b06907629db722893ce749a44f5b490c209361435c397faf294",
"contentSize": "12282265 B"
},
{
"@type": "cr:FileObject",
@@ -128,8 +128,8 @@
"description": "Every number the Atlas page shows, for six filter presets (analysis/stats/site_stats.py; what is measured is analysis/stats/measures.yaml).",
"contentUrl": "https://git.kenschiano.net/kathleen/threshing-atlas/raw/branch/main/data/public/stats.json",
"encodingFormat": "application/json",
"sha256": "663b95519cd639365c0e69ae3205bbdcb112f492ad4bbfae9deff5b845f0208d",
"contentSize": "5322125 B"
"sha256": "5a50d93c9c6f39ee30935f190c57a8e611980accd9c4980329ccec2a3ae1e57f",
"contentSize": "5386415 B"
},
{
"@type": "cr:FileObject",
@@ -138,8 +138,8 @@
"description": "The route model: the game (core/spec/game.yaml), the count tables behind every roll, and the best decision tree for every dragon colour under two goals, with posterior intervals (planner/build_policy.py).",
"contentUrl": "https://git.kenschiano.net/kathleen/threshing-atlas/raw/branch/main/data/public/policy.json",
"encodingFormat": "application/json",
"sha256": "596126746819e221dd7d3caf4de0bbcc43170cf649c5ef763866f23b9a553abf",
"contentSize": "1107643 B"
"sha256": "f5504146189b7323cb82f85eefffd4ee07dc5f0963fe7bcb71a272fba4344708",
"contentSize": "1108151 B"
},
{
"@type": "cr:FileObject",
@@ -148,8 +148,8 @@
"description": "The route graph over every run in runs_clean.csv, counted per source (analysis/network/build-graph.js).",
"contentUrl": "https://git.kenschiano.net/kathleen/threshing-atlas/raw/branch/main/data/public/graph.json",
"encodingFormat": "application/json",
"sha256": "f1e2070e01fe484ab17812b13390910bd22b17837c64421d3e4a225bc80a7c27",
"contentSize": "74031 B"
"sha256": "34739e83fa68a0b3d4389605743c36dbf00338274724c9a5f353945f17f10522",
"contentSize": "74016 B"
}
],
"recordSet": [
+3 -3
View File
@@ -10,12 +10,12 @@
"changed": "2026-11-16"
},
"reddit_spreadsheet": {
"sha256": "ad57c66b6cb0574717a1c76124ae5f451766e979a6178febda268a2a5fc738d8",
"bytes": 6384851,
"sha256": "bc9c292024882f4f4bde10cecdf1dc0c0010d586230069613479e9b26ba20db1",
"bytes": 5377645,
"changed": "2026-11-17"
},
"register": {
"sha256": "6671704e3cc197593365a92e637a8bbbed14f8c17cf1c493de66be6beb9ee863",
"sha256": "7b09b95cae876fea501ce8fcf6f328b073f3cd2dd13dcec657735df0ca18b439",
"bytes": 51191,
"changed": "2026-11-17"
},
+23 -23
View File
@@ -3,16 +3,16 @@
"by_attempt": {
"form": {
"1": [
90,
892
91,
902
],
"2": [
0,
290
294
],
"3": [
0,
187
188
],
"4-10": [
0,
@@ -20,17 +20,17 @@
],
"11-30": [
0,
574
582
],
"31 or more": [
1,
621
678
]
},
"bulk logs": {
"1": [
0,
28
29
],
"2": [
0,
@@ -81,19 +81,19 @@
}
},
"same_route": {
"routes": 325,
"first_shadows": 86,
"expected": 36.5,
"odds_ratio": 637.7,
"z": 12.0
"routes": 320,
"first_shadows": 87,
"expected": 36.8,
"odds_ratio": 646.0,
"z": 12.1
},
"form_first": [
90,
892
91,
902
],
"form_later": [
1,
2182
2252
],
"best_route": {
"route": [
@@ -105,27 +105,27 @@
"West"
],
"first": [
22,
92
23,
93
],
"later": [
0,
90
93
]
},
"shadow_routes": {
"runs": 94,
"runs": 95,
"routes": 45,
"off_gate": 3
},
"after_shadow": {
"reached_black": 77,
"bonded_black": 55,
"reached_black": 78,
"bonded_black": 56,
"died_at_blue": 15,
"answers": {
"held its gaze": [
30,
42
29,
41
],
"lowered eyes": [
0,
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
+2399 -2164
View File
File diff suppressed because it is too large Load Diff
File diff suppressed because one or more lines are too long