- planner/knowledge.yaml: what the game's developer has said (paraphrased, dated, graded), what the Atlas does with each statement, and the open questions with the experiment that tests each. - analysis/black/evidence.py -> analysis/reports/BLACK.md: counts from the runs. On the same recorded route the shadow shows on 21 of 79 first attempts and 1 of 80 later ones; no single route; Blue then Black after the shadow. - game.yaml: the shadow is a guard (not a roll); what follows it is the Blue, then the Black; on-screen text for the squad's direction screen. - planner/experiments.yaml v2: one exact path on every fresh account (fresh-replicate), then one choice changed at a time (fresh-ablate); shadow-again, second-attempt-same-path, veteran-repeat, veteran-variety; what the bot records about the account; the sequence to follow once the shadow shows. - solver.js: assign() takes account facts, account offsets and cycled arms; recommendOption() answers the squad screen (stay + direction) in one pick. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014jqCC2LZ4x1WHQ1V57nTsv
5.9 KiB
The Black dragon: what the runs show
Written by analysis/black/evidence.py from data/public/runs_clean.csv. Counts only; nothing is fitted. "Gated tree runs" investigated the scream, helped the squadmate and climbed the tree, the two gates the developer has confirmed (planner/knowledge.yaml). Form submissions over-report the shadow, so their percentages are too high; comparisons inside the form (first attempt against later, one route against another) are still fair if the over-reporting is the same on both sides.
1. The shadow by attempt number
| Attempt | Form submissions | Bulk logs | Bot |
|---|---|---|---|
| 1 | 69 / 748 (9.2%) | 0 / 28 (0.0%) | 0 / 0 |
| 2 | 3 / 274 (1.1%) | 0 / 21 (0.0%) | 0 / 4 (0.0%) |
| 3 | 1 / 177 (0.6%) | 0 / 14 (0.0%) | 0 / 5 (0.0%) |
| 4-10 | 1 / 485 (0.2%) | 0 / 102 (0.0%) | 0 / 36 (0.0%) |
| 11-30 | 1 / 524 (0.2%) | 0 / 57 (0.0%) | 0 / 137 (0.0%) |
| 31 or more | 1 / 535 (0.2%) | 0 / 0 | 0 / 54 (0.0%) |
| not given | 11 / 1406 (0.8%) | 0 / 112 (0.0%) | 0 / 0 |
Complete logs (bot and bulk) have 28 first attempts at the tree and 430 later ones, with 0 shadows. Zero in 430 later attempts rules out a rate above 0.7% for them; zero in 28 first attempts only rules out more than 10%.
2. The same route on a first attempt and on a later one
If the shadow depended only on the choices the form records (company, first direction, first move in the fight, the dagger, the bullies' fate, the fork), a route would do as well on a later attempt as on a first. It does not.
| Route | First attempt | Later attempts |
|---|---|---|
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 21 / 79 (26.6%) | 1 / 80 (1.2%) |
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest | 4 / 28 (14.3%) | 0 / 91 (0.0%) |
| Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest | 4 / 25 (16.0%) | 0 / 70 (0.0%) |
| Alone / Center / Assess the situation / Daggers or not (protect squadmate) / Left bullies to the dragons / Forest | 1 / 28 (3.6%) | 0 / 62 (0.0%) |
| Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 1 / 8 (12.5%) | 1 / 80 (1.2%) |
| 1 Squadmate / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 2 / 28 (7.1%) | 0 / 60 (0.0%) |
| Alone / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 1 / 33 (3.0%) | 0 / 48 (0.0%) |
| Alone / West / Assess the situation / Engage the smaller cadet / Left bullies to the dragons / West | 2 / 23 (8.7%) | 0 / 53 (0.0%) |
Across all 296 recorded routes, comparing first and later attempts on the same route: 66 first-attempt shadows where 29.4 would be expected if the attempt did not matter (odds ratio 21.5, z = 9.8). First and later attempts choose almost the same routes, so the difference is not in the recorded choices: it is something about the account, or a choice the form does not record.
3. On one route, is the shadow decided by the cadet's wing, section and squad?
The developer says the Black is decided by choices and by what the site knows about the account, with no dice. If the recorded route and the cadet assignment were all of it, every first attempt with the same route and assignment would agree. On the best-recorded route (Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West; 21 / 79 (26.6%) on first attempts), 20 assignments have two or more runs and 10 of them disagree (some runs with the shadow, some without). So something else decides it: a choice the form does not record, or a fact about the account other than its assignment. No wing, section or squad stands out:
| shadow / runs | |
|---|---|
| wing | Fourth: 5/25, Third: 6/23, First: 6/16, Second: 3/12 |
| section | Claw: 8/27, Tail: 7/26, Flame: 5/23, (blank): 1/3 |
| squad | Second: 10/28, First: 6/26, Third: 4/23 |
| first_sighting | Brown: 10/40, Green: 9/37 |
| sighting_action | Hold still: 10/43, Respect / face it: 4/16, Unknown: 7/13, Weapon: 0/5 |
4. There is no single route
The 87 form runs with a shadow (all attempts) took 44 different recorded routes:
- Company: Alone 70, 2 Squadmates 9, 1 Squadmate 8
- First direction: West 53, Center 20, East 14
- First move in the fight: Assess the situation 76, (not recorded) 9, Even the numbers (smaller cadet) 2
- The dagger: Engage the smaller cadet 56, (not recorded) 22, Daggers or not (protect squadmate) 9
- The bullies' fate: Squadmate's revenge 54, Left bullies to the dragons 22, Killed the bullies yourself 9, Unknown 2
- The fork: West 40, Forest 35, East 11, Unknown 1
Shadows reported without both gates: 3 (likely mis-entered).
5. After the shadow: the Blue, then the Black
The riders' notes describe one sequence: follow the shadow, a Blue lands and burns another cadet, the Blue leaves, then the Black appears. The Blue is a trial on the way, not an alternative to the Black.
- Runs that reached the Black: 70, bonded 49.
- Runs that died at the Blue: 15. What their notes say they did: approached the Blue 10, warned the other cadet / intervened 4.
- The answer given to the Black, where the note says (bonded / runs): held its gaze 27/39; lowered eyes 0/7; ignored the sound 0/1.
Holding its gaze is the only answer recorded with a bond, and it still fails about a quarter of the time. The developer says a rider who knows the system bonds with certainty, so those failures are not explained yet: the notes of the riders who died are too short to show what else they did differently.
6. What the bot has tried
415 attempts on 14 accounts; the earliest attempt logged on any account is number 2. Gated tree runs: 236, shadows 0, on 3 recorded routes (the commonest 87 times). The bot has not played a first attempt, so it has not yet tested the one situation where riders report the shadow. The most times any account has repeated one route in a row is 11.