Files
threshing-atlas/analysis/reports/BLACK.md
T
ekcSchianoandClaude Fable 5.2 d01ec46fcc The Black is not dice: developer statements, evidence report, and a plan that looks for the rule
- planner/knowledge.yaml: what the game's developer has said (paraphrased, dated, graded), what the Atlas does
  with each statement, and the open questions with the experiment that tests each.
- analysis/black/evidence.py -> analysis/reports/BLACK.md: counts from the runs. On the same recorded route the
  shadow shows on 21 of 79 first attempts and 1 of 80 later ones; no single route; Blue then Black after the shadow.
- game.yaml: the shadow is a guard (not a roll); what follows it is the Blue, then the Black; on-screen text for
  the squad's direction screen.
- planner/experiments.yaml v2: one exact path on every fresh account (fresh-replicate), then one choice changed
  at a time (fresh-ablate); shadow-again, second-attempt-same-path, veteran-repeat, veteran-variety; what the bot
  records about the account; the sequence to follow once the shadow shows.
- solver.js: assign() takes account facts, account offsets and cycled arms; recommendOption() answers the
  squad screen (stay + direction) in one pick.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014jqCC2LZ4x1WHQ1V57nTsv
2026-11-16 15:24:03 +00:00

5.9 KiB

The Black dragon: what the runs show

Written by analysis/black/evidence.py from data/public/runs_clean.csv. Counts only; nothing is fitted. "Gated tree runs" investigated the scream, helped the squadmate and climbed the tree, the two gates the developer has confirmed (planner/knowledge.yaml). Form submissions over-report the shadow, so their percentages are too high; comparisons inside the form (first attempt against later, one route against another) are still fair if the over-reporting is the same on both sides.

1. The shadow by attempt number

Attempt Form submissions Bulk logs Bot
1 69 / 748 (9.2%) 0 / 28 (0.0%) 0 / 0
2 3 / 274 (1.1%) 0 / 21 (0.0%) 0 / 4 (0.0%)
3 1 / 177 (0.6%) 0 / 14 (0.0%) 0 / 5 (0.0%)
4-10 1 / 485 (0.2%) 0 / 102 (0.0%) 0 / 36 (0.0%)
11-30 1 / 524 (0.2%) 0 / 57 (0.0%) 0 / 137 (0.0%)
31 or more 1 / 535 (0.2%) 0 / 0 0 / 54 (0.0%)
not given 11 / 1406 (0.8%) 0 / 112 (0.0%) 0 / 0

Complete logs (bot and bulk) have 28 first attempts at the tree and 430 later ones, with 0 shadows. Zero in 430 later attempts rules out a rate above 0.7% for them; zero in 28 first attempts only rules out more than 10%.

2. The same route on a first attempt and on a later one

If the shadow depended only on the choices the form records (company, first direction, first move in the fight, the dagger, the bullies' fate, the fork), a route would do as well on a later attempt as on a first. It does not.

Route First attempt Later attempts
Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West 21 / 79 (26.6%) 1 / 80 (1.2%)
Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest 4 / 28 (14.3%) 0 / 91 (0.0%)
Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest 4 / 25 (16.0%) 0 / 70 (0.0%)
Alone / Center / Assess the situation / Daggers or not (protect squadmate) / Left bullies to the dragons / Forest 1 / 28 (3.6%) 0 / 62 (0.0%)
Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West 1 / 8 (12.5%) 1 / 80 (1.2%)
1 Squadmate / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East 2 / 28 (7.1%) 0 / 60 (0.0%)
Alone / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East 1 / 33 (3.0%) 0 / 48 (0.0%)
Alone / West / Assess the situation / Engage the smaller cadet / Left bullies to the dragons / West 2 / 23 (8.7%) 0 / 53 (0.0%)

Across all 296 recorded routes, comparing first and later attempts on the same route: 66 first-attempt shadows where 29.4 would be expected if the attempt did not matter (odds ratio 21.5, z = 9.8). First and later attempts choose almost the same routes, so the difference is not in the recorded choices: it is something about the account, or a choice the form does not record.

3. On one route, is the shadow decided by the cadet's wing, section and squad?

The developer says the Black is decided by choices and by what the site knows about the account, with no dice. If the recorded route and the cadet assignment were all of it, every first attempt with the same route and assignment would agree. On the best-recorded route (Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West; 21 / 79 (26.6%) on first attempts), 20 assignments have two or more runs and 10 of them disagree (some runs with the shadow, some without). So something else decides it: a choice the form does not record, or a fact about the account other than its assignment. No wing, section or squad stands out:

shadow / runs
wing Fourth: 5/25, Third: 6/23, First: 6/16, Second: 3/12
section Claw: 8/27, Tail: 7/26, Flame: 5/23, (blank): 1/3
squad Second: 10/28, First: 6/26, Third: 4/23
first_sighting Brown: 10/40, Green: 9/37
sighting_action Hold still: 10/43, Respect / face it: 4/16, Unknown: 7/13, Weapon: 0/5

4. There is no single route

The 87 form runs with a shadow (all attempts) took 44 different recorded routes:

  • Company: Alone 70, 2 Squadmates 9, 1 Squadmate 8
  • First direction: West 53, Center 20, East 14
  • First move in the fight: Assess the situation 76, (not recorded) 9, Even the numbers (smaller cadet) 2
  • The dagger: Engage the smaller cadet 56, (not recorded) 22, Daggers or not (protect squadmate) 9
  • The bullies' fate: Squadmate's revenge 54, Left bullies to the dragons 22, Killed the bullies yourself 9, Unknown 2
  • The fork: West 40, Forest 35, East 11, Unknown 1

Shadows reported without both gates: 3 (likely mis-entered).

5. After the shadow: the Blue, then the Black

The riders' notes describe one sequence: follow the shadow, a Blue lands and burns another cadet, the Blue leaves, then the Black appears. The Blue is a trial on the way, not an alternative to the Black.

  • Runs that reached the Black: 70, bonded 49.
  • Runs that died at the Blue: 15. What their notes say they did: approached the Blue 10, warned the other cadet / intervened 4.
  • The answer given to the Black, where the note says (bonded / runs): held its gaze 27/39; lowered eyes 0/7; ignored the sound 0/1.

Holding its gaze is the only answer recorded with a bond, and it still fails about a quarter of the time. The developer says a rider who knows the system bonds with certainty, so those failures are not explained yet: the notes of the riders who died are too short to show what else they did differently.

6. What the bot has tried

415 attempts on 14 accounts; the earliest attempt logged on any account is number 2. Gated tree runs: 236, shadows 0, on 3 recorded routes (the commonest 87 times). The bot has not played a first attempt, so it has not yet tested the one situation where riders report the shadow. The most times any account has repeated one route in a row is 11.