Files
ekcSchianoandClaude Opus 5.5 3b5c655d51
CI / test (pull_request) Successful in 1m59s
Refresh to 8,748 spreadsheet runs; squad answers ignore case; rebuild checks the runs first
- spreadsheet 8,132 -> 8,748 rows (about 600 new; the sheet's keeper fixed 'Sqaudmate' in 72 answers,
  corrected 15 attempt numbers to 'First Attempt' and re-pasted the daily bulk logs); register 288 -> 292
- form.yaml squad_any_case: a typed 'second' is Second (it stopped the build)
- collection rebuild: the runs are built and checked first, so a failed check stops it before the model,
  plan, reports and statistics are rebuilt from stale runs
- route model, plan, Black evidence, screen tree, statistics, graph and metadata rebuilt (9,473 runs)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UCzTd31GphpMXDhQqWrCMQ
2026-11-16 17:13:23 +00:00

75 lines
5.9 KiB
Markdown

# The Black dragon: what the runs show
Written by `analysis/black/evidence.py` from `data/public/runs_clean.csv`. Counts only; nothing is fitted. "Gated tree runs" investigated the scream, helped the squadmate and climbed the tree, the two gates the developer has confirmed (`planner/knowledge.yaml`). Form submissions over-report the shadow, so their percentages are too high; comparisons inside the form (first attempt against later, one route against another) are still fair if the over-reporting is the same on both sides.
## 1. The shadow by attempt number
| Attempt | Form submissions | Bulk logs | Bot |
|---|---|---|---|
| 1 | 89 / 879 (10.1%) | 0 / 28 (0.0%) | 0 / 0 |
| 2 | 0 / 288 (0.0%) | 0 / 21 (0.0%) | 0 / 4 (0.0%) |
| 3 | 0 / 184 (0.0%) | 0 / 14 (0.0%) | 0 / 5 (0.0%) |
| 4-10 | 0 / 506 (0.0%) | 0 / 102 (0.0%) | 0 / 36 (0.0%) |
| 11-30 | 0 / 573 (0.0%) | 0 / 57 (0.0%) | 0 / 137 (0.0%) |
| 31 or more | 1 / 610 (0.2%) | 0 / 0 | 0 / 54 (0.0%) |
| not given | 3 / 1509 (0.2%) | 0 / 112 (0.0%) | 0 / 0 |
Complete logs (bot and bulk) have 28 first attempts at the tree and 430 later ones, with 0 shadows. Zero in 430 later attempts rules out a rate above 0.7% for them; zero in 28 first attempts only rules out more than 10%.
## 2. The same route on a first attempt and on a later one
If the shadow depended only on the choices the form records (company, first direction, first move in the fight, the dagger, the bullies' fate, the fork), a route would do as well on a later attempt as on a first. It does not.
| Route | First attempt | Later attempts |
|---|---|---|
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 22 / 88 (25.0%) | 0 / 89 (0.0%) |
| Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest | 5 / 29 (17.2%) | 0 / 93 (0.0%) |
| Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / Forest | 4 / 28 (14.3%) | 0 / 76 (0.0%) |
| 1 Squadmate / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 2 / 31 (6.5%) | 0 / 64 (0.0%) |
| Alone / Center / Assess the situation / Daggers or not (protect squadmate) / Left bullies to the dragons / Forest | 1 / 28 (3.6%) | 0 / 63 (0.0%) |
| Alone / Center / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West | 1 / 8 (12.5%) | 1 / 82 (1.2%) |
| 2 Squadmates / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 2 / 43 (4.7%) | 0 / 45 (0.0%) |
| Alone / East / Assess the situation / Engage the smaller cadet / Squadmate's revenge / East | 1 / 33 (3.0%) | 0 / 52 (0.0%) |
Across all 321 recorded routes, comparing first and later attempts on the same route: 85 first-attempt shadows where 36.4 would be expected if the attempt did not matter (odds ratio 626.3, z = 11.9). First and later attempts choose almost the same routes, so the difference is not in the recorded choices: it is something about the account, or a choice the form does not record.
## 3. On one route, is the shadow decided by the cadet's wing, section and squad?
The developer says the Black is decided by choices and by what the site knows about the account, with no dice. If the recorded route and the cadet assignment were all of it, every first attempt with the same route and assignment would agree. On the best-recorded route (Alone / West / Assess the situation / Engage the smaller cadet / Squadmate's revenge / West; 22 / 88 (25.0%) on first attempts), 22 assignments have two or more runs and 10 of them disagree (some runs with the shadow, some without). So something else decides it: a choice the form does not record, or a fact about the account other than its assignment. No wing, section or squad stands out:
| | shadow / runs |
|---|---|
| wing | Fourth: 5/27, Third: 7/26, First: 6/20, Second: 3/12 |
| section | Claw: 9/30, Flame: 5/29, Tail: 7/26, (blank): 1/3 |
| squad | Second: 11/34, First: 6/27, Third: 4/25 |
| first_sighting | Brown: 11/45, Green: 9/41 |
| sighting_action | Hold still: 10/49, Respect / face it: 4/18, Unknown: 8/14, Weapon: 0/5 |
## 4. There is no single route
The 93 form runs with a shadow (all attempts) took 46 different recorded routes:
- **Company:** Alone 70, 2 Squadmates 12, 1 Squadmate 11
- **First direction:** West 58, Center 20, East 15
- **First move in the fight:** Assess the situation 82, (not recorded) 9, Even the numbers (smaller cadet) 2
- **The dagger:** Engage the smaller cadet 60, (not recorded) 22, Daggers or not (protect squadmate) 11
- **The bullies' fate:** Squadmate's revenge 58, Left bullies to the dragons 23, Killed the bullies yourself 9, Unknown 3
- **The fork:** West 44, Forest 36, East 12, Unknown 1
Shadows reported without both gates: 3 (likely mis-entered).
## 5. After the shadow: the Blue, then the Black
The riders' notes describe one sequence: follow the shadow, a Blue lands and burns another cadet, the Blue leaves, then the Black appears. The Blue is a trial on the way, not an alternative to the Black.
- Runs that reached the Black: 76, bonded 55.
- Runs that died at the Blue: 15. What their notes say they did: approached the Blue 10, warned the other cadet / intervened 4.
- The answer given to the Black, where the note says (bonded / runs): held its gaze 30/42; lowered eyes 0/7; ignored the sound 0/1.
Holding its gaze is the only answer recorded with a bond, and it still fails about a quarter of the time. The developer says a rider who knows the system bonds with certainty, so those failures are not explained yet: the notes of the riders who died are too short to show what else they did differently.
## 6. What the bot has tried
415 attempts on 14 accounts; the earliest attempt logged on any account is number 2. Gated tree runs: 236, shadows 0, on 6 recorded routes (the commonest 70 times). The bot has not played a first attempt, so it has not yet tested the one situation where riders report the shadow. The most times any account has repeated one route in a row is 11.