# Generated report (protocol f1098ea9857c0053)

Regenerated by `scripts/analyze.py` from raw_results/ and checkpoints/ manifests. Do not edit by hand.

Primary comparator (validation-selected): **classical**.

## Primary engineering test (nominal, fly_bio vs comparator)

- success difference fly_bio - classical: -0.216 (95% CI -0.285 to -0.149); criterion lower bound > -0.05: False
- median latency ratio fly_bio / classical: 2.69 (95% CI 2.43 to 2.81); criterion upper bound < 0.80: False
- verdict: **negative**

## Topology test (fly_bio vs class-preserving rewired, 3 graphs x 5 seeds)

| condition | diff | 95% CI |
|---|---|---|
| nominal | -0.001 | -0.046 to +0.041 |
| fast_target | -0.017 | -0.071 to +0.037 |
| visual_noise | -0.016 | -0.067 to +0.034 |
| occlusion | -0.009 | -0.060 to +0.041 |
| actuator_mismatch | -0.040 | -0.097 to +0.015 |

verdict (nominal): **not_supported_inconclusive**

## Diagnostics vs fly_bio (nominal)

| other | bio - other | 95% CI |
|---|---|---|
| classical | -0.216 | -0.285 to -0.149 |
| fly_bio_K2 | +0.041 | -0.013 to +0.093 |
| fly_bio_K8 | +0.006 | -0.048 to +0.059 |
| fly_bypass | +0.016 | -0.037 to +0.069 |
| fly_coreoff | +0.709 | +0.650 to +0.766 |
| fly_fixed | +0.065 | -0.014 to +0.167 |
| fly_gluexc | +0.007 | -0.038 to +0.050 |
| fly_rewired | -0.001 | -0.046 to +0.041 |
| fly_rewired_unconstrained | -0.029 | -0.077 to +0.015 |
| gru16 | +0.039 | -0.020 to +0.098 |
| gru32 | +0.008 | -0.050 to +0.064 |
| gru8 | +0.077 | +0.013 to +0.143 |
| mlp16 | -0.024 | -0.081 to +0.031 |
| mlp32 | -0.053 | -0.114 to +0.007 |
| mlp64 | -0.023 | -0.082 to +0.036 |

## Cost and frontier (nominal test success)

| group | impl | success [95% CI] | median us [95% CI] | p99 us | trainable | stored | est. MACs | train s (all seeds) | tune s |
|---|---|---|---|---|---|---|---|---|---|
| mlp16 | np | 73.3% [68.0%, 78.3%] | 3.0 [2.9, 3.0] | 3.6 | 3394 | 3394 | 3360.0 | 113 | 40 |
| mlp32 | np | 76.2% [70.2%, 81.8%] | 3.5 [3.5, 4.2] | 4.6 | 7298 | 7298 | 7232.0 | 119 | 43 |
| mlp64 | np | 73.2% [67.4%, 78.7%] | 4.1 [4.0, 4.9] | 5.7 | 16642 | 16642 | 16512.0 | 131 | 49 |
| fly_bypass | np | 69.3% [63.1%, 75.1%] | 5.9 [5.8, 6.0] | 7.5 | 4411 | 4411 | 5162.0 | 868 | 351 |
| gru8 | np | 63.2% [56.7%, 69.5%] | 6.3 [6.2, 6.3] | 8.2 | 1410 | 1410 | 1360.0 | 170 | 62 |
| gru16 | np | 67.0% [60.7%, 72.8%] | 6.3 [6.3, 6.4] | 9.1 | 3202 | 3202 | 3104.0 | 186 | 67 |
| gru32 | np | 70.1% [64.0%, 75.9%] | 7.8 [7.2, 8.3] | 10.8 | 7938 | 7938 | 7744.0 | 213 | 66 |
| classical | np | 92.5% [88.5%, 96.0%] | 9.3 [9.2, 9.4] | 24.7 | 0 | 0 | n/a | 0 | 0 |
| fly_coreoff | np | 0.0% [0.0%, 0.0%] | 11.7 [11.5, 11.7] | 14.3 | 1661 | 1661 | 2412.0 | 1375 | 547 |
| fly_bio_K2 | dense | 66.8% [60.8%, 72.7%] | 14.8 [13.5, 16.2] | 19.6 | 8114 | 8114 | 394910.0 | 936 | 0 |
| fly_gluexc | dense | 70.2% [64.6%, 75.6%] | 24.0 [22.3, 25.9] | 30.8 | 8114 | 8114 | 787408.0 | 2312 | 0 |
| fly_bio | dense | 70.9% [64.9%, 76.7%] | 25.0 [22.5, 26.0] | 30.2 | 8114 | 8114 | 787408.0 | 2281 | 912 |
| fly_rewired_unconstrained | dense | 73.8% [68.3%, 79.1%] | 25.3 [22.3, 26.3] | 33.4 | 8114 | 8114 | 787408.0 | 2323 | 880 |
| fly_fixed | dense | 64.4% [54.0%, 72.9%] | 25.3 [22.4, 26.4] | 29.6 | 1661 | 8114 | 787408.0 | 1761 | 663 |
| fly_rewired | dense | 71.0% [65.7%, 76.1%] | 25.5 [22.4, 26.4] | 31.5 | 8114 | 8114 | 787408.0 | 6914 | 913 |
| fly_bio_K8 | dense | 70.3% [64.0%, 76.5%] | 46.3 [39.8, 47.9] | 53.7 | 8114 | 8114 | 1572404.0 | 1766 | 0 |

## Success by condition

| group | nominal | fast_target | visual_noise | occlusion | actuator_mismatch |
|---|---|---|---|---|---|
| classical | 92.5% [88.5%, 96.0%] | 82.0% [76.5%, 87.0%] | 89.5% [85.0%, 93.5%] | 77.0% [71.0%, 83.0%] | 92.0% [88.0%, 95.5%] |
| mlp32 | 76.2% [70.2%, 81.8%] | 28.1% [21.9%, 34.5%] | 73.8% [67.6%, 79.7%] | 28.6% [22.9%, 34.7%] | 71.2% [65.2%, 76.8%] |
| fly_rewired_unconstrained | 73.8% [68.3%, 79.1%] | 13.3% [9.9%, 17.1%] | 73.8% [68.6%, 78.9%] | 41.0% [33.9%, 48.0%] | 63.4% [57.8%, 68.9%] |
| mlp16 | 73.3% [68.0%, 78.3%] | 23.0% [16.2%, 30.3%] | 73.2% [67.0%, 79.0%] | 33.3% [28.1%, 38.8%] | 66.1% [59.2%, 72.8%] |
| mlp64 | 73.2% [67.4%, 78.7%] | 27.3% [21.3%, 33.7%] | 69.2% [62.9%, 75.6%] | 26.3% [21.1%, 31.8%] | 66.7% [60.2%, 73.0%] |
| fly_rewired | 71.0% [65.7%, 76.1%] | 12.9% [8.9%, 17.2%] | 69.4% [63.8%, 74.6%] | 41.7% [36.3%, 47.2%] | 61.5% [55.6%, 67.0%] |
| fly_bio | 70.9% [64.9%, 76.7%] | 11.2% [6.9%, 16.1%] | 67.8% [61.4%, 73.8%] | 40.8% [35.4%, 46.3%] | 57.5% [50.5%, 64.1%] |
| fly_bio_K8 | 70.3% [64.0%, 76.5%] | 12.3% [5.5%, 19.2%] | 69.7% [63.0%, 76.2%] | 43.2% [35.0%, 51.7%] | 60.7% [54.2%, 67.2%] |
| fly_gluexc | 70.2% [64.6%, 75.6%] | 10.8% [5.8%, 16.5%] | 68.5% [62.3%, 74.5%] | 38.6% [33.3%, 44.1%] | 58.3% [50.9%, 65.4%] |
| gru32 | 70.1% [64.0%, 75.9%] | 14.3% [9.5%, 20.0%] | 70.1% [64.0%, 76.0%] | 26.2% [18.5%, 34.7%] | 58.6% [51.3%, 65.6%] |
| fly_bypass | 69.3% [63.1%, 75.1%] | 13.0% [8.5%, 17.6%] | 67.3% [60.7%, 73.5%] | 41.0% [35.0%, 47.2%] | 60.8% [53.4%, 67.7%] |
| gru16 | 67.0% [60.7%, 72.8%] | 17.8% [10.4%, 26.4%] | 65.2% [58.5%, 71.7%] | 17.5% [13.1%, 22.0%] | 58.1% [48.8%, 66.0%] |
| fly_bio_K2 | 66.8% [60.8%, 72.7%] | 3.7% [1.5%, 6.5%] | 66.7% [60.7%, 72.5%] | 38.0% [31.5%, 44.8%] | 52.5% [45.5%, 59.5%] |
| fly_fixed | 64.4% [54.0%, 72.9%] | 6.8% [2.8%, 11.3%] | 62.9% [52.8%, 71.5%] | 36.1% [28.6%, 43.2%] | 51.4% [38.2%, 62.2%] |
| gru8 | 63.2% [56.7%, 69.5%] | 8.7% [3.1%, 17.3%] | 60.3% [54.5%, 66.0%] | 26.4% [19.8%, 32.7%] | 50.0% [42.0%, 58.3%] |
| fly_coreoff | 0.0% [0.0%, 0.0%] | 0.0% [0.0%, 0.0%] | 0.0% [0.0%, 0.0%] | 0.0% [0.0%, 0.0%] | 0.0% [0.0%, 0.0%] |
| teacher_oracle | 92.5% [88.5%, 96.0%] | 91.5% [87.5%, 95.0%] | 92.5% [88.5%, 96.0%] | 99.0% [97.5%, 100.0%] | 92.5% [88.5%, 96.0%] |

## Failure causes (% of episodes; causes overlap)

| group | condition | failed | tracked < 75% | lost run > 30 steps | collision | target contact |
|---|---|---|---|---|---|---|
| classical | nominal | 7.5% | 0.0% | 0.0% | 3.0% | 4.5% |
| classical | fast_target | 18.0% | 3.0% | 6.0% | 12.0% | 4.0% |
| classical | occlusion | 23.0% | 9.5% | 12.5% | 10.0% | 3.5% |
| mlp32 | nominal | 23.8% | 11.8% | 14.2% | 17.0% | 9.9% |
| mlp32 | fast_target | 71.9% | 53.8% | 64.5% | 62.1% | 8.3% |
| mlp32 | occlusion | 71.4% | 54.5% | 64.6% | 66.1% | 8.2% |
| fly_rewired_unconstrained | nominal | 26.2% | 12.7% | 14.9% | 19.3% | 8.8% |
| fly_rewired_unconstrained | fast_target | 86.7% | 74.5% | 82.6% | 74.8% | 6.5% |
| fly_rewired_unconstrained | occlusion | 59.0% | 46.5% | 53.1% | 52.8% | 5.1% |
| mlp16 | nominal | 26.7% | 14.4% | 17.0% | 19.8% | 11.2% |
| mlp16 | fast_target | 77.0% | 63.7% | 72.6% | 64.2% | 7.0% |
| mlp16 | occlusion | 66.7% | 52.9% | 60.6% | 62.0% | 8.0% |
| mlp64 | nominal | 26.8% | 15.5% | 17.5% | 20.9% | 10.6% |
| mlp64 | fast_target | 72.7% | 58.0% | 67.4% | 64.8% | 8.2% |
| mlp64 | occlusion | 73.7% | 59.8% | 67.6% | 69.6% | 6.3% |
| fly_rewired | nominal | 29.0% | 15.9% | 17.7% | 23.0% | 8.3% |
| fly_rewired | fast_target | 87.1% | 74.8% | 83.7% | 75.7% | 5.6% |
| fly_rewired | occlusion | 58.3% | 45.5% | 52.5% | 51.7% | 5.3% |
| fly_bio | nominal | 29.1% | 16.9% | 19.4% | 23.2% | 7.3% |
| fly_bio | fast_target | 88.8% | 77.7% | 85.9% | 76.2% | 4.9% |
| fly_bio | occlusion | 59.2% | 46.3% | 53.2% | 51.3% | 6.3% |
| fly_bio_K8 | nominal | 29.7% | 15.3% | 18.5% | 23.0% | 8.7% |
| fly_bio_K8 | fast_target | 87.7% | 76.3% | 84.2% | 73.7% | 5.0% |
| fly_bio_K8 | occlusion | 56.8% | 44.3% | 50.3% | 48.3% | 5.2% |
| fly_gluexc | nominal | 29.8% | 17.1% | 19.7% | 23.0% | 8.1% |
| fly_gluexc | fast_target | 89.2% | 78.8% | 86.6% | 78.3% | 3.9% |
| fly_gluexc | occlusion | 61.4% | 48.1% | 54.8% | 54.8% | 6.1% |
| gru32 | nominal | 29.9% | 17.4% | 19.2% | 20.2% | 9.0% |
| gru32 | fast_target | 85.7% | 75.0% | 80.9% | 71.6% | 7.6% |
| gru32 | occlusion | 73.8% | 59.0% | 69.1% | 66.4% | 5.6% |
| fly_bypass | nominal | 30.7% | 17.4% | 20.7% | 24.5% | 8.3% |
| fly_bypass | fast_target | 87.0% | 74.1% | 84.2% | 72.0% | 5.1% |
| fly_bypass | occlusion | 59.0% | 46.2% | 54.1% | 51.3% | 6.2% |
| gru16 | nominal | 33.0% | 20.4% | 21.1% | 24.4% | 9.5% |
| gru16 | fast_target | 82.2% | 71.2% | 77.2% | 74.2% | 6.8% |
| gru16 | occlusion | 82.5% | 70.6% | 77.9% | 76.7% | 4.1% |
| fly_bio_K2 | nominal | 33.2% | 17.0% | 19.0% | 24.3% | 10.5% |
| fly_bio_K2 | fast_target | 96.3% | 88.7% | 94.3% | 83.7% | 4.2% |
| fly_bio_K2 | occlusion | 62.0% | 48.3% | 54.7% | 53.0% | 6.3% |
| fly_fixed | nominal | 35.6% | 20.5% | 24.2% | 25.6% | 8.6% |
| fly_fixed | fast_target | 93.2% | 85.4% | 90.8% | 72.4% | 3.9% |
| fly_fixed | occlusion | 63.9% | 50.7% | 58.2% | 50.7% | 6.3% |
| gru8 | nominal | 36.8% | 24.8% | 27.2% | 29.9% | 8.5% |
| gru8 | fast_target | 91.3% | 84.4% | 88.9% | 81.5% | 8.4% |
| gru8 | occlusion | 73.6% | 60.9% | 68.9% | 66.2% | 6.5% |
| fly_coreoff | nominal | 100.0% | 99.9% | 100.0% | 92.5% | 2.1% |
| fly_coreoff | fast_target | 100.0% | 100.0% | 100.0% | 92.5% | 1.4% |
| fly_coreoff | occlusion | 100.0% | 99.9% | 100.0% | 92.5% | 1.3% |
| teacher_oracle | nominal | 7.5% | 0.0% | 0.0% | 1.0% | 6.5% |
| teacher_oracle | fast_target | 8.5% | 0.0% | 1.0% | 2.0% | 6.5% |
| teacher_oracle | occlusion | 1.0% | 0.0% | 0.0% | 0.0% | 1.0% |

## Per-seed nominal success

| group | seeds |
|---|---|
| classical | 0.925 |
| mlp32 | 0.750;0.705;0.795;0.770;0.790 |
| fly_rewired_unconstrained | 0.720;0.725;0.735;0.775;0.735 |
| mlp16 | 0.725;0.730;0.735;0.735;0.740 |
| mlp64 | 0.690;0.715;0.745;0.755;0.755 |
| fly_rewired | 0.750;0.660;0.690;0.750;0.705;0.720;0.705;0.715;0.745;0.655;0.735;0.715;0.730;0.745;0.625 |
| fly_bio | 0.710;0.740;0.715;0.660;0.720 |
| fly_bio_K8 | 0.675;0.700;0.735 |
| fly_gluexc | 0.695;0.725;0.720;0.670;0.700 |
| gru32 | 0.750;0.655;0.710;0.710;0.680 |
| fly_bypass | 0.720;0.720;0.675;0.710;0.640 |
| gru16 | 0.695;0.610;0.670;0.700;0.675 |
| fly_bio_K2 | 0.655;0.665;0.685 |
| fly_fixed | 0.695;0.465;0.695;0.670;0.695 |
| gru8 | 0.570;0.670;0.600;0.645;0.675 |
| fly_coreoff | 0.000;0.000;0.000;0.000;0.000 |
| teacher_oracle | 0.925 |

## H1 scaling (same dynamics, K updates per action, batch 1, CSR, random weights)

| graph | neurons | edges | median us per action |
|---|---|---|---|
| primary subset (L<=2, w>=5) | 443 | 6453 | 21.7 |
| 3-hop subset (L<=3, w>=5) | 2616 | 97572 | 214.0 |
| whole traced CNS (w>=5) | 165122 | 6235649 | 15592.1 |

Timing hardware: Apple M5, Now drawing from 'AC Power'; timer overhead median 41 ns (included in samples); simulator render+physics median 156 us per step (excluded).
Energy: NOT MEASURED.

Figures: fig_frontier.png, fig_learning_curves.png, fig_conditions.png
