Project 04Read · experimentPyTorch · CPU float32 · preregistered locally
Take 512 real neurons and their 3,061 directed connections from the connectome. Make each connection a trainable weight, feed bytes of Shakespeare through learned embeddings, and train a readout. Compare against the same graph with its edges rewired while preserving every neuron's in- and out-degree. If the anatomy carries useful structure, the fly topology should win. It did not.

On the sealed test split, averaging the three rewired controls for each seed and subtracting the fly model: mean −0.0103 bits per byte, 95% paired bootstrap interval [−0.0206, +0.0017]. Four of five seeds favoured rewiring. The interval includes zero, so no clear disadvantage is established either, and it falls well short of the predeclared +0.02 BPB practical advantage. This is one subgraph from one specimen, mostly visual neurons, with about 92% of those neurons' filtered connectivity falling outside the subset. It is a null result for this experiment, not a result about biological learning.
| Condition | Runs | Active params | Test BPB | Byte perplexity | Accuracy |
|---|---|---|---|---|---|
| Fly topology | 5 | 52,981 | 2.6388 | 6.23 | 46.92% |
| Degree-rewired control | 15 | 52,981 | 2.6286 | 6.18 | 47.11% |
| Random-density control | 5 | 52,981 | 2.5827 | 5.99 | 47.65% |
| Parameter-matched GRU | 5 | 53,000 | 2.5575 | 5.89 | 49.41% |
| No cross-node recurrence | 5 | 50,432 | 2.6738 | 6.38 | 45.92% |
Validation-selected checkpoints scored once on 55,769 test positions. Train-only references: unigram 4.8506 BPB, bigram 3.6084 BPB. Lower is better.

final-evaluate command. The analysis plan, code, corpus, graphs and configuration were hashed into a freeze file before the confirmation run.




After every stage an audit script replayed the saved validation scores and matched them to the logs within 10⁻⁶ BPB, verified code, plan, corpus and graph hashes, confirmed exact labelled degree preservation in the controls, matched initial edge-slot weights between fly and null arms, checked that every run consumed its full budget, and confirmed that no test loader had been opened. The final audit re-derived the paired bootstrap independently. The unit suite is 31 passed, 2 skipped (no CUDA or MPS in the deterministic CPU configuration).
cd projects/connectome-lm
python3.12 -m venv .venv && .venv/bin/pip install -r requirements.lock && .venv/bin/pip install --no-deps -e .
./fly-lm download --cache-dir ../../data/flat-connectome # MaleCNS flat files, ~1.07 GB
./fly-lm prepare --nodes 512 --sampling-seeds 101
./fly-lm smoke # 5 runs, minutes
./fly-lm run --config pilot # 15 runs
./fly-lm tune --config pilot --output configs/development-selection.json
./fly-lm freeze --config confirmation --selection configs/development-selection.json --output configs/confirmation-frozen.json
./fly-lm run --config confirmation --freeze configs/confirmation-frozen.json # 35 runs, ~4.5 h on a laptop CPU
./fly-lm final-evaluate --freeze configs/confirmation-frozen.json
The confirmation reports, final review, audits, per-run values and the figure source are in reports/confirmation-211428f1ca1f/. Checkpoints and prepared graphs are not in the repository.