ResultsProjects 08 – 10Experiments 1, 2 and 3

What three experiments on the fly's wiring found

Three experiments put the fly connectome, the full map of the fly's nerve cells and their connections, to practical tests: steering a robot, learning without backpropagation, and finding similar items fast. Each one fixed its rules before it started, including what result would count as a win and when to stop. The answers were mostly no. This page shows what was found, including where the fly's wiring lost.

The clearest finding: a short memory that helps and hurts

Slope chart. Post collisions: 13.2% for the circuit and 13.3% for the direct connection with the target visible; 18.2% against 21.4% with it hidden. Wall collisions: 7.4% against 4.5% visible, 25.5% against 22.8% hidden.Slope chart. Post collisions: 13.2% for the circuit and 13.3% for the direct connection with the target visible; 18.2% against 21.4% with it hidden. Wall collisions: 7.4% against 4.5% visible, 25.5% against 22.8% hidden.
A simulated robot follows a target past posts and walls, steered either by a fly circuit with loops or by a direct connection with none. With walls, the circuit is about 2.8 points worse whether or not the target is visible; with posts, it is level while the target is visible and 3.2 points better once it is hidden. The fly circuit's loops give it a short memory. The simplest reading is that the memory helps it hold a course past obstacles while the target is out of sight, and makes it slower to react to a wall right in front of it, so with the target hidden the two effects roughly cancel out. That reading fits the pattern but was not tested directly.

Data: stage1_headroom.md · stage1b_occlusion.md · full write-up

The four verdicts

Four cards. Robot steering: no clear help. Training without backpropagation: stopped before the main test. Memory filter: only where nothing works. Similarity search: no.Four cards. Robot steering: no clear help. Training without backpropagation: stopped before the main test. Memory filter: only where nothing works. Similarity search: no.
Each card gives the question in plain words and the answer its rules produced. Three of the four answers are no, and the fourth is a win only in a setting where no method does the job.

Data: g1.json · g1b.json · pilot_analysis.json · exp3_analysis.md

The three experiments

08 · Does the fly's steering circuit help a robot follow a target?

Trained until it stopped improving, a 443-neuron circuit from the fly was not clearly better than a direct connection. With the target visible it was slightly worse; with the target hidden the test could not decide. Three randomly rewired copies of the circuit did as well as the real one, so what helped was having loops at all, not the fly's particular wiring. The real circuit also turned out to be quieter than every scrambled version of itself before any training, a difference earlier comparisons had not corrected for.

09 · Can the circuit learn without backpropagation?

A pilot of forward-only learning, which never sends an error signal backwards, found results swinging between random starting points about four and a half times more than planned for. That is past the stopping limit fixed in advance, so the main comparison of learning rules was never run.

10 · Can fly-brain ideas make search and memory faster?

The fly Bloom filter beat conventional methods only at memory budgets so small that no method worked. The fly's real odour wiring was no better than scrambled wiring when missing data were set to zero, but it was better when they were filled with averages. An idea proposed to rescue it was contradicted. On the standard search benchmark, FlyHash answered about one question for every 200 the best conventional index answered.

How these were run

All three experiments were preregistered: before running anything that would produce its results, each wrote down what it would compare, how many runs it would make, what result would count as a win, what would count as ruling an effect out, and when it would stop. The analysis code was frozen and fingerprinted, and checked against that fingerprint before every analysis. Each stage ran only once the previous gate's verdict was in. Two of the three ended at a gate: Experiment 1's second test came back unclear, leaving too little to explain for its next stage to be informative, and Experiment 2's pilot tripped its own stopping rule.

That is the methodological point of the work. With the rules fixed in advance, a negative result cannot be argued away afterwards, and a positive one could not have been manufactured by trying analyses until one worked.

What these results do not say

← 10 Fly-inspired searchAll projects →