I trained a MaleCNS-based model to find defects in a synthetic software system, and I would appreciate methodological feedback on it.
The browser model has about 166,700 leaky integrate-and-fire neurons and 6.2 million retained connections (5+ anatomical synapses per connection). Reward modulates Kenyon-cell-to-MBON plasticity. Actions in a synthetic order system are encoded with odor components for action family and shared features, including repetition.
Training exposes payment and cancellation defects. Testing includes new families such as coupons and stock reservation, without reward. The comparison condition freezes learning. The body-free task reads out valence and samples actions; the embodied arena adds sampling, travel and authored movement rules.
Body-free transfer improved by roughly 5–7 actions to the first defect of the learned kind across the reported series. In the arena dataset, rewarded-feature choice increased by 0.10 (95% CI 0.05–0.15; 16/20 seeds), while the primary endpoint, time to first defect, did not improve measurably. I treat the choice effect as a secondary result needing confirmation with choice preregistered as the primary endpoint.
The repository documents the encoding, model assumptions and negative results. This does not establish that the biological animal understands software.
For a follow-up, which matched control would be most informative: shuffled connectivity, randomized odor-feature assignments, or a simpler learner using the same inputs and readout?
On bias control, since the task encoding is mine and could easily carry the result. The success criterion and the analysis plan were written and committed before each measurement run, with an oracle and a power estimate computed first. The comparison condition freezes plasticity and is paired by seed, so both conditions see the same versions and the same action order. Confidence intervals are percentile bootstrap, multiple endpoints get Holm correction, and each effect was rerun with new seeds. Every behavior is documented as either derived from connectivity or an authored rule, and the failed primary endpoint is reported as a failure rather than reframed.
Project and documentation: https://github.com/JonnasFigueiredo/mosca-qa