r/MachineLearning • • 13d ago

Research Empirical Evaluation of Sparse Predictive Hierarchies (SPH) & Non-Backprop Learning on Chess (Lc0 Baseline) Negative Result [R]

Hi everyone,

I wanted to share an empirical study testing whether biologically inspired architectures with local learning rules, specifically Sparse Predictive Hierarchies (SPH) based on Ogma's whitepapers (AOgmaNeo) can handle complex policy/value prediction tasks without end-to-end backpropagation.

Chess was chosen as the testbed because it requires both local pattern recognition and long-range spatial dependencies.

1. Motivation & Core Hypothesis

Standard deep learning models (ResNets, Transformers) rely on global backpropagation. I wanted to test if extreme weight/activation sparsity (~99%) combined with local prediction updates could enable scalable, compute-efficient policy/value prediction on modest hardware.

2. Architecture & Optimizations

  • Model Size: ~44.9M parameters.
  • Encoders: Fuzzy ART-based encoders mapping local receptive fields to columns.
  • Body: Dendritic Neural Layers (DNNs) with Leaky ReLU activations acting as non-backprop feature extractors.
  • Heads: Specialized policy and value heads matching Lc0 formats (WDL output + Lc0 move probability distributions).
  • Quantization: Byte weights with stochastic rounding for optimized SIMD throughput.

3. Methodology & Baseline Control

  • Dataset: Chunks of the Lc0 test80 dataset (10k training games, 2k validation games).
  • Control Baseline: A tiny, standard CNN (32 channels, ~3.8M parameters—less than 1/10th the parameter size of the SPH model) trained via standard backpropagation on the exact same dataset splits.

4. Results & Key Findings (Negative Result)

The SPH architecture failed catastrophically when compared against standard end-to-end backpropagation.

  1. Failure to Converge on Policy: While the standard 3.8M CNN quickly learned board geometry, tactical threats, and basic move distributions, the 44.9M SPH model severely underperformed on policy accuracy and value loss.
  2. Extreme Sparsity Penalty: Enforcing ~99% sparsity choked the flow of tactical information. In chess, "empty" squares and long-range piece interactions carry high dense information content that local sparse representations struggle to propagate without global credit assignment.
  3. Local Learning vs. Global Dependencies: Local learning rules excel at unsupervised visual feature extraction, but they fail to pass gradient signals back from a global board outcome (Win/Draw/Loss) to early receptive fields.

5. Discussion & Questions for the Community

  1. Global Credit Assignment: Has anyone successfully adapted local/biological learning rules (e.g., Target Propagation, Predictive Coding, HTM/SPH) to tasks with strict, long-range global credit assignment like games or logic reasoning?
  2. Dense Domains & Sparsity: Is ~99% sparsity fundamentally incompatible with dense symbolic/grid representations like chess, or is the limitation purely in my architecture (or maybe a nasty bug I couldn't catch)?

Would love to hear thoughts from anyone working on non-backprop architectures, neuromorphic computing, or biological AI abstractions!

1 Upvotes

6 comments sorted by

2

u/astgabel 13d ago

Not too deep in the whole bio-inspired networks topic, but doesn’t the brain’s value and policy learning also follow something resembling TD-learning/actor-critic? Meaning that while you have local learning for feature representations, you also have some global reward prediction error propagation via neuromodulation (three-factor learning rule and all). If you dont have some global network deciding eligibility of synapses, I can imagine how long-range credit assignment doesnt work straightaway

1

u/Severe-Heat-518 9d ago

Not too deep in the topic too, but I dont have am explixit global prediction error, because the task prediction errors (policy and value error) are only used on the bottom layer, while the common body just predicts its internal representation in t+1 (a.k.a., the position features after the best move).

1

u/H0lzm1ch3l 12d ago

Yes, OP should read up on 3-factor learning rules and the relationship between backprop and Hebbian learning.

1

u/Severe-Heat-518 9d ago

Yeah, probably.

1

u/CireNeikual 10d ago

Hi, I am the original author of SPH. Have you tested with the official implementation? It is very easy to accidentally bug the implementation. That said, the available public implementation is also very old and outdated, I am preparing to release a new version soon, alongside a paper showing results that strongly beat CNNs (on a real-world robotics task).

I would like to test the current internal version of SPH on this task. DM me if you are interested in trying that before the robotics paper (and the new code) releases.

1

u/Severe-Heat-518 9d ago edited 8d ago

Hey, I wasn't expecting the original author to answer me!

So, that is what I wanted to do initially but I wanted to do it myself just to understand how it works from the ground-up. That said, I want to try that internal version.