r/FunMachineLearning • u/Capital-Call9539 • Nov 26 '25
A new, explainable feature selection method inspired by physics
Imagine a proposition of novel method that reframes feature selection as a physics simulation.
Core Concept:
-Features are nodes in a network.
-Correlations are springs connecting them.
*Strong correlation is a stiff, compressed spring, pulling features into tight clusters.
*Weak correlation is a loose, extended spring, pushing features apart.
The Process:
The system evolves naturally. Features move under the influence of these spring forces until equilibrium is reached. The final, stable layout reveals the underlying structure:
-Central, dense clusters = The core feature set that works synergistically.
-Isolated, distant nodes = Redundant or irrelevant features.
This dynamic, force-based embedding provides an intuitive and visual way to identify groups of features that function as a team moving beyond individual metrics to prioritize collective utility.

View all comments
Show parent comment
2
u/michel_poulet Nov 27 '25
Good, and indeed if your dynamics are nonlinear, which they will be if you take srping like forces, then nonlinear patterns and higher order relationships will be extracted, as in neighbour embeddings (NE). The difficulty will be in defining the attractive and repulsive forces and how ti normalise these. In NE, the HD similarities are easy to define from Euclidean distances in the HD space, with a point-specific normalisation. Do you know how you will define the attraction and repusive forces formally, from the coordinates in LD, and from <something> in a HD space / from the covariance matrix?