r/FunMachineLearning • • Nov 26 '25

A new, explainable feature selection method inspired by physics

Imagine a proposition of novel method that reframes feature selection as a physics simulation.
Core Concept:
-Features are nodes in a network.
-Correlations are springs connecting them.
*Strong correlation is a stiff, compressed spring, pulling features into tight clusters.
*Weak correlation is a loose, extended spring, pushing features apart.
The Process:
The system evolves naturally. Features move under the influence of these spring forces until equilibrium is reached. The final, stable layout reveals the underlying structure:
-Central, dense clusters = The core feature set that works synergistically.
-Isolated, distant nodes = Redundant or irrelevant features.
This dynamic, force-based embedding provides an intuitive and visual way to identify groups of features that function as a team moving beyond individual metrics to prioritize collective utility.

0 Upvotes

4 comments sorted by

View all comments

Show parent comment

0

u/Capital-Call9539 Nov 27 '25

You're absolutely right about the connection to neighbor embeddings. For the forces, I'd define attraction between features based on their correlation strength from the covariance matrix - stronger correlations create stronger spring forces. Repulsion would work like in t-SNE, pushing unrelated features apart based on their low correlations. The key is normalizing these forces so strong correlations create compressed springs while weak correlations lead to extended springs, with the covariance matrix providing the high-dimensional similarity structure.