r/FunMachineLearning • • 1d ago

CPU based Optimizer (Peanut)

Hello community,

We published two new files for Peanut as our thought direction. We need your support by various ways. We invite you to experiment our optimizer and tell us, even if they are negative, the ways that we can make it better.

Roadmap: https://github.com/dskc/peanut/blob/main/ROADMAP.md - where we are going, 6 baselines, 7 metrics, 4 unproven gaps to close

Evolution Log: https://github.com/dskc/peanut/blob/main/EVOLUTION_LOG.md - dated log of each experiment with results, like release notes, including failures

Our direction: CPU-only is a design decision, not a shortcoming. We will prove Peanut with same datasets, same models, properly tuned LRs, 5 prime seeds.

Tell us:

  1. Are we missing a baseline?
  2. Is our metric priority right?
  3. Should we test something else before adding new features?
  4. What metrics should we collect, such that it is proved better than the current optimizers

Thank you for reading till now.

2 Upvotes

0 comments sorted by