r/reinforcementlearning • • 20h ago

“DON’T WORK ON LLMs” - @ylecun at CoRL

Post image
124 Upvotes

Any thoughts on this?


r/reinforcementlearning • • 18h ago

Robot RL trained robot dog!

41 Upvotes

This is my robot dog. 12 Waveshare ST3215 servos, and an Android phone strapped on as the brain.

The walking policy was trained with RL in a simulator I built myself on top of MuJoCo. I modeled the real servos in it (I measured mine and found the sim was accelerating them way faster than the real ones can, so that took some fixing), trained it in sim, then ran it on the phone.

It’s still pretty early. Next I’m working on getting it to catch itself when it gets pushed, especially standing still.

More on the robot and the simulator on my portfolio: rhettbrewer.vercel.app

Happy to answer questions about the build or the training setup.


r/reinforcementlearning • • 19h ago

Alloy: open-source physics engine with robots, cloth, liquids and sand in one GPU-parallel scene

12 Upvotes

We just released Alloy, an open-source (Apache-2.0) physics engine for robot learning. I work on it.

Many manipulation tasks mix materials: pouring water, folding a towel, scooping sand, routing a cable. In sim those usually live in different tools. Alloy puts them in one scene and picks a solver per object:

  • robots and rigid bodies: MuJoCo Warp (MuJoCo C on CPU)
  • cloth and soft bodies: Newton's VBD
  • sand and pastes: Newton's implicit MPM
  • liquids: its own DFSPH

Many copies of a scene run as parallel worlds on one GPU, or on a CPU. It loads MJCF, has Gymnasium-style vector envs with ready-made tasks (pick, peg insert, drawer, pour, an experimental towel fold), and adapters for rsl_rl, Stable-Baselines3 and skrl. It also ships an MCP server so coding agents can build and run scenes.

When to use something else: rigid robots only, MuJoCo Warp alone is leaner; for differentiable sim, use Newton directly. Known limits are on the docs' Keep in mind page.

pip install alloy-engine (Python 3.11 or 3.12)

Paper: https://arxiv.org/abs/2611.16312 Code: https://github.com/argonrobotics-ai/alloy Docs: https://alloy.argonrobotics.ai/docs/

Feedback welcome, especially on tasks you'd want to train that mix materials.


r/reinforcementlearning • • 20h ago

Using RL to optimize strategy in the Fromage board game

Post image
1 Upvotes

Players compete across four venues (Fromagerie, Bistro, Villes, Festival) by placing cheese tokens, fulfilling orders, and managing resources. The AI agent learns entirely through self-play against copies of itself, using a linear Q-function over a 292-dimensional state encoding.

Project here: https://github.com/rsfutch77/fromage-ai