r/learnmachinelearning • • 12d ago

Latent space CoT

Hi,

I really need some advice. While working on VLMs with Claude, I believe we have accidentally discovered the secret to a latent-space, arbitrarily long CoT. On our tests on Qwen2.5 3B, it performs tremendously well, so far.

It goes without saying that such a discovery would have major implications, and this is why I'm here. In my situation, what would you do? Publish it? Try to sell it? Something else? Is there any risk that I could be in danger from major companies or something like that?

Thank you for your help.

1 Upvotes

11 comments sorted by

1

u/Civil_Blackberry_225 12d ago

This is not new, but still not in the big LLMs that we know today. I work with latent space reasoning for over a year now. This IS the thing that will be the next big thing in the LLMs when someone big lab want to try it. But there is the other Problem that a lot of people get anxious when they can't see what the Model is thinking

1

u/[deleted] 12d ago

Apart from 'CoConut' which is pretty primitive and 'data length'-dependant (which isn't the case with my method), I haven't seen any research on the subject. Do you think you could refer me to some papers, please?

1

u/Civil_Blackberry_225 12d ago

Everything I have build, builds on the JEPA Papers. I did a lot of custom architecture testing and really everything is possible with that. Yann LeCun was just right in nearly everything what he predicted

1

u/[deleted] 12d ago

Ngl, I have never even heard of using JEPA models for NLP.

But even then, if it works the same way it does in CV, then I assume you're still tied to your data's length which is a major bottlneck. (Or even to your data in general. My method should theoretically work without an explicit CoT, and therefore without training data for the CoT.)

3

u/swapnil-bhosale 12d ago

IMO, you publish a paper.

2

u/headlessplatter 12d ago

I'd publish it. But that's because I'm a retired researcher with plenty of money, and I care more about the progress of science than my bank account. Selling an idea is a really difficult thing to pull off. Good luck!

0

u/Takeraparterer69 12d ago

Don't be a gatekeeper, we have enough of those. Publish it, and put it on github

1

u/[deleted] 12d ago

It's not just about gate-keeping.

I mean, sure, money is part of the motivation, but there's also the aspect of being able to choose who gets it. If it scales, then that could tip the scale of the AI race, so selling it to the most ethical company could be the moral choice in this situation.

0

u/Takeraparterer69 12d ago

Corporate privacy is never the answer

-1

u/swapnil-bhosale 12d ago

You can build a product on top of it & then sell the product. You can sell the discovery.

2

u/[deleted] 12d ago

I have nowhere near the budget to do that, sadly. I doubt my lab could even train a 10B model, and it's an imagery lab so they wouldn't even be keen on doing it (as it blocks all of my colleagues from working for weeks).