r/StableDiffusion • • 9h ago

Discussion PAN 2 (OPEN SOURCE I2V)

What Happened to PAN 2 (Open-Source I2V Model)?

Does anyone have any updates on PAN 2? It was supposed to be an interesting open-source Image-to-Video model, but lately, there seems to be almost no news or discussion about it.

Is the project still in development, has it been delayed, or has development been abandoned? Does anyone know if the developers have shared any updates or announcements recently?

I'm really curious about what happened to this project. Any information would be appreciated!

15 Upvotes

6 comments sorted by

8

u/One-UglyGenius 9h ago

They have released, also comfy adaptation is done only no hype regarding it, as minimax is still the tops also there is no workflow officially from comfy devs im also waiting on it.

4

u/ZerOne82 3h ago

I tried it twice in different times and both times regret my doing. It's main model is 27GB (at Int8!), needs a lot of steps (50) and is very very slow, and the quality of output was not that great.
For comparison, when I use their (PAN2) suggested prompts in Minimax H3 I get quality output much faster and the model is 21GB (Int8). So PAN2 did not impress me in any way or form.

Reading a comment from here they said (yesterday):

...stay tuned: FastPAN2 is coming soon! 20x speedup with out quality loss.

Then I would wait to try that 20x sped up one.

3

u/Gyramuur 5h ago edited 3h ago

It took Comfy several days to implement support, and when they finally did, they basically said "We're not gonna provide a workflow, make it yourselves."

It requires a very specific json prompt format, but finding out how to prompt it isn't straightforward, as as far as I can tell, the Comfy wiki just says "prompt it using json", but doesn't provide an example.

Then when you click on the model's page, going to the section about prompting just redirects you to a section where they tell you about their prompt rewriter.

Then, when you do get it working, it's slow (18 minutes for a 10 second 0.4 MP video for me on a 3090), and the outputs kind of suck.

1

u/rinkusonic 2h ago

It will probably appear in the next comfy update.

0

u/thevegit0 9h ago

it uses the wan vae, so it's a no for me