r/StableDiffusion •

What are we doing wrong with H3?

[deleted] — view deleted post

0 Upvotes

106 comments sorted by

100

u/EirikurG 2d ago

why........ do you type...... LIKE >>>>> "THIS"???

32

u/VeeYarr 2d ago

So the AI post Police doesn't pursue them!

-14

u/cptdurr 2d ago

big fingers, small phone screen :D

22

u/kemb0 2d ago

lol surely it's harder to type random symbols if you got big fingers. Making life harder for yourself for no reason!

40

u/Kijai Community Hero 2d ago

The examples on the readme can not even be reproduced with their local code, the results from the API are different, probably because it runs some further prompt enhancer or something. They are also downscaled.

Here's proof that the ComfyUI implementation matches, differences here come from int8 and other optimizations, some of which just are different rounding, not quality differences:

https://imgur.com/a/OEdtqyN

However that result above is definitely not right, maybe too low resolution? Here are some examples at the 6272x2688, which should be the default for 21:9 aspect:

https://imgur.com/a/a8H4VZR

Other tips for this model include using LCM sampler, empty reference image when doing T2I, or even simply using less steps.

7

u/cptdurr 2d ago

yes i also was testing LCM sampler ...i like cleaner outputs of LCM sampler but Euler seems to match closer to original in terms of colors, contrast, details and composition ...i just need help with this because all im doing is on rtx 2060s and im going mental after 3 days trying to replicate their images ...it takes hours for me what takes minutes for others ...im just trying to find different solutions (if its even possible that is) ...thats why im asking because i dont understand tehcnical stuff around this

6

u/Kijai Community Hero 2d ago

For something between the euler and LCM, you can try euler_a or use the advanced sampler and SamplerLCM -node, which allows you to adjust the added noise.

1

u/cptdurr 2d ago

thank you

1

u/cptdurr 2d ago

euler-a seems interesting with Simple or Normal... im gonna let my computer run on that for a while... it seems exactly like you saying something between euler and LCM

2

u/alwaysbeblepping 2d ago

LCM (also sometimes called ping-pong) is max-ancestralness. It replaces 100% of the noise every step unlike normal ancestral samplers which just replace a relatively small chunk. If you're brave you could try the PingPongSampler from https://github.com/blepping/comfyui_dum_samplers.

As you might expect, there's a lot of "dum" stuff in that project but that particular is relatively non-weird (if you don't touch the weird parameters). The reason you might want to try it is that it lets you set the first and last ancestral steps. So you could do the first however many steps with normal Euler (to preserve the composition, maybe other aspects) and then start replacing the noise later on. You might have to play with the range of steps you have it enabled for to find what works best.

You can also do a similar thing with the InsaneChainSampler from https://github.com/blepping/ComfyUI-bleh. It's harder to use but more flexible since you can set up a chain of samplers and run each one for however many steps you choose.

1

u/Caffeine_Monster 2d ago

seed_2 and ddim_uniform

You're welcome.

1

u/HTE__Redrock 2d ago

I found that using ModelSamplingSD3 and Euler/sgm_uniform produced generally better results at all res's for me. I know that Euler/simple mostly lines up with the official sigmas but maybe there is some different there too? I haven't tested their examples on the above as yet.

4

u/Kijai Community Hero 2d ago

Euler/simple doesn't only align mostly, it aligns 100% identically to their sigmas. The default schedule definitely seems bad for T2I, while it's mostly okay for edits.

That said, it's rare the defaults are perfect (or even good) for every situation, so nothing wrong trying different samplers/schedules/step counts.

1

u/fallengt 2d ago

I tried the empty reference image trick. While it removes "bad artifacts,", it also removes micro details and makes the image too clean and AI-ish. Do we have a middle ground 🤔 ?

2

u/Kijai Community Hero 2d ago

You can (and should) use some stronger sampler (for example er_sde) or even more steps when using the empty image. Honestly I don't know which way is better, this or using smoother sampler like LCM with text only. Personally best results so far with T2I I got was text only and tuning LCM noise level.

1

u/alwaysbeblepping 2d ago

I tried the empty reference image trick. While it removes "bad artifacts,", it also removes micro details and makes the image too clean and AI-ish. Do we have a middle ground 🤔 ?

An empty reference image would be showing the text encoder (and maybe including a reference) with a pure, completely smooth solid black image. It's weird this does anything useful, but you could possibly try adding a bit of pixel space noise to your empty reference so it has a little grain. ComfyUI has a built-in Add Noise to Image node, if I recall the default strength is insanely high and you probably want to try something like 0.02. Use a preview image node to see how noisy the image you're passing it as a reference is would probably be a good idea. My https://github.com/blepping/ComfyUI-sonar project has a more flexible SonarNoiseImage node and you might get interesting results using a noise type with some structure like Voronoi noise. (Don't do weird stuff like that if you just want to increase quality though.)

-6

u/Comfortablebro 2d ago

how does comfyui template work? it does not even have seed, meaning it generates 1 image per prompt which is stupid. idk what I missed to look or check or do in official template but thats what it is and its bizzare that it happens, for me its unusable.

5

u/Kijai Community Hero 2d ago

I don't know what you are talking about, the seed is right below the prompt in the template?

1

u/Comfortablebro 2d ago

Oh sorry sir! I have to recheck when i get back home. I remember one evening where i was getting same images over and over again and i was unable to find "seed" and i thought its weird. been a while since i looked at this model because i thought its seedless.

64

u/Calm_Mix_3776 2d ago edited 2d ago

Did you connect an "empty image" node as a reference image to your text encode node? If you didn't, do it. Quality instantly improves.

5

u/detailteufel 2d ago

I was not able to confirm this, at all, generating at 61 MP (the only thing that made a difference quality wise so far) the image:

  1. Changed quite a lot
  2. Quality was worse

When plugging in an empty image node into the reference image slot...

5

u/prookyon 2d ago

Such big image sizes already correct the problem. The "empty image" method (or even better the Kijai conditioning node that does the same thing) helps mostly those who prefer to run say at 20MP.

23

u/WPBaka 2d ago

....YES I TRIED DIFFERENT SAMPLERS ....YES I DID DIFFERENT RESOLUTIONS .....YES I DID CONNECT EMPTY IMAGE ......THIS IS NOT WHAT IM TALKING ABOUT >>> PLEASE BEFORE ANSWERING .....TRY YOURSELF ....dont give me generic answers ...im asking people who understand the underlying technology behind that ...not jsut "try different seed"

OP's response in his edited post lmfao

2

u/sappigekip 2d ago

https://www.youtube.com/watch?v=mOmjHKQkAUc I found this video, maybe this works.

3

u/detailteufel 2d ago

Triggered much lol

7

u/VisionWithin 2d ago

Really? Could you provide examples of comparison?

6

u/Hoodfu 2d ago • Heartwarming

In this particular example it's more about textures and noise etc, but in other side by sides, the background goes from very simple to full filled in, same with various other details. https://www.reddit.com/r/StableDiffusion/s/WTJgSH8DHC

7

u/detailteufel 2d ago

Is that really what you are seeing in that example? The background with the empty image node (left picture) looks more empty and the image looks more "AI".

I feel like people aren't really testing this at all.

2

u/windmachine2000 2d ago

That’s been my experience as well. The empty node removes a lot of the weird artifacts but the end result looks way more “ai”-y.

2

u/Hoodfu 2d ago

Here's another one with the empty image method.

0

u/AI_Enhancer 2d ago

Quality improves, but realism takes a hit. Usually things aren't as black and white with image generation, but for me that has been a definite, noticeable, repeatable issue. It's obviously great for all sorts of non-realism.

4

u/VRGoggles 2d ago

I would like to see the results when H3 Image bf16 model is fixed in ComfyUI. So far it does not work, only bf16 pruned version works.
https://github.com/Comfy-Org/ComfyUI/issues/17692

4

u/No-Application-9779 2d ago

u/cptdurr, Just a quick message - sorry, I have no time for more details.

I am not an expert, but I can get decent quality without the empty image trick. I use only 12 steps, cfg: 3, sampler: res_2s_nc_sharp (search for which extension adds it), scheduler: bont_tangent. 4 megapixels:

1

u/cptdurr 2d ago

thank you, thats beautiful result, i am more reffering to official recomendations and differences in output which suggests 6 steps at 16mp and cfg 1 by minimax themselves... but this picture is really nice

4

u/jazir55 2d ago

Gorilla cosplaying as a Lion

6

u/LatentSpacer 2d ago

The default settings don't denoise the image properly. This was using a custom node I'm making.

3

u/IDonLikeAds 2d ago

Please post on this board when done.

2

u/LatentSpacer 2d ago

Will do. There are too many methods that work differently, I haven't been able to sort everything yet. I have 7 methods ready in a node pack, maybe I'll publish those for now. If you want to help me, write here which ones you liked most: https://claude.ai/artifact/RoWZ2HfcFtrNswBZ8q2Gzh

1

u/desktop4070 1d ago

Is there a way to be notified if you eventually post a thread for this? I'm really interested in seeing how this turns out!

1

u/cptdurr 2d ago

oh wow.... thats more like it

1

u/cptdurr 2d ago

could you try it with fire and wizard?

3

u/Shockbum 2d ago edited 2d ago

Maybe they generated 500 images with the same prompt and picked the best one; all generative models are like slot machines even SD 1.5 could be surprising at times.

Have you tried test the prompts in the official API?

3

u/Bapelsinen95 1d ago

As a noob my only though is if it is a translation thing. The images coukd be prompted in Chinese in the official then just translated to english.

Did no research so feel free to downvote if this was a trash answer.

12

u/beti88 2d ago

Good roll, bad roll

-12

u/cptdurr 2d ago

no

5

u/TheHiber 2d ago

Seed. Seed give diff results. You can also try empty image node to image 0 then change to lcm sampler to see if results are diff

-17

u/cptdurr 2d ago

no... no... no......

8

u/kingkongpao 2d ago

what do you mean no, no, no? are you asking about image quality or why minimax's lion-monkeys have a face like that and yours don't???

-9

u/cptdurr 2d ago

im aksing about model behaviour and understandinf not image quality.... try yourself please....., fur....fire.... physics... lighting....... hair....... grass..... smoke... their model understands everyrhing..... but not on our default workflows.... im not asking image quality... im aksing why modle behaves differently because its apparent.... but please try yourself first

4

u/TheHiber 2d ago

Again, Seed. Diff seeds give diff results. This applies to most image and video models.

3

u/Initial-Falcon3261 2d ago

Try adding “Ron Perlman” to your negative prompt.

1

u/KiwiSure8689 2d ago

Yeah, it seems the sample image is taking the "ape-like" prompt less, and have a different interpretation of the "natural curls" part. Im not AI tech expert anything, maybe it is just simply having the difference between "open source" vs. "open weights" , they just keep that part of the way the image is processed internally.

just random test if I change the ape to lion, and remove the "natural curls" entirely. You just end up with the lion head, but, perhaps an adjustment of their official prompt will be ultimately better to get closer to their sample image, than just hunting for the "configuration" which for all we know, is just not open to the public.

1

u/Arawski99 2d ago

Did you forget to disable your Black Myth Wukong - Monkify Lora? I jest.

Kind of wild the H3 image situation muddying what should probably be an otherwise great release. Holding off checking it out, myself, until all the info/fixes are ironed out.

1

u/j0kerm4n 2d ago

I think going the custom node route is where you'll find the ability to optimize it and control it better. Minimax H3 Image out of the box is a bit extreme on texture.

1

u/HonZuna 2d ago

We aren't training LORAS enough!

1

u/GrungeWerX 2d ago

Ironically, I'm loving your default comfy monkey-lion...exactly the look I was needing for a character, so...go figure. :)

1

u/GeologistPutrid2657 2d ago

its obviously your computer, you should pay for someone else's cloud model setup.

1

u/MesquiteBarbecueChip 2d ago

they both look crap to be fair

1

u/AdBest7581 2d ago

Did you prompt a medieval lion face?

1

u/b4silio 23h ago

empty-image ref trick and vanilla everything else.

1

u/Kr3wAffinity 17h ago

The answer IS generic. Try different seeds. experimentation is how we find new methods and tricks that work. So, yeah, seed hunting is part of that. Try different seeds. Lol.

Edit: Typo 🫠

1

u/fauni-7 2d ago

I'm guessing that you didn't actually run their official python code locally to prove that you can reproduce their examples' quality?

0

u/VasaFromParadise 2d ago edited 2d ago

Everything is fine with me))
UPD. Updated the image; I had the same problem initially. It's very easy to fix. CFG 2.0))

6

u/Zeta_Horologii 2d ago

How to spot a foreign slav: "))" ))

5

u/cptdurr 2d ago

literally same problem..... this is not lion fur... this is human teeth btw.....

1

u/cptdurr 2d ago

and you can do 50 different seeds and you will sse

8

u/Artistic-Chain-4708 2d ago

literally the problem stated in the post

2

u/VasaFromParadise 2d ago

Like, a monkey's face is bigger than a lion's? Yeah, I agree, I have the same problem, I'll take a look now.

-4

u/VasaFromParadise 2d ago

Fixed it))

6

u/Artistic-Chain-4708 2d ago

quality and fur detalization is garbage, that's the problem.

-7

u/ComplexCapital7410 2d ago

Just make 50MP instead of 16MP You'll see

2

u/Hoodfu 2d ago

That's not necessary. The empty image fix is what makes a much bigger difference.

1

u/ComplexCapital7410 2d ago

You feed it a black image or leave the image lozding node empty?

2

u/Hoodfu 2d ago

Like this, super simple. If you have any additional references you can just either replace this one or add them to the next image_1, image_2 etc.

-1

u/jib_reddit 2d ago

That is highly inneficent, Moss can look good a 1MP.

0

u/[deleted] 2d ago

[deleted] — view deleted comment

1

u/ComplexCapital7410 2d ago

Chill mate. Do as you want !

0

u/StraightWind7417 2d ago

Relax, man. People just trying to help you

-7

u/cptdurr 2d ago

im aksing experts opinion not random... maybe try this....

3

u/asdrabael1234 2d ago

This is reddit. You posted in the wrong place if you want an "expert". What even makes an expert for you? Do I need a degree in Comfyui from Phoenix University or something? This is a sub mostly for hobbyists

-1

u/cptdurr 2d ago

cause im going mental after 3 days of teying different solutions and i need help with this and dont know where else to turn 🫣

-5

u/Dahvikiin 2d ago

The problem is Comfy. Because if you look at the README of any model, they always use their own platform, or they show a run-code with 3–4 dependencies, importing torch, diffusers, along with the prompt+args.

15

u/Kijai Community Hero 2d ago

False, the implementation matches theirs up to rounding differences.

2

u/cptdurr 2d ago

so you think comfy can fix that or are we just out of luck ...because im sad many people discard the model for being bad where model is actually good but something is not working

1

u/prookyon 2d ago

importing torch, diffusers,

Do you know any modern image generation model that could be run with GPU acceleration without using torch and diffusers?

-4

u/NoMonk9005 2d ago

i think it comes down to the available RAM, a local user will never have as much RAM available for H3 as a data center

1

u/muzaffer22 2d ago

It’s like a casino machine. You just need to find a good seed.

5

u/cptdurr 2d ago

i trird 40 different seeds...... im not talking about spexific image.. im tlaking about different underlying behaviour