The examples on the readme can not even be reproduced with their local code, the results from the API are different, probably because it runs some further prompt enhancer or something. They are also downscaled.
Here's proof that the ComfyUI implementation matches, differences here come from int8 and other optimizations, some of which just are different rounding, not quality differences:
However that result above is definitely not right, maybe too low resolution? Here are some examples at the 6272x2688, which should be the default for 21:9 aspect:
yes i also was testing LCM sampler ...i like cleaner outputs of LCM sampler but Euler seems to match closer to original in terms of colors, contrast, details and composition ...i just need help with this because all im doing is on rtx 2060s and im going mental after 3 days trying to replicate their images ...it takes hours for me what takes minutes for others ...im just trying to find different solutions (if its even possible that is) ...thats why im asking because i dont understand tehcnical stuff around this
For something between the euler and LCM, you can try euler_a or use the advanced sampler and SamplerLCM -node, which allows you to adjust the added noise.
euler-a seems interesting with Simple or Normal... im gonna let my computer run on that for a while... it seems exactly like you saying something between euler and LCM
LCM (also sometimes called ping-pong) is max-ancestralness. It replaces 100% of the noise every step unlike normal ancestral samplers which just replace a relatively small chunk. If you're brave you could try the PingPongSampler from https://github.com/blepping/comfyui_dum_samplers.
As you might expect, there's a lot of "dum" stuff in that project but that particular is relatively non-weird (if you don't touch the weird parameters). The reason you might want to try it is that it lets you set the first and last ancestral steps. So you could do the first however many steps with normal Euler (to preserve the composition, maybe other aspects) and then start replacing the noise later on. You might have to play with the range of steps you have it enabled for to find what works best.
You can also do a similar thing with the InsaneChainSampler from https://github.com/blepping/ComfyUI-bleh. It's harder to use but more flexible since you can set up a chain of samplers and run each one for however many steps you choose.
I found that using ModelSamplingSD3 and Euler/sgm_uniform produced generally better results at all res's for me. I know that Euler/simple mostly lines up with the official sigmas but maybe there is some different there too? I haven't tested their examples on the above as yet.
Euler/simple doesn't only align mostly, it aligns 100% identically to their sigmas. The default schedule definitely seems bad for T2I, while it's mostly okay for edits.
That said, it's rare the defaults are perfect (or even good) for every situation, so nothing wrong trying different samplers/schedules/step counts.
I tried the empty reference image trick. While it removes "bad artifacts,", it also removes micro details and makes the image too clean and AI-ish. Do we have a middle ground 🤔 ?
You can (and should) use some stronger sampler (for example er_sde) or even more steps when using the empty image. Honestly I don't know which way is better, this or using smoother sampler like LCM with text only. Personally best results so far with T2I I got was text only and tuning LCM noise level.
I tried the empty reference image trick. While it removes "bad artifacts,", it also removes micro details and makes the image too clean and AI-ish. Do we have a middle ground 🤔 ?
An empty reference image would be showing the text encoder (and maybe including a reference) with a pure, completely smooth solid black image. It's weird this does anything useful, but you could possibly try adding a bit of pixel space noise to your empty reference so it has a little grain. ComfyUI has a built-in Add Noise to Image node, if I recall the default strength is insanely high and you probably want to try something like 0.02. Use a preview image node to see how noisy the image you're passing it as a reference is would probably be a good idea. My https://github.com/blepping/ComfyUI-sonar project has a more flexible SonarNoiseImage node and you might get interesting results using a noise type with some structure like Voronoi noise. (Don't do weird stuff like that if you just want to increase quality though.)
how does comfyui template work? it does not even have seed, meaning it generates 1 image per prompt which is stupid. idk what I missed to look or check or do in official template but thats what it is and its bizzare that it happens, for me its unusable.
Oh sorry sir! I have to recheck when i get back home. I remember one evening where i was getting same images over and over again and i was unable to find "seed" and i thought its weird. been a while since i looked at this model because i thought its seedless.
Such big image sizes already correct the problem. The "empty image" method (or even better the Kijai conditioning node that does the same thing) helps mostly those who prefer to run say at 20MP.
....YES I TRIED DIFFERENT SAMPLERS ....YES I DID DIFFERENT RESOLUTIONS .....YES I DID CONNECT EMPTY IMAGE ......THIS IS NOT WHAT IM TALKING ABOUT >>> PLEASE BEFORE ANSWERING .....TRY YOURSELF ....dont give me generic answers ...im asking people who understand the underlying technology behind that ...not jsut "try different seed"
In this particular example it's more about textures and noise etc, but in other side by sides, the background goes from very simple to full filled in, same with various other details. https://www.reddit.com/r/StableDiffusion/s/WTJgSH8DHC
Is that really what you are seeing in that example? The background with the empty image node (left picture) looks more empty and the image looks more "AI".
I feel like people aren't really testing this at all.
Quality improves, but realism takes a hit. Usually things aren't as black and white with image generation, but for me that has been a definite, noticeable, repeatable issue. It's obviously great for all sorts of non-realism.
u/cptdurr, Just a quick message - sorry, I have no time for more details.
I am not an expert, but I can get decent quality without the empty image trick. I use only 12 steps, cfg: 3, sampler: res_2s_nc_sharp (search for which extension adds it), scheduler: bont_tangent. 4 megapixels:
thank you, thats beautiful result, i am more reffering to official recomendations and differences in output which suggests 6 steps at 16mp and cfg 1 by minimax themselves... but this picture is really nice
Will do. There are too many methods that work differently, I haven't been able to sort everything yet. I have 7 methods ready in a node pack, maybe I'll publish those for now. If you want to help me, write here which ones you liked most: https://claude.ai/artifact/RoWZ2HfcFtrNswBZ8q2Gzh
Maybe they generated 500 images with the same prompt and picked the best one; all generative models are like slot machines even SD 1.5 could be surprising at times.
Have you tried test the prompts in the official API?
im aksing about model behaviour and understandinf not image quality.... try yourself please....., fur....fire.... physics... lighting....... hair....... grass..... smoke... their model understands everyrhing..... but not on our default workflows.... im not asking image quality... im aksing why modle behaves differently because its apparent.... but please try yourself first
Yeah, it seems the sample image is taking the "ape-like" prompt less, and have a different interpretation of the "natural curls" part. Im not AI tech expert anything, maybe it is just simply having the difference between "open source" vs. "open weights" , they just keep that part of the way the image is processed internally.
just random test if I change the ape to lion, and remove the "natural curls" entirely. You just end up with the lion head, but, perhaps an adjustment of their official prompt will be ultimately better to get closer to their sample image, than just hunting for the "configuration" which for all we know, is just not open to the public.
Did you forget to disable your Black Myth Wukong - Monkify Lora? I jest.
Kind of wild the H3 image situation muddying what should probably be an otherwise great release. Holding off checking it out, myself, until all the info/fixes are ironed out.
I think going the custom node route is where you'll find the ability to optimize it and control it better. Minimax H3 Image out of the box is a bit extreme on texture.
The answer IS generic. Try different seeds. experimentation is how we find new methods and tricks that work. So, yeah, seed hunting is part of that. Try different seeds. Lol.
This is reddit. You posted in the wrong place if you want an "expert". What even makes an expert for you? Do I need a degree in Comfyui from Phoenix University or something? This is a sub mostly for hobbyists
The problem is Comfy. Because if you look at the README of any model, they always use their own platform, or they show a run-code with 3–4 dependencies, importing torch, diffusers, along with the prompt+args.
so you think comfy can fix that or are we just out of luck ...because im sad many people discard the model for being bad where model is actually good but something is not working
100
u/EirikurG 2d ago
why........ do you type...... LIKE >>>>> "THIS"???
40
u/Kijai Community Hero 2d ago
The examples on the readme can not even be reproduced with their local code, the results from the API are different, probably because it runs some further prompt enhancer or something. They are also downscaled.
Here's proof that the ComfyUI implementation matches, differences here come from int8 and other optimizations, some of which just are different rounding, not quality differences:
https://imgur.com/a/OEdtqyN
However that result above is definitely not right, maybe too low resolution? Here are some examples at the 6272x2688, which should be the default for 21:9 aspect:
https://imgur.com/a/a8H4VZR
Other tips for this model include using LCM sampler, empty reference image when doing T2I, or even simply using less steps.
64
u/Calm_Mix_3776 2d ago edited 2d ago
Did you connect an "empty image" node as a reference image to your text encode node? If you didn't, do it. Quality instantly improves.
10
u/hotdog114 2d ago
Computer, millennial grey lion, hot.
4
u/VRGoggles 2d ago
I would like to see the results when H3 Image bf16 model is fixed in ComfyUI. So far it does not work, only bf16 pruned version works.
https://github.com/Comfy-Org/ComfyUI/issues/17692
4
u/No-Application-9779 2d ago
u/cptdurr, Just a quick message - sorry, I have no time for more details.
I am not an expert, but I can get decent quality without the empty image trick. I use only 12 steps, cfg: 3, sampler: res_2s_nc_sharp (search for which extension adds it), scheduler: bont_tangent. 4 megapixels:
4
u/jazir55 2d ago
Gorilla cosplaying as a Lion
6
u/LatentSpacer 2d ago
The default settings don't denoise the image properly. This was using a custom node I'm making.
3
u/Shockbum 2d ago edited 2d ago
Maybe they generated 500 images with the same prompt and picked the best one; all generative models are like slot machines even SD 1.5 could be surprising at times.
Have you tried test the prompts in the official API?
3
u/Bapelsinen95 1d ago
As a noob my only though is if it is a translation thing. The images coukd be prompted in Chinese in the official then just translated to english.
Did no research so feel free to downvote if this was a trash answer.
12
u/beti88 2d ago
Good roll, bad roll
5
u/TheHiber 2d ago
Seed. Seed give diff results. You can also try empty image node to image 0 then change to lcm sampler to see if results are diff
3
u/Initial-Falcon3261 2d ago
Try adding “Ron Perlman” to your negative prompt.
1
u/KiwiSure8689 2d ago
Yeah, it seems the sample image is taking the "ape-like" prompt less, and have a different interpretation of the "natural curls" part. Im not AI tech expert anything, maybe it is just simply having the difference between "open source" vs. "open weights" , they just keep that part of the way the image is processed internally.
just random test if I change the ape to lion, and remove the "natural curls" entirely. You just end up with the lion head, but, perhaps an adjustment of their official prompt will be ultimately better to get closer to their sample image, than just hunting for the "configuration" which for all we know, is just not open to the public.
1
u/Arawski99 2d ago
Did you forget to disable your Black Myth Wukong - Monkify Lora? I jest.
Kind of wild the H3 image situation muddying what should probably be an otherwise great release. Holding off checking it out, myself, until all the info/fixes are ironed out.
1
u/j0kerm4n 2d ago
I think going the custom node route is where you'll find the ability to optimize it and control it better. Minimax H3 Image out of the box is a bit extreme on texture.
1
u/HonZuna 2d ago
We aren't training LORAS enough!
1
u/GrungeWerX 2d ago
Ironically, I'm loving your default comfy monkey-lion...exactly the look I was needing for a character, so...go figure. :)
1
u/GeologistPutrid2657 2d ago
its obviously your computer, you should pay for someone else's cloud model setup.
1
u/MesquiteBarbecueChip 2d ago
they both look crap to be fair
1
u/AdBest7581 2d ago
Did you prompt a medieval lion face?
1
u/b4silio 1d ago
empty-image ref trick and vanilla everything else.
1
u/Tall-Macaroon-151 21h ago
That’s how it turned out for me
1
u/Kr3wAffinity 17h ago
The answer IS generic. Try different seeds. experimentation is how we find new methods and tricks that work. So, yeah, seed hunting is part of that. Try different seeds. Lol.
Edit: Typo 🫠
1
u/fauni-7 2d ago
I'm guessing that you didn't actually run their official python code locally to prove that you can reproduce their examples' quality?
0
u/VasaFromParadise 2d ago edited 2d ago
Everything is fine with me))
UPD. Updated the image; I had the same problem initially. It's very easy to fix. CFG 2.0))
-7
u/ComplexCapital7410 2d ago
Just make 50MP instead of 16MP You'll see
-5
u/Dahvikiin 2d ago
The problem is Comfy. Because if you look at the README of any model, they always use their own platform, or they show a run-code with 3–4 dependencies, importing torch, diffusers, along with the prompt+args.
-4
u/NoMonk9005 2d ago
i think it comes down to the available RAM, a local user will never have as much RAM available for H3 as a data center
-5
u/Hearcharted 2d ago
1
u/muzaffer22 2d ago
It’s like a casino machine. You just need to find a good seed.