Diffusion Single File
comfyui

I found great settings :) for quality and prompt follow

#48
by hanswurstwerner - opened

Try the ClownsharKsampler and change the Nois_Type_Init to "Studentt" 6 Steps ddim/beta, shift 12/10 it's incredible how good the quality is even at low resolutions. The other options from Sharksampler also bring good quality, just experiment. I use Ref 4 Step lora 0.1. I've tried a lot of things before but never really found good quality, but this is the solution for me.
Link for ClownsharKsampler https://github.com/ClownsharkBatwing/RES4LYF.git

With ETA, you can also increase or decrease the value; this also has a greater effect on quality and prompt follow. For example, I noticed a big difference when I switched from 0.50 to 0.25 or 0.75. You can generally test a lot and have significantly more opportunities to improve quality and prompt follow.

1

Try the different noise types yourself, they definitely make a huge difference

2

Try a higher or lower value for s_noise_init e.g. 0.80, that can also bring quality again or better promptly follow.

3

Then I tried something else that worked wonderfully and promptly reinforced it significantly and in some cases improved the quality again. There is a node for Flux2klein9b called https://github.com/capitan01R/ComfyUI-Flux2Klein-Enhancer if you increase the "active scale" above, it promptly follows it much better, test it out yourself.

4

I tried 3.00 strength once and the prompt follow is incredible, just try 1.25-3.00 strength.
If the value is too high, the quality may suffer. But for me it varies from video to video. Just try it out. If you notice that it doesn't follow the prompt, try 1.25 first and then higher and higher until you're satisfied.
I've often had the problem before that without this node it doesn't follow it properly. With this node it really works perfectly as it should.

6

I tried different settings, and a value of -0.10 makes the movements more realistic for me.

5
Try the other values too, it works almost everything and affects the quality or prompt follow.

7

I haven't noticed any change in these controls so far; everything else works great.

8
There are other nodes available in the custom node, but I haven't tried them yet.

I've only tested it with the reference model so far, but I think it will work great with the other model as well. Feel free to write to me and ask if it works for you and if you could improve your quality or prompt follow, I would be very interested.

hanswurstwerner changed discussion title from I found great settings :) to I found great settings :) for quality and prompt follow
This comment has been hidden (marked as Resolved)

Try the ClownsharKsampler and change the Nois_Type_Init to "Studentt" 6 Steps ddim/beta, shift 12/10 it's incredible how good the quality is even at low resolutions. The other options from Sharksampler also bring good quality, just experiment. I use Ref 4 Step lora 0.1. I've tried a lot of things before but never really found good quality, but this is the solution for me.
Link for ClownsharKsampler https://github.com/ClownsharkBatwing/RES4LYF.git

With ETA, you can also increase or decrease the value; this also has a greater effect on quality and prompt follow. For example, I noticed a big difference when I switched from 0.50 to 0.25 or 0.75. You can generally test a lot and have significantly more opportunities to improve quality and prompt follow.

1

Try the different noise types yourself, they definitely make a huge difference

2

Try a higher or lower value for s_noise_init e.g. 0.80, that can also bring quality again or better promptly follow.

3

Then I tried something else that worked wonderfully and promptly reinforced it significantly and in some cases improved the quality again. There is a node for Flux2klein9b called https://github.com/capitan01R/ComfyUI-Flux2Klein-Enhancer if you increase the "active scale" above, it promptly follows it much better, test it out yourself.

4

I tried 3.00 strength once and the prompt follow is incredible, just try 1.25-3.00 strength.
If the value is too high, the quality may suffer. But for me it varies from video to video. Just try it out. If you notice that it doesn't follow the prompt, try 1.25 first and then higher and higher until you're satisfied.
I've often had the problem before that without this node it doesn't follow it properly. With this node it really works perfectly as it should.

6

I tried different settings, and a value of -0.10 makes the movements more realistic for me.

5
Try the other values too, it works almost everything and affects the quality or prompt follow.

7

I haven't noticed any change in these controls so far; everything else works great.

8
There are other nodes available in the custom node, but I haven't tried them yet.

I've only tested it with the reference model so far, but I think it will work great with the other model as well. Feel free to write to me and ask if it works for you and if you could improve your quality or prompt follow, I would be very interested.

would you kindly share the best workflow you got or multiple ones if possibe? thank you.

Sign up or log in to comment