TenStrip commited on
Commit
853c0d9
·
verified ·
1 Parent(s): 11fd407

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -29
README.md CHANGED
@@ -1,8 +1,10 @@
1
- LTX2 i2v - Lora+Refinements.
2
 
3
- Many nodes to change/edit lora strengths and refine second pass results for high-effort generation. Use res_2s for best quality. Hard load audio from the first pass if it's good, it will usually be better than the second pass.
4
 
 
5
 
 
6
 
7
 
8
 
@@ -20,30 +22,3 @@ Many nodes to change/edit lora strengths and refine second pass results for high
20
 
21
 
22
 
23
-
24
-
25
-
26
-
27
-
28
-
29
-
30
-
31
-
32
- OLD LTX i2v workflow
33
-
34
- Differences from default:
35
-
36
- -Running distilled lora 1.0 on both passes with fp8 model - allows control over the distill strength if the effect is too strong. The fully distilled model was supposedly fixed, can be replaced with that. 1920x1080 241 frames possible on a 5090.
37
-
38
- -Using KJ's seperated models for easier offloading.
39
- -- https://huggingface.co/Kijai/LTXV2_comfy/tree/main
40
-
41
- -dpmpp sde sampler first pass, LCM second pass. SDE adds much better motion detail, LCM adds less for the weaker second pass, only upscaling it.
42
-
43
- -4 step sigmas on upscale pass, this is what the LTX2 dev post suggested. Not sure why default WF only has 3 steps.
44
-
45
- -First audio latent is discarded, audio output comes from 4 step pass. This is to correct for the SDE first pass, which doesn't produce good audio. Tradeoff. The second pass basically retracks the video, it can be innaccurate to prompt but that might just be the model.
46
-
47
- -Latent normalizer (LTX video github): seems to fix bad audio and burned video outputs
48
-
49
- -Image upscaler before preprocessing. Full size image sent to preprocessing. Use a 2x-4x upscaler the image is not 1280 on a side for fidelity, or use a sharpener to sharpen results. They will come through and also have a visual impact on the output.
 
1
+ LTX2 simple i2v.
2
 
3
+ Uses res2s and usually lower distill strength with fp8 model, 0.75-0.9 depending on application. Stack as many loras as you can even if barely related to the concept, lora stack drowns out the base model noise and makes the output more stable.
4
 
5
+ Use 33-38 preprocess node compression strength to increase motion. Get the best motion and audio from the first pass, cancel and reroll seed if bad. If preview is kind of good stop it and refine with prompt and lora weight mixes.
6
 
7
+ Second pass uses audio directly from first seed to track and half strength distilled upscale pass based on the full size input image for max quality. Only way to get very good clear visuals is with the half distill, but passing audio latent into the half distilled sampler ruins it, so this is the neat trick.
8
 
9
 
10
 
 
22
 
23
 
24