comfyui
nvfp4
video
quantized
adhikjoshi commited on
Commit
a8b97d3
·
verified ·
1 Parent(s): 5fbb415

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -11
README.md CHANGED
@@ -45,18 +45,25 @@ encoder and both H3 VAEs from
45
 
46
  ## Benchmarks (RTX PRO 6000 Blackwell Max-Q, 96 GB, SageAttention, 1344×768×124f, 20 steps)
47
 
48
- | DiT variant | Size | s/step | Notes |
49
- |---|---|---|---|
50
- | bf16 (reference) | 66.3 GB | 14.65 | baseline quality |
51
- | pruned int8_convrot (official) | 21.0 GB | 22.7 | pruned arch, W8A16 dequant path |
52
- | **nvfp4 (this repo)** | 38.6 GB | 19.8* | full (unpruned) model |
53
- | **nvfp4_fpmm (this repo)** | 38.6 GB | ~bf16* | full (unpruned) model |
54
 
55
- \* measured on torch 2.8+cu128, where comfy_kitchen runs **fallback** (emulated)
56
- FP4 ops — a cu130 torch build unlocks the optimized CUDA kernels and these
57
- numbers will be updated. Same-seed visual quality vs bf16: no quantization
58
- artifacts observed (trajectory divergence only, PSNR vs bf16 within the
59
- pipeline's chaotic-divergence regime; see sample).
 
 
 
 
 
 
 
 
 
 
60
 
61
  A same-seed sample generated with this checkpoint is in
62
  [`assets/sample_r2v_5s.mp4`](assets/sample_r2v_5s.mp4).
 
45
 
46
  ## Benchmarks (RTX PRO 6000 Blackwell Max-Q, 96 GB, SageAttention, 1344×768×124f, 20 steps)
47
 
48
+ All on the same card, same seed, SageAttention. **torch cu130 build strongly
49
+ recommended** — it enables comfy_kitchen's optimized CUDA kernels (on cu128
50
+ the FP4 path runs emulated and is ~2. slower).
 
 
 
51
 
52
+ | DiT variant | Size | s/step (cu130) | s/step (cu128) | Notes |
53
+ |---|---|---|---|---|
54
+ | **nvfp4 (this repo)** | 38.6 GB | **8.47** | 19.8 (emulated) | full model, **1.5× faster than bf16** |
55
+ | convrot W4A4 (measured, not shipped) | 37.4 GB | 9.69 | — | visible text-rendering artifacts |
56
+ | bf16 (reference) | 66.3 GB | 12.76 | 14.65 | baseline quality |
57
+ | **nvfp4_fpmm (this repo)** | 38.6 GB | — | 14.99 | ties bf16 on cu128, 42 % less VRAM |
58
+ | pruned int8_convrot (official) | 21.0 GB | — | 22.7 | pruned arch, W8A16 dequant path |
59
+
60
+ Stacking ComfyUI's `EasyCache` (threshold 0.1) on top cuts wall time a further
61
+ ~1.4× with deviation within the pipeline's run-to-run variance.
62
+
63
+ Same-seed visual quality of `nvfp4` vs bf16: no quantization artifacts observed
64
+ (trajectory divergence only — diffusion is chaotic under any weight
65
+ perturbation; see sample). The W4A4 experiment degraded fine text rendering,
66
+ which is why it is not shipped.
67
 
68
  A same-seed sample generated with this checkpoint is in
69
  [`assets/sample_r2v_5s.mp4`](assets/sample_r2v_5s.mp4).