Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -45,18 +45,25 @@ encoder and both H3 VAEs from
|
|
| 45 |
|
| 46 |
## Benchmarks (RTX PRO 6000 Blackwell Max-Q, 96 GB, SageAttention, 1344×768×124f, 20 steps)
|
| 47 |
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
| pruned int8_convrot (official) | 21.0 GB | 22.7 | pruned arch, W8A16 dequant path |
|
| 52 |
-
| **nvfp4 (this repo)** | 38.6 GB | 19.8* | full (unpruned) model |
|
| 53 |
-
| **nvfp4_fpmm (this repo)** | 38.6 GB | ~bf16* | full (unpruned) model |
|
| 54 |
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
|
| 61 |
A same-seed sample generated with this checkpoint is in
|
| 62 |
[`assets/sample_r2v_5s.mp4`](assets/sample_r2v_5s.mp4).
|
|
|
|
| 45 |
|
| 46 |
## Benchmarks (RTX PRO 6000 Blackwell Max-Q, 96 GB, SageAttention, 1344×768×124f, 20 steps)
|
| 47 |
|
| 48 |
+
All on the same card, same seed, SageAttention. **torch cu130 build strongly
|
| 49 |
+
recommended** — it enables comfy_kitchen's optimized CUDA kernels (on cu128
|
| 50 |
+
the FP4 path runs emulated and is ~2.3× slower).
|
|
|
|
|
|
|
|
|
|
| 51 |
|
| 52 |
+
| DiT variant | Size | s/step (cu130) | s/step (cu128) | Notes |
|
| 53 |
+
|---|---|---|---|---|
|
| 54 |
+
| **nvfp4 (this repo)** | 38.6 GB | **8.47** | 19.8 (emulated) | full model, **1.5× faster than bf16** |
|
| 55 |
+
| convrot W4A4 (measured, not shipped) | 37.4 GB | 9.69 | — | visible text-rendering artifacts |
|
| 56 |
+
| bf16 (reference) | 66.3 GB | 12.76 | 14.65 | baseline quality |
|
| 57 |
+
| **nvfp4_fpmm (this repo)** | 38.6 GB | — | 14.99 | ties bf16 on cu128, 42 % less VRAM |
|
| 58 |
+
| pruned int8_convrot (official) | 21.0 GB | — | 22.7 | pruned arch, W8A16 dequant path |
|
| 59 |
+
|
| 60 |
+
Stacking ComfyUI's `EasyCache` (threshold 0.1) on top cuts wall time a further
|
| 61 |
+
~1.4× with deviation within the pipeline's run-to-run variance.
|
| 62 |
+
|
| 63 |
+
Same-seed visual quality of `nvfp4` vs bf16: no quantization artifacts observed
|
| 64 |
+
(trajectory divergence only — diffusion is chaotic under any weight
|
| 65 |
+
perturbation; see sample). The W4A4 experiment degraded fine text rendering,
|
| 66 |
+
which is why it is not shipped.
|
| 67 |
|
| 68 |
A same-seed sample generated with this checkpoint is in
|
| 69 |
[`assets/sample_r2v_5s.mp4`](assets/sample_r2v_5s.mp4).
|