comfyui
nvfp4
video
quantized
adhikjoshi commited on
Commit
39083bd
·
verified ·
1 Parent(s): 72ea840

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +68 -0
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: minimax-h3-community-license-agreement
4
+ license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
5
+ base_model: MiniMaxAI/MiniMax-H3
6
+ tags:
7
+ - comfyui
8
+ - nvfp4
9
+ - video
10
+ - quantized
11
+ ---
12
+
13
+ # MiniMax H3 ref2va — NVFP4 (ComfyUI-native)
14
+
15
+ NVFP4 quantization of the [MiniMax H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
16
+ **reference-to-video** DiT (`ref2va`), in ComfyUI's native quant layout — loads with
17
+ the stock `UNETLoader` on any Blackwell GPU (sm_120: RTX 5090 / RTX PRO 6000, and
18
+ newer). Derived from
19
+ [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3)'s
20
+ `minimax_h3_ref2va_bf16.safetensors`.
21
+
22
+ ## Files
23
+
24
+ | File | Size | GEMM path |
25
+ |---|---|---|
26
+ | `diffusion_models/minimax_h3_ref2va_nvfp4.safetensors` | 38.6 GB | native FP4 tensor-core |
27
+ | `diffusion_models/minimax_h3_ref2va_nvfp4_fpmm.safetensors` | 38.6 GB | dequant → bf16 (quality-safe, same path the official NVFP4 text encoder uses) |
28
+
29
+ Quantization policy mirrors the official `int8_convrot` release: the 50 main
30
+ blocks' `attn.qkv_proj`, `attn.out_proj`, `mlp.fc1`, `mlp.fc2` (200 layers) go
31
+ to NVFP4 (E2M1, per-16 FP8-E4M3 block scales + global FP32 scale); everything
32
+ quality-critical — adaln/modulation, norms, patch/condition projections, token
33
+ refiner, final layers — stays bf16. Weight-only PTQ (no activation calibration),
34
+ produced with the included `convert_nvfp4.py` via ComfyUI's `comfy_kitchen`
35
+ `quantize_nvfp4` kernels.
36
+
37
+ ## Usage (ComfyUI)
38
+
39
+ Drop into `ComfyUI/models/diffusion_models/` and select in `UNETLoader`
40
+ (weight_dtype `default`) inside the official
41
+ [MiniMax H3 r2v template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json).
42
+ Pair with the official `qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors` text
43
+ encoder and both H3 VAEs from
44
+ [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3).
45
+
46
+ ## Benchmarks (RTX PRO 6000 Blackwell Max-Q, 96 GB, SageAttention, 1344×768×124f, 20 steps)
47
+
48
+ | DiT variant | Size | s/step | Notes |
49
+ |---|---|---|---|
50
+ | bf16 (reference) | 66.3 GB | 14.65 | baseline quality |
51
+ | pruned int8_convrot (official) | 21.0 GB | 22.7 | pruned arch, W8A16 dequant path |
52
+ | **nvfp4 (this repo)** | 38.6 GB | 19.8* | full (unpruned) model |
53
+ | **nvfp4_fpmm (this repo)** | 38.6 GB | ~bf16* | full (unpruned) model |
54
+
55
+ \* measured on torch 2.8+cu128, where comfy_kitchen runs **fallback** (emulated)
56
+ FP4 ops — a cu130 torch build unlocks the optimized CUDA kernels and these
57
+ numbers will be updated. Same-seed visual quality vs bf16: no quantization
58
+ artifacts observed (trajectory divergence only, PSNR vs bf16 ≈ within the
59
+ pipeline's chaotic-divergence regime; see sample).
60
+
61
+ A same-seed sample generated with this checkpoint is in
62
+ [`assets/sample_r2v_5s.mp4`](assets/sample_r2v_5s.mp4).
63
+
64
+ ## License
65
+
66
+ MiniMax H3 Community License. This is a derivative work of MiniMaxAI/MiniMax-H3;
67
+ see the [license](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE)
68
+ for terms.