Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,68 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: minimax-h3-community-license-agreement
|
| 4 |
+
license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
|
| 5 |
+
base_model: MiniMaxAI/MiniMax-H3
|
| 6 |
+
tags:
|
| 7 |
+
- comfyui
|
| 8 |
+
- nvfp4
|
| 9 |
+
- video
|
| 10 |
+
- quantized
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# MiniMax H3 ref2va — NVFP4 (ComfyUI-native)
|
| 14 |
+
|
| 15 |
+
NVFP4 quantization of the [MiniMax H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
|
| 16 |
+
**reference-to-video** DiT (`ref2va`), in ComfyUI's native quant layout — loads with
|
| 17 |
+
the stock `UNETLoader` on any Blackwell GPU (sm_120: RTX 5090 / RTX PRO 6000, and
|
| 18 |
+
newer). Derived from
|
| 19 |
+
[Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3)'s
|
| 20 |
+
`minimax_h3_ref2va_bf16.safetensors`.
|
| 21 |
+
|
| 22 |
+
## Files
|
| 23 |
+
|
| 24 |
+
| File | Size | GEMM path |
|
| 25 |
+
|---|---|---|
|
| 26 |
+
| `diffusion_models/minimax_h3_ref2va_nvfp4.safetensors` | 38.6 GB | native FP4 tensor-core |
|
| 27 |
+
| `diffusion_models/minimax_h3_ref2va_nvfp4_fpmm.safetensors` | 38.6 GB | dequant → bf16 (quality-safe, same path the official NVFP4 text encoder uses) |
|
| 28 |
+
|
| 29 |
+
Quantization policy mirrors the official `int8_convrot` release: the 50 main
|
| 30 |
+
blocks' `attn.qkv_proj`, `attn.out_proj`, `mlp.fc1`, `mlp.fc2` (200 layers) go
|
| 31 |
+
to NVFP4 (E2M1, per-16 FP8-E4M3 block scales + global FP32 scale); everything
|
| 32 |
+
quality-critical — adaln/modulation, norms, patch/condition projections, token
|
| 33 |
+
refiner, final layers — stays bf16. Weight-only PTQ (no activation calibration),
|
| 34 |
+
produced with the included `convert_nvfp4.py` via ComfyUI's `comfy_kitchen`
|
| 35 |
+
`quantize_nvfp4` kernels.
|
| 36 |
+
|
| 37 |
+
## Usage (ComfyUI)
|
| 38 |
+
|
| 39 |
+
Drop into `ComfyUI/models/diffusion_models/` and select in `UNETLoader`
|
| 40 |
+
(weight_dtype `default`) inside the official
|
| 41 |
+
[MiniMax H3 r2v template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json).
|
| 42 |
+
Pair with the official `qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors` text
|
| 43 |
+
encoder and both H3 VAEs from
|
| 44 |
+
[Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3).
|
| 45 |
+
|
| 46 |
+
## Benchmarks (RTX PRO 6000 Blackwell Max-Q, 96 GB, SageAttention, 1344×768×124f, 20 steps)
|
| 47 |
+
|
| 48 |
+
| DiT variant | Size | s/step | Notes |
|
| 49 |
+
|---|---|---|---|
|
| 50 |
+
| bf16 (reference) | 66.3 GB | 14.65 | baseline quality |
|
| 51 |
+
| pruned int8_convrot (official) | 21.0 GB | 22.7 | pruned arch, W8A16 dequant path |
|
| 52 |
+
| **nvfp4 (this repo)** | 38.6 GB | 19.8* | full (unpruned) model |
|
| 53 |
+
| **nvfp4_fpmm (this repo)** | 38.6 GB | ~bf16* | full (unpruned) model |
|
| 54 |
+
|
| 55 |
+
\* measured on torch 2.8+cu128, where comfy_kitchen runs **fallback** (emulated)
|
| 56 |
+
FP4 ops — a cu130 torch build unlocks the optimized CUDA kernels and these
|
| 57 |
+
numbers will be updated. Same-seed visual quality vs bf16: no quantization
|
| 58 |
+
artifacts observed (trajectory divergence only, PSNR vs bf16 ≈ within the
|
| 59 |
+
pipeline's chaotic-divergence regime; see sample).
|
| 60 |
+
|
| 61 |
+
A same-seed sample generated with this checkpoint is in
|
| 62 |
+
[`assets/sample_r2v_5s.mp4`](assets/sample_r2v_5s.mp4).
|
| 63 |
+
|
| 64 |
+
## License
|
| 65 |
+
|
| 66 |
+
MiniMax H3 Community License. This is a derivative work of MiniMaxAI/MiniMax-H3;
|
| 67 |
+
see the [license](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE)
|
| 68 |
+
for terms.
|