Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,43 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: flux-2-dev-non-commercial-license
|
| 4 |
+
license_link: https://huggingface.co/black-forest-labs/FLUX.2-dev/blob/main/LICENSE.md
|
| 5 |
+
base_model: black-forest-labs/FLUX.2-dev
|
| 6 |
+
tags:
|
| 7 |
+
- flux
|
| 8 |
+
- comfyui
|
| 9 |
+
- int8
|
| 10 |
+
- quantized
|
| 11 |
+
- text-to-image
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# FLUX.2-dev — INT8 tensorwise (+ConvRot), stock-ComfyUI native
|
| 15 |
+
|
| 16 |
+
Offline INT8 quantization of the `black-forest-labs/FLUX.2-dev` transformer, produced
|
| 17 |
+
with [Comfy-Org/comfy-quants](https://github.com/Comfy-Org/comfy-quants)
|
| 18 |
+
(`export-model-int8-tensorwise`). Loads **natively in stock ComfyUI >= v0.27.0**
|
| 19 |
+
(`QUANT_ALGOS["int8_tensorwise"]`, SM >= 7.5 / Turing+) — no custom node required.
|
| 20 |
+
|
| 21 |
+
Transformer-only (for `models/diffusion_models/`, load via `UNETLoader`); pair with
|
| 22 |
+
the usual FLUX.2 text encoder (Mistral) and VAE.
|
| 23 |
+
|
| 24 |
+
## Quantization contract
|
| 25 |
+
|
| 26 |
+
- 160 quantized Linears (8 double blocks × img/txt attn qkv/proj + gated MLP, 48
|
| 27 |
+
single blocks × fused linear1/linear2); global modulation, io projections and
|
| 28 |
+
final layer kept bf16; all 160 ConvRot-rotated (regular Hadamard, group 256).
|
| 29 |
+
- Per layer: `int8` weight + `float32 [out,1]` scale + `comfy_quant` marker
|
| 30 |
+
`{"format": "int8_tensorwise", "convrot": true, "convrot_groupsize": 256}`
|
| 31 |
+
(byte-exact to stock ComfyUI's save path).
|
| 32 |
+
- Quant math bit-faithful to comfy-kitchen >= 0.2.15.
|
| 33 |
+
|
| 34 |
+
## Measured (RTX PRO 6000 Blackwell, 1024², 20 steps, torch 2.10.0+cu130)
|
| 35 |
+
|
| 36 |
+
Image PSNR vs bf16: **32.6 dB** — markedly better than FP8 E4M3 (20.1 dB) or NVFP4
|
| 37 |
+
(17.6 dB) on this trajectory-sensitive 32B distilled model; INT8+ConvRot's higher
|
| 38 |
+
weight fidelity (SQNR ≈ 41 dB vs 31.5 dB for fp8) translates directly into image
|
| 39 |
+
quality here. Disk 33.1 GB (vs 64 GB bf16).
|
| 40 |
+
|
| 41 |
+
## License
|
| 42 |
+
|
| 43 |
+
Inherits the FLUX.2-dev Non-Commercial License from the base model.
|