LAXMAYDAY commited on
Commit
8f8aee9
·
verified ·
1 Parent(s): d8c0b4e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +43 -0
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: flux-2-dev-non-commercial-license
4
+ license_link: https://huggingface.co/black-forest-labs/FLUX.2-dev/blob/main/LICENSE.md
5
+ base_model: black-forest-labs/FLUX.2-dev
6
+ tags:
7
+ - flux
8
+ - comfyui
9
+ - int8
10
+ - quantized
11
+ - text-to-image
12
+ ---
13
+
14
+ # FLUX.2-dev — INT8 tensorwise (+ConvRot), stock-ComfyUI native
15
+
16
+ Offline INT8 quantization of the `black-forest-labs/FLUX.2-dev` transformer, produced
17
+ with [Comfy-Org/comfy-quants](https://github.com/Comfy-Org/comfy-quants)
18
+ (`export-model-int8-tensorwise`). Loads **natively in stock ComfyUI >= v0.27.0**
19
+ (`QUANT_ALGOS["int8_tensorwise"]`, SM >= 7.5 / Turing+) — no custom node required.
20
+
21
+ Transformer-only (for `models/diffusion_models/`, load via `UNETLoader`); pair with
22
+ the usual FLUX.2 text encoder (Mistral) and VAE.
23
+
24
+ ## Quantization contract
25
+
26
+ - 160 quantized Linears (8 double blocks × img/txt attn qkv/proj + gated MLP, 48
27
+ single blocks × fused linear1/linear2); global modulation, io projections and
28
+ final layer kept bf16; all 160 ConvRot-rotated (regular Hadamard, group 256).
29
+ - Per layer: `int8` weight + `float32 [out,1]` scale + `comfy_quant` marker
30
+ `{"format": "int8_tensorwise", "convrot": true, "convrot_groupsize": 256}`
31
+ (byte-exact to stock ComfyUI's save path).
32
+ - Quant math bit-faithful to comfy-kitchen >= 0.2.15.
33
+
34
+ ## Measured (RTX PRO 6000 Blackwell, 1024², 20 steps, torch 2.10.0+cu130)
35
+
36
+ Image PSNR vs bf16: **32.6 dB** — markedly better than FP8 E4M3 (20.1 dB) or NVFP4
37
+ (17.6 dB) on this trajectory-sensitive 32B distilled model; INT8+ConvRot's higher
38
+ weight fidelity (SQNR ≈ 41 dB vs 31.5 dB for fp8) translates directly into image
39
+ quality here. Disk 33.1 GB (vs 64 GB bf16).
40
+
41
+ ## License
42
+
43
+ Inherits the FLUX.2-dev Non-Commercial License from the base model.