fxtdstudios commited on
Commit
b1e1055
·
verified ·
1 Parent(s): d78cccd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +70 -0
README.md CHANGED
@@ -1,3 +1,73 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ library_name: comfyui
4
+ pipeline_tag: image-to-image
5
+ tags:
6
+ - hdr
7
+ - diffusion
8
+ - comfyui
9
+ - vae-decoder
10
+ - openexr
11
+ - radiance
12
+ - rudra
13
  ---
14
+
15
+ # RUDRA — HDR Decoders for Diffusion Models
16
+
17
+ **Radiometric Dynamic-Range Conditioning for HDR-Aware Diffusion Models**
18
+ FXTD Studios / Radiance Research
19
+
20
+ Distilled decoders that turn diffusion **latents into scene-linear HDR / OpenEXR** instead
21
+ of tone-mapped SDR. They replace the standard VAE decode inside the *Radiance HDR VAE
22
+ Decode* ComfyUI node, preserving highlights, exposure, and wide-gamut color.
23
+
24
+ ➡️ **Code, training, and docs:** https://github.com/fxtdstudios/RUDRA
25
+
26
+ ## Files
27
+
28
+ Each file is a trained `RadianceTurboDecoder` / `RadianceFullDecoder` for one backbone:
29
+
30
+ ```
31
+ rudra_{turbo|full}_decoder_{backbone}_ema.safetensors
32
+ ```
33
+
34
+ | Backbone | Recommended file | Quality (PSNR_log) |
35
+ |---|---|---|
36
+ | Flux.1 | `rudra_full_decoder_flux_ema.safetensors` | 29.77 |
37
+ | Wan | `rudra_full_decoder_wan_ema.safetensors` | 32.45 |
38
+ | LTX | `rudra_full_decoder_ltx-video_ema.safetensors` | 25.47 |
39
+ | SDXL | `rudra_turbo_decoder_sdxl_ema.safetensors` | 33.86 |
40
+ | Qwen-Image | `rudra_turbo_decoder_qwen_ema.safetensors` | 26.67 |
41
+ | Flux.2 Klein | `rudra_turbo_decoder_flux2-klein_ema.safetensors` | 28.57 |
42
+ | Z-Image | use the Flux decoder (shares the FLUX.1 VAE) | — |
43
+
44
+ `turbo` (~0.5 M params) is fast and strong on simple latents (SDXL); `full` (~5.6 M) wins
45
+ on Flux/Wan/LTX. Both are provided where trained.
46
+
47
+ ## Usage (ComfyUI)
48
+
49
+ 1. Download into `ComfyUI/models/radiance/`:
50
+ ```bash
51
+ huggingface-cli download fxtdstudios/RUDRA --include "rudra_*.safetensors" \
52
+ --local-dir "ComfyUI/models/radiance"
53
+ ```
54
+ 2. In the **Radiance HDR VAE Decode** node: set `rudra_decoder = Enabled`, pick
55
+ `decoder_size` (`rudra_turbo` or `rudra_full`) per the table above, and set
56
+ `target_space` to your output color space (Linear / ACEScg / Rec.2020 / LogC4…).
57
+
58
+ ## Notes
59
+
60
+ - **Backbone-specific:** a decoder is tied to its VAE latent space — use the matching file
61
+ for the model feeding the node (Flux decoder for a Flux workflow, etc.).
62
+ - **Flux.2 Klein** uses a 128-channel / 16× VAE, so its decoder has an extra upsample stage
63
+ (requires the updated `fast_vae.py` from the GitHub repo).
64
+ - Quality is reported as held-out **log-space PSNR**; perceptual HDR evaluation uses
65
+ **ColorVideoVDP** (JOD). SDXL/Qwen/Klein were trained on a smaller pair set and can be
66
+ improved with more data.
67
+
68
+ ## Citation
69
+
70
+ > RUDRA: Radiometric Dynamic-Range Conditioning for HDR-Aware Diffusion Models.
71
+ > FXTD Studios / Radiance Research.
72
+
73
+ License: change the `license:` field above to match your release terms.