Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -1,3 +1,73 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
library_name: comfyui
|
| 4 |
+
pipeline_tag: image-to-image
|
| 5 |
+
tags:
|
| 6 |
+
- hdr
|
| 7 |
+
- diffusion
|
| 8 |
+
- comfyui
|
| 9 |
+
- vae-decoder
|
| 10 |
+
- openexr
|
| 11 |
+
- radiance
|
| 12 |
+
- rudra
|
| 13 |
---
|
| 14 |
+
|
| 15 |
+
# RUDRA — HDR Decoders for Diffusion Models
|
| 16 |
+
|
| 17 |
+
**Radiometric Dynamic-Range Conditioning for HDR-Aware Diffusion Models**
|
| 18 |
+
FXTD Studios / Radiance Research
|
| 19 |
+
|
| 20 |
+
Distilled decoders that turn diffusion **latents into scene-linear HDR / OpenEXR** instead
|
| 21 |
+
of tone-mapped SDR. They replace the standard VAE decode inside the *Radiance HDR VAE
|
| 22 |
+
Decode* ComfyUI node, preserving highlights, exposure, and wide-gamut color.
|
| 23 |
+
|
| 24 |
+
➡️ **Code, training, and docs:** https://github.com/fxtdstudios/RUDRA
|
| 25 |
+
|
| 26 |
+
## Files
|
| 27 |
+
|
| 28 |
+
Each file is a trained `RadianceTurboDecoder` / `RadianceFullDecoder` for one backbone:
|
| 29 |
+
|
| 30 |
+
```
|
| 31 |
+
rudra_{turbo|full}_decoder_{backbone}_ema.safetensors
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
| Backbone | Recommended file | Quality (PSNR_log) |
|
| 35 |
+
|---|---|---|
|
| 36 |
+
| Flux.1 | `rudra_full_decoder_flux_ema.safetensors` | 29.77 |
|
| 37 |
+
| Wan | `rudra_full_decoder_wan_ema.safetensors` | 32.45 |
|
| 38 |
+
| LTX | `rudra_full_decoder_ltx-video_ema.safetensors` | 25.47 |
|
| 39 |
+
| SDXL | `rudra_turbo_decoder_sdxl_ema.safetensors` | 33.86 |
|
| 40 |
+
| Qwen-Image | `rudra_turbo_decoder_qwen_ema.safetensors` | 26.67 |
|
| 41 |
+
| Flux.2 Klein | `rudra_turbo_decoder_flux2-klein_ema.safetensors` | 28.57 |
|
| 42 |
+
| Z-Image | use the Flux decoder (shares the FLUX.1 VAE) | — |
|
| 43 |
+
|
| 44 |
+
`turbo` (~0.5 M params) is fast and strong on simple latents (SDXL); `full` (~5.6 M) wins
|
| 45 |
+
on Flux/Wan/LTX. Both are provided where trained.
|
| 46 |
+
|
| 47 |
+
## Usage (ComfyUI)
|
| 48 |
+
|
| 49 |
+
1. Download into `ComfyUI/models/radiance/`:
|
| 50 |
+
```bash
|
| 51 |
+
huggingface-cli download fxtdstudios/RUDRA --include "rudra_*.safetensors" \
|
| 52 |
+
--local-dir "ComfyUI/models/radiance"
|
| 53 |
+
```
|
| 54 |
+
2. In the **Radiance HDR VAE Decode** node: set `rudra_decoder = Enabled`, pick
|
| 55 |
+
`decoder_size` (`rudra_turbo` or `rudra_full`) per the table above, and set
|
| 56 |
+
`target_space` to your output color space (Linear / ACEScg / Rec.2020 / LogC4…).
|
| 57 |
+
|
| 58 |
+
## Notes
|
| 59 |
+
|
| 60 |
+
- **Backbone-specific:** a decoder is tied to its VAE latent space — use the matching file
|
| 61 |
+
for the model feeding the node (Flux decoder for a Flux workflow, etc.).
|
| 62 |
+
- **Flux.2 Klein** uses a 128-channel / 16× VAE, so its decoder has an extra upsample stage
|
| 63 |
+
(requires the updated `fast_vae.py` from the GitHub repo).
|
| 64 |
+
- Quality is reported as held-out **log-space PSNR**; perceptual HDR evaluation uses
|
| 65 |
+
**ColorVideoVDP** (JOD). SDXL/Qwen/Klein were trained on a smaller pair set and can be
|
| 66 |
+
improved with more data.
|
| 67 |
+
|
| 68 |
+
## Citation
|
| 69 |
+
|
| 70 |
+
> RUDRA: Radiometric Dynamic-Range Conditioning for HDR-Aware Diffusion Models.
|
| 71 |
+
> FXTD Studios / Radiance Research.
|
| 72 |
+
|
| 73 |
+
License: change the `license:` field above to match your release terms.
|