| | --- |
| | license: apache-2.0 |
| | --- |
| | |
| | ## Comparison |
| |  |
| |
|
| |
|
| | ## === Metrics === |
| | ``` |
| | SD15 VAE | MSE=2.732e-03 PSNR=28.10 LPIPS=0.147 Edge=0.206 KL=19.821 | Z[min/mean/max/std]=[-17.375, 0.072, 16.203, 0.900] | Skew[min/mean/max]=[-0.543, -0.126, 0.070] | Kurt[min/mean/max]=[-0.151, 1.228, 4.574] |
| | SDXL VAE fp16 fix | MSE=2.018e-03 PSNR=29.67 LPIPS=0.124 Edge=0.188 KL=32.222 | Z[min/mean/max/std]=[-4.066, -0.014, 4.301, 0.861] | Skew[min/mean/max]=[-0.017, 0.105, 0.165] | Kurt[min/mean/max]=[-0.380, -0.228, -0.107] |
| | AiArtLab/sdxl_vae | MSE=1.736e-03 PSNR=30.29 LPIPS=0.116 Edge=0.181 KL=32.222 | Z[min/mean/max/std]=[-4.066, -0.014, 4.301, 0.861] | Skew[min/mean/max]=[-0.017, 0.105, 0.165] | Kurt[min/mean/max]=[-0.380, -0.228, -0.107] |
| | LTX-Video VAE | MSE=1.202e-03 PSNR=31.84 LPIPS=0.141 Edge=0.168 KL=6.656 | Z[min/mean/max/std]=[-5.043, 0.011, 4.969, 0.272] | Skew[min/mean/max]=[-0.542, -0.018, 0.411] | Kurt[min/mean/max]=[-0.576, 0.741, 1.843] |
| | Wan2.2-TI2V-5B | MSE=7.782e-04 PSNR=34.25 LPIPS=0.052 Edge=0.121 KL=9.472 | Z[min/mean/max/std]=[-4.789, -0.012, 4.266, 0.375] | Skew[min/mean/max]=[-0.397, 0.022, 0.653] | Kurt[min/mean/max]=[-0.482, 0.006, 0.538] |
| | AiArtLab/wan16x_vae | MSE=7.275e-04 PSNR=34.51 LPIPS=0.051 Edge=0.118 KL=9.472 | Z[min/mean/max/std]=[-4.789, -0.012, 4.266, 0.375] | Skew[min/mean/max]=[-0.397, 0.022, 0.653] | Kurt[min/mean/max]=[-0.482, 0.006, 0.538] |
| | Wan2.2-T2V-A14B | MSE=7.073e-04 PSNR=34.59 LPIPS=0.048 Edge=0.115 KL=7.781 | Z[min/mean/max/std]=[-15.336, -0.159, 17.703, 2.563] | Skew[min/mean/max]=[-0.343, 0.006, 0.367] | Kurt[min/mean/max]=[-0.538, -0.071, 0.594] |
| | QwenImage | MSE=6.549e-04 PSNR=35.21 LPIPS=0.047 Edge=0.110 KL=7.776 | Z[min/mean/max/std]=[-15.297, -0.158, 17.688, 2.561] | Skew[min/mean/max]=[-0.346, 0.005, 0.368] | Kurt[min/mean/max]=[-0.538, -0.072, 0.597] |
| | AuraDiffusion/16ch-vae | MSE=5.361e-04 PSNR=35.80 LPIPS=0.041 Edge=0.100 KL=4.421 | Z[min/mean/max/std]=[-1.373, -0.005, 1.621, 0.165] | Skew[min/mean/max]=[-0.331, 0.040, 0.413] | Kurt[min/mean/max]=[-0.170, 0.303, 0.670] |
| | FLUX.1-schnell VAE | MSE=4.594e-04 PSNR=35.87 LPIPS=0.035 Edge=0.088 KL=13.016 | Z[min/mean/max/std]=[-5.824, -0.076, 6.246, 0.945] | Skew[min/mean/max]=[-0.268, 0.048, 0.483] | Kurt[min/mean/max]=[-0.498, 0.037, 0.568] |
| | AiArtLab/simplevae | MSE=4.818e-04 PSNR=36.20 LPIPS=0.035 Edge=0.095 KL=4.032 | Z[min/mean/max/std]=[-7.762, -0.061, 9.914, 0.965] | Skew[min/mean/max]=[-0.320, 0.044, 0.411] | Kurt[min/mean/max]=[-0.045, 0.346, 0.696] |
| | ``` |
| | ## === Percent === |
| | ``` |
| | | Model | PSNR | LPIPS | Edge | |
| | |----------------------------|-----------|-----------|-----------| |
| | | SD15 VAE | 100% | 100% | 100% | |
| | | SDXL VAE fp16 fix | 105.6% | 118.3% | 109.7% | |
| | | AiArtLab/sdxl_vae | 107.8% | 126.8% | 113.8% | |
| | | LTX-Video VAE | 113.3% | 103.8% | 122.5% | |
| | | Wan2.2-TI2V-5B | 121.9% | 280.8% | 170.8% | |
| | | AiArtLab/wan16x_vae | 122.8% | 287.3% | 174.2% | |
| | | Wan2.2-T2V-A14B | 123.1% | 303.2% | 179.4% | |
| | | QwenImage | 125.3% | 308.8% | 188.0% | |
| | | AuraDiffusion/16ch-vae | 127.4% | 355.5% | 206.6% | |
| | | FLUX.1-schnell VAE | 127.6% | 424.4% | 234.8% | |
| | | AiArtLab/simplevae | 128.8% | 415.2% | 217.7% | |
| | ``` |
| |
|
| | ## Compare |
| |
|
| | https://imgsli.com/NDE1MzE0/5/2 |
| |
|
| | ### Diffusers |
| | ``` |
| | from diffusers import AutoencoderKL |
| | vae = AutoencoderKL.from_pretrained("AiArtLab/simplevae",subfolder="vae").cuda().half() |
| | |
| | ``` |
| |
|
| | ## VAE Training Process |
| |
|
| | - Inited from AuraDiffusion/16ch-vae (not compatible), added mid block/retrained |
| | - Dataset: 100,000 PNG images |
| | - Training Time: ~ 2 weeks |
| | - Hardware: Single RTX 5090 |
| | - Resolution: 512px |
| | - Precision: FP32 |
| | - Effective Batch Size: 16 |
| | - Optimizer: AdamW (8-bit) |
| | - Balanced losses (lpips, MSE, MAE, Edge, KL) |
| | ## Source |
| |
|
| | https://huggingface.co/AiArtLab/simplevae/blob/main/train_vae.py |
| | |
| | ## Acknowledgments |
| | - **[Stan](https://t.me/Stangle)** — Key investor. Thank you for believing in us when others called it madness. |
| | - **Captainsaturnus** |
| | - **Love. Death. Transformers.** |
| | - **TOPAPEC** |
| | |
| | ## Donations |
| | |
| | Please contact with us if you may provide some GPU's or money on training |
| | |
| | DOGE: DEw2DR8C7BnF8GgcrfTzUjSnGkuMeJhg83 |
| | |
| | BTC: 3JHv9Hb8kEW8zMAccdgCdZGfrHeMhH1rpN |
| | |
| | ## Contacts |
| | |
| | [recoilme](https://t.me/recoilme) |
| | |
| | ## Test training |
| | |
| | [test train](trainvideo.mp4) |
| | |
