Hugging Face's logo

erkam
/
sd-clevr-sg2layout-objects_cap-e2e

Text-to-Image
Diffusers
stable-diffusion
stable-diffusion-diffusers
lora
Model card Files
xet
 Community
How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("erkam/sd-clevr-sg2layout-objects_cap-e2e")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

LoRA text2image fine-tuning - erkam/sd-clevr-sg2layout-objects_cap-e2e

These are LoRA adaption weights for stabilityai/stable-diffusion-2. The weights were fine-tuned on the erkam/clevr-full-v4 dataset. You can find some example images in the following.

Downloads last month
-
Inference Providers NEW
Text-to-Image
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for erkam/sd-clevr-sg2layout-objects_cap-e2e

Base model

stabilityai/stable-diffusion-2
Adapter
(105)
this model