Hugging Face's logo

SAMControlNet
/
sd-controlnet-sam-seg

Image-to-Image
Diffusers
Safetensors
stable-diffusion
stable-diffusion-diffusers
controlnet
jax-diffusers-event
Model card Files
xet
 Community
1
How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline

controlnet = ControlNetModel.from_pretrained("SAMControlNet/sd-controlnet-sam-seg")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
	"runwayml/stable-diffusion-v1-5", controlnet=controlnet
)

controlnet- SAMControlNet/sd-controlnet-sam-seg

These are controlnet weights trained on runwayml/stable-diffusion-v1-5 with new type of conditioning. You can find some example images in the following.

prompt: a dolphin jumping out of the water images_0) prompt: a antelope standing in a field with birds images_1)

Downloads last month
109
Inference Providers NEW
Image-to-Image
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SAMControlNet/sd-controlnet-sam-seg

Base model

runwayml/stable-diffusion-v1-5
Adapter
(2725)
this model

Spaces using SAMControlNet/sd-controlnet-sam-seg 3