Diffusers How to use OpenSound/EzAudio with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline
controlnet = ControlNetModel.from_pretrained("OpenSound/EzAudio")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
"fill-in-base-model", controlnet=controlnet
)