Image-to-Video
Diffusers
ONNX
video-generation
video diffusion transformer
audio-driven avatar animation
Instructions to use FrancisRing/FlashPortrait with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use FrancisRing/FlashPortrait with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("FrancisRing/FlashPortrait", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Huggingface demo
#1
by jujutechnology - opened
Will you be putting a demo version up on HF? At least one that we can duplicate and use.
Hi, we are working on it and will put an online Gradio Demo on the HF as soon as possible. Please stay tuned!