Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

FrancisRing
/
FlashPortrait

Image-to-Video
Diffusers
ONNX
video-generation
video diffusion transformer
audio-driven avatar animation
Model card Files Files and versions
xet
Community
1

Instructions to use FrancisRing/FlashPortrait with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Diffusers

    How to use FrancisRing/FlashPortrait with Diffusers:

    pip install -U diffusers transformers accelerate
    import torch
    from diffusers import DiffusionPipeline
    from diffusers.utils import load_image, export_to_video
    
    # switch to "mps" for apple devices
    pipe = DiffusionPipeline.from_pretrained("FrancisRing/FlashPortrait", dtype=torch.bfloat16, device_map="cuda")
    pipe.to("cuda")
    
    prompt = "A man with short gray hair plays a red electric guitar."
    image = load_image(
        "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png"
    )
    
    output = pipe(image=image, prompt=prompt).frames[0]
    export_to_video(output, "output.mp4")
  • Notebooks
  • Google Colab
  • Kaggle
FlashPortrait
58.3 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 12 commits
FrancisRing's picture
FrancisRing
Update README.md
2c3aac1 verified 6 months ago
  • assets
    Upload framework.jpg 6 months ago
  • .gitattributes
    1.58 kB
    Upload framework.jpg 6 months ago
  • README.md
    19.5 kB
    Update README.md 6 months ago
  • face_det.onnx
    371 kB
    xet
    Upload 3 files 6 months ago
  • face_landmark.onnx
    2.87 MB
    xet
    Upload 3 files 6 months ago
  • fast_lora_rank64.safetensors
    739 MB
    xet
    Upload 2 files 6 months ago
  • fast_vae.pth
    22.7 MB
    xet
    Upload 2 files 6 months ago
  • pd_fpg.pth
    39.5 MB
    xet
    Upload 3 files 6 months ago
  • portrait_encoder.pt
    329 MB
    xet
    Upload portrait_encoder.pt 6 months ago
  • transformer.pt
    57.1 GB
    xet
    Upload transformer.pt with huggingface_hub 6 months ago