Commit ·
d39847b
1
Parent(s): 063d83d
Add Time Adapter model card and example videos
Browse files- .gitattributes +1 -0
- README.md +66 -0
- examples/ftta_forest_15.mp4 +3 -0
- examples/ftta_forest_30.mp4 +3 -0
- examples/ftta_forest_60.mp4 +3 -0
- examples/ftta_pose_15.mp4 +3 -0
- examples/ftta_pose_30.mp4 +3 -0
- examples/ftta_pose_60.mp4 +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
examples/*.mp4 filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,3 +1,69 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- ru
|
| 6 |
+
base_model:
|
| 7 |
+
- kandinskylab/Kandinsky-5.0-I2V-Lite-sft-5s
|
| 8 |
+
pipeline_tag: image-to-video
|
| 9 |
+
tags:
|
| 10 |
+
- image-to-video
|
| 11 |
+
- video-generation
|
| 12 |
+
- kandinsky-5
|
| 13 |
+
- time-adapter
|
| 14 |
+
- fps-conditioning
|
| 15 |
+
- latent-time
|
| 16 |
+
widget:
|
| 17 |
+
- text: >-
|
| 18 |
+
A close-up of a green-eyed girl in a dress stands in the city. The girl
|
| 19 |
+
smiles and waves. Then she turns her back and walks away.
|
| 20 |
+
output:
|
| 21 |
+
url: examples/ftta_pose_15.mp4
|
| 22 |
+
- text: >-
|
| 23 |
+
A close-up of a green-eyed girl in a dress stands in the city. The girl
|
| 24 |
+
smiles and waves. Then she turns her back and walks away.
|
| 25 |
+
output:
|
| 26 |
+
url: examples/ftta_pose_30.mp4
|
| 27 |
+
- text: >-
|
| 28 |
+
A close-up of a green-eyed girl in a dress stands in the city. The girl
|
| 29 |
+
smiles and waves. Then she turns her back and walks away.
|
| 30 |
+
output:
|
| 31 |
+
url: examples/ftta_pose_60.mp4
|
| 32 |
+
- text: >-
|
| 33 |
+
Beautiful views of the forest with fog. The wind dispels the fog and the
|
| 34 |
+
sun peeks out over the forest. The sun's rays illuminate a beautiful green
|
| 35 |
+
forest.
|
| 36 |
+
output:
|
| 37 |
+
url: examples/ftta_forest_15.mp4
|
| 38 |
+
- text: >-
|
| 39 |
+
Beautiful views of the forest with fog. The wind dispels the fog and the
|
| 40 |
+
sun peeks out over the forest. The sun's rays illuminate a beautiful green
|
| 41 |
+
forest.
|
| 42 |
+
output:
|
| 43 |
+
url: examples/ftta_forest_30.mp4
|
| 44 |
+
- text: >-
|
| 45 |
+
Beautiful views of the forest with fog. The wind dispels the fog and the
|
| 46 |
+
sun peeks out over the forest. The sun's rays illuminate a beautiful green
|
| 47 |
+
forest.
|
| 48 |
+
output:
|
| 49 |
+
url: examples/ftta_forest_60.mp4
|
| 50 |
---
|
| 51 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
| 52 |
+
<h1 style="color: #24292e; margin-top: 0;">Time Adapter for Kandinsky-5 I2V</h1>
|
| 53 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 54 |
+
<h2 style="color: #24292e; margin-top: 0;">Overview</h2>
|
| 55 |
+
<p>This repository contains a lightweight temporal adapter for Kandinsky-5 image-to-video generation.</p>
|
| 56 |
+
<p>The adapter is intended for motion tempo control with two temporal signals: global FPS conditioning and latent-time conditioning.</p>
|
| 57 |
+
<p>Lower target FPS typically leads to slower perceived motion, while higher target FPS leads to faster perceived motion.</p>
|
| 58 |
+
</div>
|
| 59 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 60 |
+
<h2 style="color: #24292e; margin-top: 0;">Behavior</h2>
|
| 61 |
+
<p>The adapter is designed to work on top of a base I2V model and inject temporal control without requiring full end-to-end finetuning of the generator.</p>
|
| 62 |
+
<p>In practice, the final video quality, visual consistency, and motion realism still depend strongly on the underlying base image-to-video model.</p>
|
| 63 |
+
</div>
|
| 64 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 65 |
+
<h2 style="color: #24292e; margin-top: 0;">Examples</h2>
|
| 66 |
+
<p>The gallery below shows FTTA examples for pose motion control and forest motion control at different target FPS values.</p>
|
| 67 |
+
</div>
|
| 68 |
+
</div>
|
| 69 |
+
<Gallery />
|
examples/ftta_forest_15.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d4badd7320fa4d8c3904c9ad08041b1f93d52d47980cde0fefff0f770f0abe3
|
| 3 |
+
size 4578144
|
examples/ftta_forest_30.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:de7fe6c78b3567ff51c8d09eaef1362c4eaaaefccf8a77ddb63c51d183fcccd0
|
| 3 |
+
size 3189226
|
examples/ftta_forest_60.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:328aa0fc8b846ef601b6b5e8b50f422f09d45771591148fa4190e77ee6d05b29
|
| 3 |
+
size 3358817
|
examples/ftta_pose_15.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1b7cb4a42f8b3e4ed1bc1ae6474758fbfc9e7603906221715715917c47012598
|
| 3 |
+
size 3228724
|
examples/ftta_pose_30.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5617cca1f9afac88e788ed958a53e08d2643924a8d97a076d73e9036e9f6dce8
|
| 3 |
+
size 2503432
|
examples/ftta_pose_60.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:954359847cd8a241fae9e50b448a19138ed3a316532e62f94d957109049b6878
|
| 3 |
+
size 1985107
|