Constellum commited on
Commit
d39847b
·
1 Parent(s): 063d83d

Add Time Adapter model card and example videos

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ examples/*.mp4 filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,69 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ language:
4
+ - en
5
+ - ru
6
+ base_model:
7
+ - kandinskylab/Kandinsky-5.0-I2V-Lite-sft-5s
8
+ pipeline_tag: image-to-video
9
+ tags:
10
+ - image-to-video
11
+ - video-generation
12
+ - kandinsky-5
13
+ - time-adapter
14
+ - fps-conditioning
15
+ - latent-time
16
+ widget:
17
+ - text: >-
18
+ A close-up of a green-eyed girl in a dress stands in the city. The girl
19
+ smiles and waves. Then she turns her back and walks away.
20
+ output:
21
+ url: examples/ftta_pose_15.mp4
22
+ - text: >-
23
+ A close-up of a green-eyed girl in a dress stands in the city. The girl
24
+ smiles and waves. Then she turns her back and walks away.
25
+ output:
26
+ url: examples/ftta_pose_30.mp4
27
+ - text: >-
28
+ A close-up of a green-eyed girl in a dress stands in the city. The girl
29
+ smiles and waves. Then she turns her back and walks away.
30
+ output:
31
+ url: examples/ftta_pose_60.mp4
32
+ - text: >-
33
+ Beautiful views of the forest with fog. The wind dispels the fog and the
34
+ sun peeks out over the forest. The sun's rays illuminate a beautiful green
35
+ forest.
36
+ output:
37
+ url: examples/ftta_forest_15.mp4
38
+ - text: >-
39
+ Beautiful views of the forest with fog. The wind dispels the fog and the
40
+ sun peeks out over the forest. The sun's rays illuminate a beautiful green
41
+ forest.
42
+ output:
43
+ url: examples/ftta_forest_30.mp4
44
+ - text: >-
45
+ Beautiful views of the forest with fog. The wind dispels the fog and the
46
+ sun peeks out over the forest. The sun's rays illuminate a beautiful green
47
+ forest.
48
+ output:
49
+ url: examples/ftta_forest_60.mp4
50
  ---
51
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
52
+ <h1 style="color: #24292e; margin-top: 0;">Time Adapter for Kandinsky-5 I2V</h1>
53
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
54
+ <h2 style="color: #24292e; margin-top: 0;">Overview</h2>
55
+ <p>This repository contains a lightweight temporal adapter for Kandinsky-5 image-to-video generation.</p>
56
+ <p>The adapter is intended for motion tempo control with two temporal signals: global FPS conditioning and latent-time conditioning.</p>
57
+ <p>Lower target FPS typically leads to slower perceived motion, while higher target FPS leads to faster perceived motion.</p>
58
+ </div>
59
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
60
+ <h2 style="color: #24292e; margin-top: 0;">Behavior</h2>
61
+ <p>The adapter is designed to work on top of a base I2V model and inject temporal control without requiring full end-to-end finetuning of the generator.</p>
62
+ <p>In practice, the final video quality, visual consistency, and motion realism still depend strongly on the underlying base image-to-video model.</p>
63
+ </div>
64
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
65
+ <h2 style="color: #24292e; margin-top: 0;">Examples</h2>
66
+ <p>The gallery below shows FTTA examples for pose motion control and forest motion control at different target FPS values.</p>
67
+ </div>
68
+ </div>
69
+ <Gallery />
examples/ftta_forest_15.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d4badd7320fa4d8c3904c9ad08041b1f93d52d47980cde0fefff0f770f0abe3
3
+ size 4578144
examples/ftta_forest_30.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de7fe6c78b3567ff51c8d09eaef1362c4eaaaefccf8a77ddb63c51d183fcccd0
3
+ size 3189226
examples/ftta_forest_60.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:328aa0fc8b846ef601b6b5e8b50f422f09d45771591148fa4190e77ee6d05b29
3
+ size 3358817
examples/ftta_pose_15.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b7cb4a42f8b3e4ed1bc1ae6474758fbfc9e7603906221715715917c47012598
3
+ size 3228724
examples/ftta_pose_30.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5617cca1f9afac88e788ed958a53e08d2643924a8d97a076d73e9036e9f6dce8
3
+ size 2503432
examples/ftta_pose_60.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:954359847cd8a241fae9e50b448a19138ed3a316532e62f94d957109049b6878
3
+ size 1985107