docs: document the published v8.0 dataset + corpus-free reproduction
Browse files
README.md
CHANGED
|
@@ -19,9 +19,23 @@ Generative text→skeletal-animation model shipped with
|
|
| 19 |
|
| 20 |
- `t2m.onnx` + `t2m-vocab.json` — the generative model + its vocab/contract.
|
| 21 |
- `t2m-v61.onnx` / `t2m-v4.onnx` — previous versions, kept for rollback.
|
| 22 |
-
- `motion-library-v2.json` — the curated **template clip library**
|
| 23 |
-
the fallback for prompts outside the model vocab *and* — since
|
| 24 |
-
model's training data.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
## What changed in v8.0
|
| 27 |
|
|
@@ -82,11 +96,12 @@ curated clips is the improvement path.
|
|
| 82 |
## Training data — permissive only
|
| 83 |
|
| 84 |
The curated library is CC0/CC-BY content (Sketchfab, OpenGameArt, Quaternius
|
| 85 |
-
packs)
|
| 86 |
-
|
| 87 |
-
windows (commercial-OK) remain in the corpus path
|
| 88 |
-
are **excluded** (non-commercial).
|
| 89 |
-
filtered out
|
|
|
|
| 90 |
|
| 91 |
## Architecture (v8.0)
|
| 92 |
|
|
@@ -115,8 +130,13 @@ world delta); `fps: 30`, `T: 60` (2.0 s).
|
|
| 115 |
`scripts/prep-t2m-v6.py` + `scripts/train-t2m-flow-v5.py` in the QtMeshEditor
|
| 116 |
repo (one-time, offline dev tools — the app never runs Python):
|
| 117 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 118 |
```
|
| 119 |
-
python3 scripts/prep-t2m-v6.py --
|
| 120 |
--library-repeat 40 --min-roles 16 --out t2m.npz
|
| 121 |
python3 scripts/train-t2m-flow-v5.py --data t2m.npz --out flow --dim 384 --layers 8 \
|
| 122 |
--phase-weight 0.08 --twist-weight 0.5 --travel-weight 0.2 --amp-weight 0.4 \
|
|
|
|
| 19 |
|
| 20 |
- `t2m.onnx` + `t2m-vocab.json` — the generative model + its vocab/contract.
|
| 21 |
- `t2m-v61.onnx` / `t2m-v4.onnx` — previous versions, kept for rollback.
|
| 22 |
+
- `motion-library-v2.json` — the curated **template clip library** (150 clips).
|
| 23 |
+
It is both the fallback for prompts outside the model vocab *and* — since
|
| 24 |
+
v8.0 — the model's training data. This is the exact library v8.0 trained on.
|
| 25 |
+
- `ATTRIBUTION-v2.md` — **required credits** for the CC-BY clips in that
|
| 26 |
+
library. It must ship with the data and with anything derived from it.
|
| 27 |
+
|
| 28 |
+
## Dataset
|
| 29 |
+
|
| 30 |
+
The published library is the full v8.0 training source: 150 clips drawn from 31
|
| 31 |
+
source assets — 27 CC-BY-4.0, plus CC0 material (largely Quaternius packs) and
|
| 32 |
+
17 clips the author owns outright. Every CC-BY asset is credited in
|
| 33 |
+
`ATTRIBUTION-v2.md`; no clip in the library lacks a credit where one is due.
|
| 34 |
+
|
| 35 |
+
To rebuild the training cache from it, see **Reproducing** below. The cache
|
| 36 |
+
itself is not published — it is fully regenerable from this library, and it
|
| 37 |
+
stamps its own `buildArgv`/`buildFlags` so any `.npz` can state how it was
|
| 38 |
+
built.
|
| 39 |
|
| 40 |
## What changed in v8.0
|
| 41 |
|
|
|
|
| 96 |
## Training data — permissive only
|
| 97 |
|
| 98 |
The curated library is CC0/CC-BY content (Sketchfab, OpenGameArt, Quaternius
|
| 99 |
+
packs) plus clips the author owns; credits are in `ATTRIBUTION-v2.md`, **which
|
| 100 |
+
must ship with the library and with anything derived from it**. Earlier CMU
|
| 101 |
+
MoCap windows (commercial-OK) remain in the corpus path but no longer dominate
|
| 102 |
+
training. AMASS / HumanML3D / KIT-ML are **excluded** (non-commercial).
|
| 103 |
+
Zombie/fruit/non-humanoid characters are filtered out, as are clips failing the
|
| 104 |
+
anatomical ankle gate or resolving fewer than 16 of the 22 canonical roles.
|
| 105 |
|
| 106 |
## Architecture (v8.0)
|
| 107 |
|
|
|
|
| 130 |
`scripts/prep-t2m-v6.py` + `scripts/train-t2m-flow-v5.py` in the QtMeshEditor
|
| 131 |
repo (one-time, offline dev tools — the app never runs Python):
|
| 132 |
|
| 133 |
+
`--corpus` is optional and points at the raw CMU-derived corpus, which is NOT
|
| 134 |
+
published here; with `--library-repeat 40` the curated library dominates
|
| 135 |
+
training either way, so omitting it reproduces the same shape of dataset from
|
| 136 |
+
the published files alone:
|
| 137 |
+
|
| 138 |
```
|
| 139 |
+
python3 scripts/prep-t2m-v6.py --library motion-library-v2.json \
|
| 140 |
--library-repeat 40 --min-roles 16 --out t2m.npz
|
| 141 |
python3 scripts/train-t2m-flow-v5.py --data t2m.npz --out flow --dim 384 --layers 8 \
|
| 142 |
--phase-weight 0.08 --twist-weight 0.5 --travel-weight 0.2 --amp-weight 0.4 \
|