IgorSwat commited on
Commit Β·
14e5842
1
Parent(s): 1a30440
Reexport models for RNET v0.10.0
Browse files- README.md +29 -3
- xnnpack/german/{duration_predictor_de.pte β config.json} +2 -2
- xnnpack/{standard/duration_predictor_std.pte β german/duration_predictor_de_xnnpack_fp32.pte} +2 -2
- xnnpack/german/{synthesizer_de.pte β synthesizer_de_xnnpack_fp32.pte} +2 -2
- xnnpack/polish/{duration_predictor_pl.pte β config.json} +2 -2
- xnnpack/polish/{synthesizer_pl.pte β duration_predictor_pl_xnnpack_fp32.pte} +2 -2
- xnnpack/polish/synthesizer_pl_xnnpack_fp32.pte +3 -0
- xnnpack/standard/config.json +3 -0
- xnnpack/standard/duration_predictor_std_xnnpack_fp32.pte +3 -0
- xnnpack/standard/synthesizer_std.pte +0 -3
- xnnpack/standard/synthesizer_std_xnnpack_fp32.pte +3 -0
README.md
CHANGED
|
@@ -21,7 +21,7 @@ It can perform speech synthesis in 8 different languages, including fine-tuned P
|
|
| 21 |
|
| 22 |
The models support **input shape dynamism** and cover the input range of `1` up to `128` tokens.
|
| 23 |
|
| 24 |
-
Additionally, the repository contains essential resources for **G2P (grapheme-to-phoneme)** preprocessing
|
| 25 |
including simple word-by-word phonemization models (also in ExecuTorch format).
|
| 26 |
|
| 27 |
If you'd like to run these models in your own ExecuTorch runtime, refer to the
|
|
@@ -39,8 +39,34 @@ make sure your runtime is compatible with the ExecuTorch version used to export
|
|
| 39 |
|
| 40 |
## Repository Structure
|
| 41 |
|
| 42 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
- `phonemizer` - data files required by the [Phonemis](https://github.com/IgorSwat/Phonemis) package - responsible for input preprocessing part
|
| 44 |
of React Native ExecuTorch Kokoro pipeline.
|
| 45 |
- `voices` - a collection of pre-computed speaker embeddings used by the Kokoro model to synthesize speech with specific vocal characteristics.
|
| 46 |
-
- `xnnpack` - exported, XNNPACK-optimized Kokoro runtime modules.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
The models support **input shape dynamism** and cover the input range of `1` up to `128` tokens.
|
| 23 |
|
| 24 |
+
Additionally, the repository contains essential resources for **G2P (grapheme-to-phoneme)** preprocessing required by the Kokoro model,
|
| 25 |
including simple word-by-word phonemization models (also in ExecuTorch format).
|
| 26 |
|
| 27 |
If you'd like to run these models in your own ExecuTorch runtime, refer to the
|
|
|
|
| 39 |
|
| 40 |
## Repository Structure
|
| 41 |
|
| 42 |
+
```
|
| 43 |
+
.
|
| 44 |
+
βββ config.json # Backend-agnostic model manifest
|
| 45 |
+
βββ phonemizer/ # G2P data files + per-language phonemizer models
|
| 46 |
+
βββ voices/ # Pre-computed speaker embeddings
|
| 47 |
+
βββ xnnpack/ # XNNPACK-exported .pte files, one directory per model variant
|
| 48 |
+
βββ standard/
|
| 49 |
+
β βββ config.json
|
| 50 |
+
β βββ duration_predictor_std_xnnpack_fp32.pte
|
| 51 |
+
β βββ synthesizer_std_xnnpack_fp32.pte
|
| 52 |
+
βββ german/
|
| 53 |
+
β βββ config.json
|
| 54 |
+
β βββ duration_predictor_de_xnnpack_fp32.pte
|
| 55 |
+
β βββ synthesizer_de_xnnpack_fp32.pte
|
| 56 |
+
βββ polish/
|
| 57 |
+
βββ config.json
|
| 58 |
+
βββ duration_predictor_pl_xnnpack_fp32.pte
|
| 59 |
+
βββ synthesizer_pl_xnnpack_fp32.pte
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
- `phonemizer` - data files required by the [Phonemis](https://github.com/IgorSwat/Phonemis) package - responsible for input preprocessing part
|
| 63 |
of React Native ExecuTorch Kokoro pipeline.
|
| 64 |
- `voices` - a collection of pre-computed speaker embeddings used by the Kokoro model to synthesize speech with specific vocal characteristics.
|
| 65 |
+
- `xnnpack` - exported, XNNPACK-optimized Kokoro runtime modules. Each variant directory ships a `config.json` manifest
|
| 66 |
+
describing its `.pte` files and their method signatures.
|
| 67 |
+
|
| 68 |
+
Each variant is composed of two sub-models that run sequentially:
|
| 69 |
+
|
| 70 |
+
1. **Duration predictor** β predicts per-token durations and the prosody features `d`. Exported as a bundled program exposing
|
| 71 |
+
`forward_32`, `forward_64` and `forward_128`, one method per padded token bucket.
|
| 72 |
+
2. **Synthesizer** β encodes text, predicts F0/N and decodes the waveform. Exported with dynamic shapes behind a single `forward` method.
|
xnnpack/german/{duration_predictor_de.pte β config.json}
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bf6eac054d3e9cc94e6f3f2dd5117ae5c95be4221a1d8da301c57f3f01449eb1
|
| 3 |
+
size 4406
|
xnnpack/{standard/duration_predictor_std.pte β german/duration_predictor_de_xnnpack_fp32.pte}
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d745ed3793b68d8c6c7e2189f39bc4fc2ec30b4be9c27eb50648f59470105b87
|
| 3 |
+
size 59307208
|
xnnpack/german/{synthesizer_de.pte β synthesizer_de_xnnpack_fp32.pte}
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14056f50118fa51c027f60cfd74133384d61b80bae5645a7ff10d9b7e5e4b511
|
| 3 |
+
size 272463344
|
xnnpack/polish/{duration_predictor_pl.pte β config.json}
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e802f70b98c8603fce6bdf94bbaf2e6352296e3bd80fe398570095a210d2cfbd
|
| 3 |
+
size 4406
|
xnnpack/polish/{synthesizer_pl.pte β duration_predictor_pl_xnnpack_fp32.pte}
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2053f3ac747c606df8655922335d98b00948080575742ce4ade7d06441aa020d
|
| 3 |
+
size 59307208
|
xnnpack/polish/synthesizer_pl_xnnpack_fp32.pte
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d89fba6ec41d774595ba581fd0b8f69401618927728b899cf56823457cec4b95
|
| 3 |
+
size 272463344
|
xnnpack/standard/config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e6565d2e208b2e32bcba4441f36e75fe142f76493fd69bf1b929c8245b2d07b0
|
| 3 |
+
size 4409
|
xnnpack/standard/duration_predictor_std_xnnpack_fp32.pte
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:781a6e6de5c13cf2c97c4a486c766c92c107ff8ac99d7ae8e991bfb81d701334
|
| 3 |
+
size 59307208
|
xnnpack/standard/synthesizer_std.pte
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:a1d6dea9b16fc3bb60236f886bb460de7c1bf864cecbb93b8768e917740bf38f
|
| 3 |
-
size 272442224
|
|
|
|
|
|
|
|
|
|
|
|
xnnpack/standard/synthesizer_std_xnnpack_fp32.pte
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1f4ce2b8dcf396b1bc0125d7dbccadd79a4c3dc104bb8776dbcc85c482bcd000
|
| 3 |
+
size 272463344
|