Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -23,13 +23,17 @@ On the English `full` split of Ming-Freeform-Audio-Edit, against Ren et al.
|
|
| 23 |
| substitution | SIM | 0.78 | **0.943** | **0.943** |
|
| 24 |
| insertion | SIM | 0.82 | **0.961** | 0.960 |
|
| 25 |
| deletion | SIM | 0.78 | **0.918** | **0.918** |
|
| 26 |
-
| substitution | DNSMOS | **3.11** | 2.931 | 2.925 |
|
| 27 |
-
| insertion | DNSMOS | **3.18** | 2.905 | 2.908 |
|
| 28 |
-
| deletion | DNSMOS | **3.09** | 2.938 | 2.935 |
|
| 29 |
|
| 30 |
-
Five of the
|
| 31 |
-
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
### Which checkpoint to use
|
| 35 |
|
|
|
|
| 23 |
| substitution | SIM | 0.78 | **0.943** | **0.943** |
|
| 24 |
| insertion | SIM | 0.82 | **0.961** | 0.960 |
|
| 25 |
| deletion | SIM | 0.78 | **0.918** | **0.918** |
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
+
Five of the six compared numbers improve on theirs: substitution and insertion
|
| 28 |
+
WER, and speaker similarity on all three edit types. We do not beat them on
|
| 29 |
+
deletion WER -- see the repository's Limitations, which also locates most of that
|
| 30 |
+
gap with a ground-truth waveform splice.
|
| 31 |
+
|
| 32 |
+
Signal quality is reported full-reference, since a no-reference MOS estimator
|
| 33 |
+
rates the untouched original recordings below synthesised output on this
|
| 34 |
+
benchmark. Over the audio the edit does not touch, PESQ is 4.089 / 4.083 / 4.076
|
| 35 |
+
for substitution / insertion / deletion, against 4.351 for copy-synthesis with no
|
| 36 |
+
edit at all.
|
| 37 |
|
| 38 |
### Which checkpoint to use
|
| 39 |
|