RootAccess4Life commited on
Commit
931c041
·
verified ·
1 Parent(s): 79062ac

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -6
README.md CHANGED
@@ -23,13 +23,17 @@ On the English `full` split of Ming-Freeform-Audio-Edit, against Ren et al.
23
  | substitution | SIM | 0.78 | **0.943** | **0.943** |
24
  | insertion | SIM | 0.82 | **0.961** | 0.960 |
25
  | deletion | SIM | 0.78 | **0.918** | **0.918** |
26
- | substitution | DNSMOS | **3.11** | 2.931 | 2.925 |
27
- | insertion | DNSMOS | **3.18** | 2.905 | 2.908 |
28
- | deletion | DNSMOS | **3.09** | 2.938 | 2.935 |
29
 
30
- Five of the nine numbers they report improve on theirs: substitution and
31
- insertion WER, and speaker similarity on all three edit types. We do not beat
32
- them on deletion WER or on DNSMOS anywhere -- see the repository's Limitations.
 
 
 
 
 
 
 
33
 
34
  ### Which checkpoint to use
35
 
 
23
  | substitution | SIM | 0.78 | **0.943** | **0.943** |
24
  | insertion | SIM | 0.82 | **0.961** | 0.960 |
25
  | deletion | SIM | 0.78 | **0.918** | **0.918** |
 
 
 
26
 
27
+ Five of the six compared numbers improve on theirs: substitution and insertion
28
+ WER, and speaker similarity on all three edit types. We do not beat them on
29
+ deletion WER -- see the repository's Limitations, which also locates most of that
30
+ gap with a ground-truth waveform splice.
31
+
32
+ Signal quality is reported full-reference, since a no-reference MOS estimator
33
+ rates the untouched original recordings below synthesised output on this
34
+ benchmark. Over the audio the edit does not touch, PESQ is 4.089 / 4.083 / 4.076
35
+ for substitution / insertion / deletion, against 4.351 for copy-synthesis with no
36
+ edit at all.
37
 
38
  ### Which checkpoint to use
39