RootAccess4Life commited on
Commit
c1ccd89
·
verified ·
1 Parent(s): f5a106e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: pytorch
4
+ tags:
5
+ - speech-editing
6
+ - speech-synthesis
7
+ - text-to-speech
8
+ ---
9
+
10
+ # wavepainter
11
+
12
+ Released checkpoints for [wavepainter](https://github.com/pujariaditya/wavepainter),
13
+ a masked-span speech editor.
14
+
15
+ On the English `full` split of Ming-Freeform-Audio-Edit, against Ren et al.
16
+ ([arXiv:2602.00560](https://arxiv.org/abs/2602.00560), the row with GRPO):
17
+
18
+ | edit type | metric | Ren et al. | wavepainter |
19
+ |---|---|---|---|
20
+ | substitution | WER | 4.41 | **3.063** |
21
+ | insertion | WER | 4.97 | **4.128** |
22
+ | deletion | WER | **6.88** | 9.136 |
23
+ | substitution | SIM | 0.78 | **0.943** |
24
+ | insertion | SIM | 0.82 | **0.961** |
25
+ | deletion | SIM | 0.78 | **0.918** |
26
+ | substitution | DNSMOS | **3.11** | 2.931 |
27
+ | insertion | DNSMOS | **3.18** | 2.905 |
28
+ | deletion | DNSMOS | **3.09** | 2.938 |
29
+
30
+ Five of the nine numbers they report improve on theirs: substitution and
31
+ insertion WER, and speaker similarity on all three edit types. We do not beat
32
+ them on deletion WER or on DNSMOS anywhere -- see the repository's Limitations.
33
+
34
+ ## Files
35
+
36
+ - `phase1-base/` — the phase-1 editor. Start here to re-run phase 2 (~1 GPU-hour).
37
+ - `phase2-hubert-a085/` — the released model. This produces the numbers above.
38
+
39
+ ## Use
40
+
41
+ ```bash
42
+ git clone https://github.com/pujariaditya/wavepainter && cd wavepainter
43
+ pip install -e . && ./setup.sh
44
+ python scripts/download_weights.py
45
+ ./scripts/verify_benchmark.sh
46
+ ```
47
+
48
+ Checkpoints are sha256-pinned in `scripts/download_weights.py`. Licence and
49
+ attribution, including for the components these weights derive from, are in the
50
+ repository's `ATTRIBUTION.md`.