AnotherPotatoCoder commited on
Commit
5491fb4
Β·
verified Β·
1 Parent(s): a88d1a6

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +66 -0
README.md ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - km
5
+ tags:
6
+ - text-to-speech
7
+ - tts
8
+ - khmer
9
+ ---
10
+
11
+ # SimpleKhmerTTS
12
+
13
+ Decoder-only transformer TTS, using [WavTokenizer](https://github.com/jishengpeng/WavTokenizer) as the audio codec and [DDD-Cambodia/khmer-speech-dataset](https://huggingface.co/datasets/DDD-Cambodia/khmer-speech-dataset) as dataset.
14
+
15
+ ## Samples
16
+
17
+ | Text | Audio |
18
+ | -------- | -------------------------------------------------------------------------------------------------------------------------- |
19
+ | Sample 1 | <audio controls src="https://huggingface.co/AnotherPotatoCoder/Khmer-TTS/resolve/main/sample_audios/sample_1.wav"></audio> |
20
+ | Sample 2 | <audio controls src="https://huggingface.co/AnotherPotatoCoder/Khmer-TTS/resolve/main/sample_audios/sample_2.wav"></audio> |
21
+ | Sample 3 | <audio controls src="https://huggingface.co/AnotherPotatoCoder/Khmer-TTS/resolve/main/sample_audios/sample_3.wav"></audio> |
22
+ | Sample 4 | <audio controls src="https://huggingface.co/AnotherPotatoCoder/Khmer-TTS/resolve/main/sample_audios/sample_4.wav"></audio> |
23
+
24
+ ## Setup
25
+
26
+ ```bash
27
+ git clone https://github.com/FirstPotatoCoder/SimpleKhmerTTS.git
28
+ cd SimpleKhmerTTS
29
+ pip install -q -r requirements.txt
30
+ python scripts/download_weights.py
31
+ ```
32
+
33
+ ## Run
34
+
35
+ ```bash
36
+ python examples/run_inference.py " αž—αžΆαžŸαžΆαžαŸ’αž˜αŸ‚αžšαž˜αžΆαž“αž’αž€αŸ’αžŸαžšαž…αŸ’αžšαžΎαž“ αž αžΎαž™αž–αž·αž”αžΆαž€αžŸαžšαžŸαŸαžšαž”αž“αŸ’αžαž·αž…αŸ” αž—αžΆαžŸαžΆαž“αŸαŸ‡αž˜αžΆαž“αž”αŸ’αžšαžœαžαŸ’αžαž·αž™αžΌαžšαž’αž„αŸ’αžœαŸ‚αž„ αž“αž·αž„αž‡αžΆαž•αŸ’αž“αŸ‚αž€αž˜αž½αž™αž™αŸ‰αžΆαž„αžŸαŸ†αžαžΆαž“αŸ‹αž“αŸƒαžœαž”αŸ’αž”αž’αž˜αŸŒαž€αž˜αŸ’αž–αž»αž‡αžΆαŸ”" --speaker_id 0
37
+ ```
38
+
39
+ Or from Python:
40
+
41
+ ```python
42
+ from tts.inference import TTSPipeline
43
+
44
+ pipe = TTSPipeline(
45
+ tts_weights="weights/tts.pt",
46
+ wavtokenizer_weights="weights/wavtokenizer.ckpt",
47
+ wavtokenizer_config="configs/wavtokenizer_config.yaml"
48
+ )
49
+
50
+ pipe.generate(" αž—αžΆαžŸαžΆαžαŸ’αž˜αŸ‚αžšαž˜αžΆαž“αž’αž€αŸ’αžŸαžšαž…αŸ’αžšαžΎαž“ αž αžΎαž™αž–αž·αž”αžΆαž€αžŸαžšαžŸαŸαžšαž”αž“αŸ’αžαž·αž…αŸ”", speaker_id=1, out_path="out.wav")
51
+ ```
52
+
53
+ ## Limitations
54
+
55
+ - The model sometimes hallucinates, generating babbling or garbled output on rare or unseen words, making it ill-suited for direct deployment β€” likely due to the limited amount of training data and codec's limited performance on Khmer audio.
56
+ - Works best when generating ~3s to 10s of audio, matching the length distribution of its training data.
57
+ - No chunking support yet β€” the current repo only supports clip-by-clip generation, one sample at a time.
58
+
59
+ ## Credits
60
+
61
+ - Data: [Khmer Speech Dataset](https://huggingface.co/datasets/DDD-Cambodia/khmer-speech-dataset) by DDD-Cambodia
62
+
63
+ - Compute: [Kaggle](https://www.kaggle.com) for free T4 GPU access
64
+
65
+ - Audio tokenizer/codec: [WavTokenizer](https://github.com/jishengpeng/WavTokenizer)
66
+ (vendored under `wavtokenizer/`, trimmed to inference-only code).