Text-to-Speech
Transformers
SPRING_F5
tts
multilingual
indic-languages
custom_code
SPRING_F5 / README.md
arigalaadarsh's picture
Update README.md
8bc8673 verified
|
Raw
History Blame Contribute Delete
6.62 kB
metadata
license: apache-2.0
language:
  - as
  - bn
  - bo
  - gu
  - hi
  - kn
  - ks
  - kok
  - mai
  - ml
  - mni
  - mr
  - ne
  - or
  - pa
  - sa
  - sat
  - sd
  - ta
  - te
  - ur
  - doi
  - raj
  - en
base_model:
  - SWivid/F5-TTS
library_name: transformers
pipeline_tag: text-to-speech
tags:
  - text-to-speech
  - tts
  - multilingual
  - indic-languages
widget:
  - text: >-
      2026 లో ఈ project లో మా ultimate goal ఏంటంటే, ఒక Telugu speaker తన daily
      conversation లో naturally English words ఉపయోగించినప్పుడు, మన T T S system
      కూడా అదే style ని understand చేసి, unnecessary pauses లేకుండా చాలా smooth
      మరియు natural speech ని generate చేయాలి.
    example_title: CodeMix-Telugu
    output:
      url: examples/codemix_te.wav
  - text: >-
      எங்களுடைய plan என்னவென்றால், இந்த project-ஐ பெரிய scale-க்கு கொண்டு
      செல்வது, அதற்காக 2026 முழுவதும் புதிய training data மற்றும் high-quality
      audio samples-ஐ தொடர்ந்து collect செய்வதாகும்.
    example_title: CodeMix-Tamil
    output:
      url: examples/codemix_ta.wav
  - text: >-
      हम इस project को 2026 तक बड़े scale पर ले जाने की planning कर रहे हैं,
      इसलिए नए training data और high-quality audio samples लगातार collect कर रहे
      हैं।
    example_title: CodeMix-Hindi
    output:
      url: examples/codemix_hi.wav
  - text: >-
      విద్య మన జీవితానికి వెలుగునిచ్చే శక్తి. అది జ్ఞానం, ఆత్మవిశ్వాసం, మంచి
      ఆలోచనా విధానాన్ని పెంచుతుంది. ప్రతి వ్యక్తి అభివృద్ధికి, సమాజ పురోగతికి
      విద్య ఎంతో ముఖ్యం
    example_title: Telugu1
    output:
      url: examples/example1_te.wav
  - text: >-
      பள்ளிகூடத்திலேயே நம்மள தான் மாணவர்கள் எல்லாருக்கும் பிடிக்கும்னு எல்லாரும்
      பேசிக்குறாங்க.
    example_title: Tamil1
    output:
      url: examples/example1_ta.wav
  - text: >-
      उन्होंने टाटा इंस्टीट्यूट ऑफ़ सोशल साइंसेज़, टाटा इंस्टीट्यूट ऑफ़
      फ़ंडामेंटल रिसर्च और नेशनल सेंटर फ़ॉर परफ़ॉर्मिंग आर्ट्स की भी स्थापना की।
    example_title: Hindi1
    output:
      url: examples/example1_hi.wav
  - text: >-
      The grain was of such excellent quality, that the likes of it had never
      been seen before.
    example_title: English1
    output:
      url: examples/example1_en.wav
datasets:
  - ai4bharat/IndicVoices
  - ai4bharat/Rasa

SPRING_F5: Fine-tuned F5-TTS for 23 Indian Languages & English

SPRING_F5 is a multilingual text-to-speech (TTS) model based on F5-TTS, fine-tuned to support 23 Indian Language & English.

Supported Languages

SPRING_F5 supports the following 24 languages:

  • Assamese, Bengali, Bodo, Gujarati, Hindi, Kannada, Kashmiri, Konkani, Maithili, Malayalam, Manipuri, Marathi, Nepali, Odia, Punjabi, Sanskrit, Santali, Sindhi, Tamil, Telugu, Urdu, Dogri, Rajasthani and English

🚀 Installation

We recommend using a dedicated Conda environment.

conda create -n springf5 python=3.10 -y
conda activate springf5
pip install git+https://github.com/ArigalaAdarsh/SPRING_F5.git
from transformers import AutoModel
import numpy as np
import soundfile as sf

# Load INF5 from Hugging Face
repo_id = "SPRINGLab/SPRING_F5"
model = AutoModel.from_pretrained(repo_id, trust_remote_code=True)

# Generate speech
audio = model(" 2026 లో ఈ project లో మా ultimate goal ఏంటంటే, ఒక Telugu speaker తన daily conversation లో naturally English words ఉపయోగించినప్పుడు, మన T T S system కూడా అదే style ని understand చేసి, unnecessary pauses లేకుండా చాలా smooth మరియు natural speech ని generate చేయాలి.", 
            ref_audio_path="prompt_audios/example1_te.wav",
            ref_text="వందేభారత్ రైలు ఆధునిక భారతదేశం యొక్క వైభవోపేతమైన చిత్రాలలో ఒకటిగా ఉంది",
            lang='te'  # Language ID is used for number-to-Indic word conversion.
                  )

# Normalize and save output
if audio.dtype == np.int16:
    audio = audio.astype(np.float32) / 32768.0
sf.write("generated_audios/outputs/example.wav", np.array(audio, dtype=np.float32), samplerate=24000)

Training Details

SPRING_F5 was trained using 2 × NVIDIA H200 GPUs for approximately two weeks.

We would like to sincerely thank C-DAC for providing the computational resources required to train this model.

We used the F5-TTS Base configuration, with approximately 330M parameters, following the model configuration described in the original F5-TTS work.

Training Data

The model was trained on approximately 3,220 hours of high-quality speech data collected from the following datasets:

These datasets provide diverse multilingual speech data covering the Indian languages supported by SPRING_F5.


References

We would like to express our sincere gratitude to the authors and contributors of F5-TTS for their valuable contributions to text-to-speech research and for providing the foundation for this work.

SPRING_F5 builds upon the F5-TTS architecture and training methodology and extends it toward multilingual speech synthesis for Indian languages.

@misc{spring_f5_2026,
  author       = {Adarsh Arigala},
  title        = {SPRING_F5},
  year         = {2026},
  url          = {https://github.com/arigalaadarsh/SPRING_F5},
}