| --- |
| license: other |
| license_name: netease-youdao-model-use-license-agreement |
| license_link: https://github.com/netease-youdao/Confucius4-R2T2/blob/master/MODEL_LICENSE |
| base_model: netease-youdao/Confucius4-R2T2 |
| base_model_relation: quantized |
| pipeline_tag: automatic-speech-recognition |
| library_name: mlx |
| tags: |
| - mlx |
| - mlx-audio |
| - qwen3_asr |
| - asr |
| - streaming |
| - confucius4 |
| - r2t2 |
| language: |
| - zh |
| - en |
| --- |
| |
| # Confucius4-R2T2 — MLX, 8-bit |
|
|
| [`netease-youdao/Confucius4-R2T2`](https://huggingface.co/netease-youdao/Confucius4-R2T2) — NetEase |
| Youdao's low-latency, append-only streaming ASR fine-tune of Qwen3-ASR-1.7B — converted to MLX: |
| the Qwen3 language model quantised to 8 bits, group size 64, affine; the AuT audio encoder stays bf16 (2.3 GB). |
|
|
| Converted with the `mlx_audio.convert` CLI (xocialize/mlx-audio fork @ `1792021`, mlx 0.32.2), on |
| the GPU stream of an Apple M5 Max — MLX quantisation is device-dependent, so the device is recorded: |
|
|
| ```bash |
| python -m mlx_audio.convert --hf-path netease-youdao/Confucius4-R2T2 \ |
| --mlx-path Confucius4-R2T2-8bit --model-domain stt -q --q-bits 8 --q-group-size 64 |
| ``` |
|
|
| The architecture is `qwen3_asr`, unchanged from `Qwen/Qwen3-ASR-1.7B`, so the weights load through |
| the existing Qwen3-ASR paths of `mlx-audio` (Python) and `mlx-audio-swift`, and through |
| [`qwen3-asr-mlx-swift`](https://github.com/xocialize/qwen3-asr-mlx-swift), whose R2T2 loop and |
| MLXEngine `stt` package ([`mlx-r2t2-stt-swift`](https://github.com/xocialize/mlx-r2t2-stt-swift)) |
| are what this repo exists for. |
|
|
| ## Use |
|
|
| ```python |
| from mlx_audio.stt.utils import load_model, load_audio |
| model = load_model("mlx-community/Confucius4-R2T2-8bit") |
| print(model.generate(load_audio("audio.wav"), language="English").text) |
| ``` |
|
|
| Streaming (the stable-prefix protocol the model was trained for) needs the R2T2 loop: 160 ms chunks, |
| re-feed the audio window with the committed text as the prompt, cut the output at `|`, roll back one |
| token, commit the rest. See the Swift package above or `netease-youdao/Confucius4-R2T2`. |
|
|
| ## Licence |
|
|
| The weights are governed by the **NetEase Youdao Model Use License Agreement** (`LICENSE`; the |
| Chinese text in `MODEL_LICENSE_zh` prevails). It is royalty-free, including commercial use, but |
| requires a separate licence from NetEase Youdao above 100 million monthly active users or RMB 1 |
| billion annual revenue (§2.2), forbids using the model to improve other commercial AI models |
| (§3.4 c) and the high-risk uses it lists (§4.2), and binds downstream recipients to the same terms |
| (§3.4 a). Read it before use. |
|
|
| Any modifications made to the original model in this Derivative Work are not endorsed, warranted, |
| or guaranteed by the original right-holder of the original model, and the original right-holder |
| disclaims all liability related to this Derivative Work. |
|
|
