audio-cpp/VibeVoice-ASR-Streaming-7B-GGUF

VibeVoice ASR Streaming 7B GGUF for audio.cpp

This repository contains audio.cpp-native GGUF builds of microsoft/VibeVoice-ASR-Streaming-7B.

Use with audio.cpp

Install the recommended Q8_0 package through the audio.cpp model manager:

python3 tools/model_manager_v2.py install vibevoice_asr_streaming_7b_q8_0

Run offline ASR:

build/debug/bin/audiocpp_cli \
  --task asr \
  --family vibevoice_asr_streaming \
  --model models/VibeVoice-ASR-Streaming-7B-GGUF/vibevoice-asr-streaming-7b-q8_0.gguf \
  --backend cuda \
  --threads 8 \
  --audio input.wav \
  --text-out transcript.txt \
  --metrics \
  --log

Run the server with the model loaded:

{
  "host": "127.0.0.1",
  "port": 8080,
  "backend": "cuda",
  "threads": 8,
  "models": [
    {
      "id": "vibevoice-streaming-7b",
      "family": "vibevoice_asr_streaming",
      "path": "models/VibeVoice-ASR-Streaming-7B-GGUF/vibevoice-asr-streaming-7b-q8_0.gguf",
      "task": "asr",
      "mode": "streaming"
    }
  ]
}

Then start the server:

build/debug/bin/audiocpp_server --config server.json --log

For live streaming, send 16 kHz mono signed 16-bit PCM to the live endpoint:

ffmpeg -hide_banner -loglevel error -i input.wav -f s16le -ac 1 -ar 16000 - \
  | curl -N -X POST \
      -H 'Content-Type: application/octet-stream' \
      -H 'Transfer-Encoding: chunked' \
      -H 'Expect:' \
      -T - \
      'http://127.0.0.1:8080/v1/audio/transcriptions/live?model=vibevoice-streaming-7b&sample_rate=16000&channels=1&sample_format=s16le'

Files

File	Format	Notes
vibevoice-asr-streaming-7b-bf16.gguf	BF16	Highest precision package.
vibevoice-asr-streaming-7b-q8_0.gguf	Q8_0	Recommended package for audio.cpp.
vibevoice-asr-streaming-7b-q4_k.gguf	Q4_K	Smaller lower-bit package.

Each GGUF is self-contained and embeds the audio.cpp package spec and required sidecars.

Source and license

These GGUF files were converted from the upstream Hugging Face model:

• Upstream repository: https://huggingface.co/microsoft/VibeVoice-ASR-Streaming-7B
• Pinned upstream revision: 60d858b518b4e19d404af3737f848fc185b30177
• Upstream license: MIT

The GGUF conversion preserves the upstream MIT license. See the upstream model card and Microsoft VibeVoice repository for the original model documentation, usage notes, and any responsible-use guidance.