File size: 1,081 Bytes
eca55dc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 | # BEST-RQ-2 (xares-llm encoder)
This folder contains the BEST-RQ-2 audio encoder integration for `xares-llm`.
Benchmark repository: [xiaomi-research/xares-llm](https://github.com/xiaomi-research/xares-llm)
## Setup
1. Make sure the environment to run `xares-llm` is set up properly (virtual environment initialized and the `xares-llm` package downloaded/installed).
2. Add the `BEST-RQ-2` folder to the `xares-llm` (current) directory so it is available at `./BEST-RQ-2`.
3. Before running a `xares-llm` evaluation, you must install the required packages for BEST-RQ-2:
```bash
uv pip install -r BEST-RQ-2/audio-embeddings/pyproject.toml
```
## Run an evaluation
Single task (e.g. to test that everything works):
```bash
uv run -m xares_llm.run BEST-RQ-2.BEST-RQ-2_encoder.BestRQ2Encoder <task> <task> # e.g. replace <task> with esc-50, score should be around 0.48
```
All tasks:
```bash
uv run -m xares_llm.run BEST-RQ-2.BEST-RQ-2_encoder.BestRQ2Encoder all
```
## Help
If you encounter any problems, contact: [ludovic.tuncay@irit.fr](mailto:ludovic.tuncay@irit.fr)
|