Update README.md
Browse files
README.md
CHANGED
|
@@ -69,6 +69,30 @@ The model was evaluated on a representative subset of the **CETVEL Benchmark Sui
|
|
| 69 |
|
| 70 |
Because Diffutron is a Masked Diffusion Language Model, it requires inference strategies distinct from standard causal generation. We recommend using the `dllm` library or custom generation loops tailored for discrete diffusion.
|
| 71 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
### Generation Parameters Used in Paper:
|
| 73 |
* **Longer Context:** Steps: 128, Temp: 0.1, Block Length: 32, Repetition Penalty: 1.2
|
| 74 |
* **Shorter Context:** Steps: 64, Remask: `low_conf`, Stochastic: `False`, CFG: 0.0
|
|
|
|
| 69 |
|
| 70 |
Because Diffutron is a Masked Diffusion Language Model, it requires inference strategies distinct from standard causal generation. We recommend using the `dllm` library or custom generation loops tailored for discrete diffusion.
|
| 71 |
|
| 72 |
+
### 1. Install the dllm Library:
|
| 73 |
+
```bash
|
| 74 |
+
git clone https://github.com/Diffutron/dllm.git
|
| 75 |
+
cd dllm
|
| 76 |
+
pip install -e .
|
| 77 |
+
```
|
| 78 |
+
### 2. Chat via Interaction Mode:
|
| 79 |
+
|
| 80 |
+
```bash
|
| 81 |
+
python -u examples/bert/chat.py \
|
| 82 |
+
--model_name_or_path "diffutron/DiffutronLM-0.3B-Instruct" \
|
| 83 |
+
--chat True \
|
| 84 |
+
--steps 64 \
|
| 85 |
+
--max_new_tokens 64 \
|
| 86 |
+
--temperature 0.1 \
|
| 87 |
+
--block_length 32 \
|
| 88 |
+
--repetition_penalty 1.2 \
|
| 89 |
+
--remasking "low_confidence" \
|
| 90 |
+
--stochastic_transfer False \
|
| 91 |
+
--cfg_scale 0.0
|
| 92 |
+
```
|
| 93 |
+
|
| 94 |
+
For other inference modes, see [dllm](https://github.com/Diffutron/dllm) library.
|
| 95 |
+
|
| 96 |
### Generation Parameters Used in Paper:
|
| 97 |
* **Longer Context:** Steps: 128, Temp: 0.1, Block Length: 32, Repetition Penalty: 1.2
|
| 98 |
* **Shorter Context:** Steps: 64, Remask: `low_conf`, Stochastic: `False`, CFG: 0.0
|