Update README.md
Browse files
README.md
CHANGED
|
@@ -61,14 +61,31 @@ Despite being an intermediate checkpoint, the 1st-Stage model demonstrates highl
|
|
| 61 |
|
| 62 |
## 💻 Usage
|
| 63 |
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
## ⚠️ Limitations
|
| 74 |
|
|
|
|
| 61 |
|
| 62 |
## 💻 Usage
|
| 63 |
|
| 64 |
+
Because Diffutron is a Masked Diffusion Language Model, it requires inference strategies distinct from standard causal generation. We recommend using the `dllm` library or custom generation loops tailored for discrete diffusion.
|
| 65 |
+
|
| 66 |
+
### 1. Install the dllm Library:
|
| 67 |
+
```bash
|
| 68 |
+
git clone https://github.com/Diffutron/dllm.git
|
| 69 |
+
cd dllm
|
| 70 |
+
pip install -e .
|
| 71 |
+
```
|
| 72 |
+
### 2. Chat via Interaction Mode:
|
| 73 |
+
|
| 74 |
+
```bash
|
| 75 |
+
python -u examples/bert/chat.py \
|
| 76 |
+
--model_name_or_path "diffutron/DiffutronLM-0.3B-1st-Stage" \
|
| 77 |
+
--chat True \
|
| 78 |
+
--steps 64 \
|
| 79 |
+
--max_new_tokens 64 \
|
| 80 |
+
--temperature 0.1 \
|
| 81 |
+
--block_length 32 \
|
| 82 |
+
--repetition_penalty 1.2 \
|
| 83 |
+
--remasking "low_confidence" \
|
| 84 |
+
--stochastic_transfer False \
|
| 85 |
+
--cfg_scale 0.0
|
| 86 |
+
```
|
| 87 |
+
|
| 88 |
+
For other inference modes, see [dllm](https://github.com/Diffutron/dllm) library.
|
| 89 |
|
| 90 |
## ⚠️ Limitations
|
| 91 |
|