suayptalha commited on
Commit
2fe4bf1
·
verified ·
1 Parent(s): 478d8b6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -69,6 +69,30 @@ The model was evaluated on a representative subset of the **CETVEL Benchmark Sui
69
 
70
  Because Diffutron is a Masked Diffusion Language Model, it requires inference strategies distinct from standard causal generation. We recommend using the `dllm` library or custom generation loops tailored for discrete diffusion.
71
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
  ### Generation Parameters Used in Paper:
73
  * **Longer Context:** Steps: 128, Temp: 0.1, Block Length: 32, Repetition Penalty: 1.2
74
  * **Shorter Context:** Steps: 64, Remask: `low_conf`, Stochastic: `False`, CFG: 0.0
 
69
 
70
  Because Diffutron is a Masked Diffusion Language Model, it requires inference strategies distinct from standard causal generation. We recommend using the `dllm` library or custom generation loops tailored for discrete diffusion.
71
 
72
+ ### 1. Install the dllm Library:
73
+ ```bash
74
+ git clone https://github.com/Diffutron/dllm.git
75
+ cd dllm
76
+ pip install -e .
77
+ ```
78
+ ### 2. Chat via Interaction Mode:
79
+
80
+ ```bash
81
+ python -u examples/bert/chat.py \
82
+ --model_name_or_path "diffutron/DiffutronLM-0.3B-Instruct" \
83
+ --chat True \
84
+ --steps 64 \
85
+ --max_new_tokens 64 \
86
+ --temperature 0.1 \
87
+ --block_length 32 \
88
+ --repetition_penalty 1.2 \
89
+ --remasking "low_confidence" \
90
+ --stochastic_transfer False \
91
+ --cfg_scale 0.0
92
+ ```
93
+
94
+ For other inference modes, see [dllm](https://github.com/Diffutron/dllm) library.
95
+
96
  ### Generation Parameters Used in Paper:
97
  * **Longer Context:** Steps: 128, Temp: 0.1, Block Length: 32, Repetition Penalty: 1.2
98
  * **Shorter Context:** Steps: 64, Remask: `low_conf`, Stochastic: `False`, CFG: 0.0