Batched generation (batch_size > 1) produces incorrect outputs β possible causal mask issue?
#9 opened about 6 hours ago
by
vconchel
Differences in the results of the reproduction test on lm-evaluation-harness
1
#8 opened 13 days ago
by
ThreeGold116
difference definition of eos token id in config.json and tokenizer_config.json
1
#7 opened about 1 month ago
by
ThreeGold116
Inference with ChatML Template
#6 opened about 1 month ago
by
ThreeGold116
LoRA Merge - Package Available
#4 opened about 2 months ago
by
EVillacis
Fix for KV Cache Bug - ouro-cache-fix Package
π
3
3
#3 opened 2 months ago
by
EVillacis
Bytedance_ouro-1.4B.ipynb Colab Notebook
π
1
#2 opened 2 months ago
by
Javedalam