N8Programs commited on
Commit
7c0f24d
·
verified ·
1 Parent(s): ae597ef

Use cross-version split Qwen3-MoE expert layout

Browse files
Files changed (2) hide show
  1. README.md +4 -1
  2. model.safetensors +2 -2
README.md CHANGED
@@ -66,7 +66,10 @@ BOS 8190, and PAD 8191.
66
  | Maximum exported context | 32,768 |
67
  | Published weight dtype | BF16 |
68
 
69
- The checkpoint uses the stock Transformers `Qwen3MoeForCausalLM` layout.
 
 
 
70
 
71
  ## Tokenizer
72
 
 
66
  | Maximum exported context | 32,768 |
67
  | Published weight dtype | BF16 |
68
 
69
+ The checkpoint uses the stock Transformers `Qwen3MoeForCausalLM` layout. MoE
70
+ expert weights are stored as per-expert `gate_proj`, `up_proj`, and `down_proj`
71
+ tensors for compatibility across Transformers releases; loading has been tested
72
+ with Transformers 4.57.1 and 5.11.0.
73
 
74
  ## Tokenizer
75
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d6127bc3df898c2e30efee0cf9f01e13035c895af6f618e4830fea589ca30d91
3
- size 344125920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88d6175774185c2a373126a46b064d0a9c3a2bc9a0546d8b502f0d76d0a8318c
3
+ size 344168016