DeanoCalver commited on
Commit
5a3bcd0
·
verified ·
1 Parent(s): 9108823

Uniform ROCmFPX baseline quant of DeepSeek-V4-Flash-0731

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +85 -0
  3. ds4-0731-uniform.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ds4-0731-uniform.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: deepseek-ai/DeepSeek-V4-Flash-0731
4
+ tags:
5
+ - gguf
6
+ - deepseek
7
+ - rocm
8
+ - strix-halo
9
+ - quantized
10
+ ---
11
+
12
+ # DeepSeek-V4-Flash-0731 — ROCmFPX (uniform baseline)
13
+
14
+ A ROCmFPX GGUF quantization of **DeepSeek-V4-Flash-0731**, built to run the full target
15
+ locally on AMD Strix Halo (Ryzen AI MAX+ 395 / Radeon 8060S) in unified memory.
16
+
17
+ **This is a baseline, deliberately.** The format assignment here is uniform by tensor role
18
+ — the same public ROCmFPX recipe, applied to the new checkpoint. It exists so that our own
19
+ adaptive-format work has an honest "before" to be measured against, on the same checkpoint,
20
+ with the same harness. It is not the interesting artifact; it is the control.
21
+
22
+ ## What's in it
23
+
24
+ | role | qtype | name | block | bits/weight | tensors |
25
+ |---|---|---|---|---|---|
26
+ | attention, dense | 101 | `Q4_0_ROCMFP4_FAST` | 17 B / 32 | 4.25 | 660 |
27
+ | down projections | 104 | `Q3_0_ROCMFPX` | 14 B / 32 | 3.50 | 43 |
28
+ | gate / up projections | 107 | `Q2_0_ROCMFP2` | 10 B / 32 | 2.50 | 86 |
29
+ | passthrough (norms, embeddings, router) | — | F32 / Q6_K | — | — | 539 |
30
+
31
+ 1328 tensors, single file, no companion sidecar required. The qtype histogram is an exact
32
+ match to the published preview-era ROCmFPX artifact, which is what makes it a fair control:
33
+ the format is held fixed and only the checkpoint differs.
34
+
35
+ ## What it is not
36
+
37
+ - **Not the Lucebox artifact.** [Lucebox's published
38
+ ROCMFPX GGUF](https://huggingface.co/Lucebox/DeepSeek-V4-Flash-ROCMFPX) is built from the
39
+ *preview* checkpoint. This is an independent build from `0731`, matching their format.
40
+ - **Not adaptive.** No learned codebooks, no per-expert format selection. Those land in
41
+ separate repos.
42
+ - **Not imatrix-calibrated.** There is no calibration input at all: the assignment is fixed
43
+ by role in the export plan. If you are used to seeing `quantize.imatrix.*` keys in a GGUF
44
+ of this family, their absence here is correct and deliberate — see below.
45
+
46
+ ## Metadata provenance
47
+
48
+ This artifact was assembled using a metadata template taken from a published GGUF of the
49
+ same family, and it initially inherited that file's `quantize.imatrix.*` keys — which
50
+ described an imatrix calibration on someone else's build machine that played no part in
51
+ producing these weights. Those keys have been removed. What remains:
52
+
53
+ ```
54
+ general.name = DeepSeek-V4-Flash-0731-ROCMFPX
55
+ geoquant.source_model = deepseek-ai/DeepSeek-V4-Flash-0731
56
+ geoquant.format = ROCmFPX uniform 101/104/107
57
+ geoquant.calibration = none
58
+ ```
59
+
60
+ If a GGUF's metadata claims a method that did not produce it, every downstream comparison
61
+ built on it is quietly wrong. Worth checking on any quant, not just this one.
62
+
63
+ ## Speculative decode
64
+
65
+ Pair with the drafter for DSpark speculative decode:
66
+ **[DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF](https://huggingface.co/Geometric-AI/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF)**
67
+ — extracted from this checkpoint's integrated MTP head, so it is matched to this target.
68
+
69
+ ## Measurements
70
+
71
+ **Not published here yet.** Throughput, prefill, accept rate and quality for this baseline
72
+ and for the adaptive variants are being measured under one protocol on one box, and will be
73
+ reported together. A number measured here and compared against a number quoted from
74
+ somewhere else is not a comparison, so we would rather wait.
75
+
76
+ ## Integrity
77
+
78
+ ```
79
+ sha256 24cacd61f17bd189807d2ea51aadbde81ff15f69c4f6e358c34952bbe58dbea8
80
+ file ds4-0731-uniform.gguf (102,320,631,200 bytes)
81
+ ```
82
+
83
+ ## License
84
+
85
+ MIT, inherited from the base model.
ds4-0731-uniform.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24cacd61f17bd189807d2ea51aadbde81ff15f69c4f6e358c34952bbe58dbea8
3
+ size 102320631200