etwk commited on
Commit Β·
f704813
1
Parent(s): 93db0e9
Docs: companion-repo note for provenance recipes, qualify dead links, neutral phrasing; gitignore .claude/
Browse files- .gitignore +1 -0
- EVALUATION.md +1 -1
- README.md +9 -5
.gitignore
CHANGED
|
@@ -1,2 +1,3 @@
|
|
| 1 |
__pycache__/
|
| 2 |
*.pyc
|
|
|
|
|
|
| 1 |
__pycache__/
|
| 2 |
*.pyc
|
| 3 |
+
.claude/
|
EVALUATION.md
CHANGED
|
@@ -147,7 +147,7 @@ Reproduce any row with `modchallenge evaluate horner_rnn --total 1100 --seed <he
|
|
| 147 |
This matches the larger faithful 5-prime bootstrap on the shipped weights
|
| 148 |
(`diag_5prime_boot.py` in the research repo): `P(tier < 0.90) β 0.000 %` for tiers 1β9 and
|
| 149 |
β 0.002 % for tier 10; `E[tier10] β 0.991`, worst observed near-max tier-10 prime β 0.875. A
|
| 150 |
-
40k-draw width sweep (`audit_width_robustness.py`) finds **no accuracy "knee"** anywhere in the
|
| 151 |
samplable range β the residual misses are rare per-`(a,b)` reduction-boundary events scattered
|
| 152 |
β uniformly, in the deep tail only.
|
| 153 |
|
|
|
|
| 147 |
This matches the larger faithful 5-prime bootstrap on the shipped weights
|
| 148 |
(`diag_5prime_boot.py` in the research repo): `P(tier < 0.90) β 0.000 %` for tiers 1β9 and
|
| 149 |
β 0.002 % for tier 10; `E[tier10] β 0.991`, worst observed near-max tier-10 prime β 0.875. A
|
| 150 |
+
40k-draw width sweep (`audit_width_robustness.py`, research repo) finds **no accuracy "knee"** anywhere in the
|
| 151 |
samplable range β the residual misses are rare per-`(a,b)` reduction-boundary events scattered
|
| 152 |
β uniformly, in the deep tail only.
|
| 153 |
|
README.md
CHANGED
|
@@ -125,9 +125,10 @@ accuracy, and both are about *matching the test distribution*:
|
|
| 125 |
### Tier 9 and the reduction-boundary position
|
| 126 |
|
| 127 |
The tier-9 prime range is value-uniform on `[2^513, 2^1024)`, so a large fraction of tier-9
|
| 128 |
-
primes are **shorter than 1024 bits**, and the
|
| 129 |
-
|
| 130 |
-
cell trained only on near-`2^1024` primes learns
|
|
|
|
| 131 |
**~0.00 on shorter primes**: tier 9 started at **0.73**, dominated by a single ~1020-bit
|
| 132 |
benchmark prime failing entirely (0/22). The fix is to train on a mix of value-uniform primes
|
| 133 |
(benchmark-faithful) and **bit-length-uniform primes over [990, 1024]** (equal weight to every
|
|
@@ -136,8 +137,11 @@ position. Combined with gradient accumulation (effective batch ~26k) and the wor
|
|
| 136 |
loss, this took tier 9 from **0.73 -> 0.99**, even across prime widths (held-out value-uniform
|
| 137 |
validation 0.99; per-width 1015-1024 all ~0.99).
|
| 138 |
|
| 139 |
-
The training scripts
|
| 140 |
-
|
|
|
|
|
|
|
|
|
|
| 141 |
|
| 142 |
```bash
|
| 143 |
# Historical small-prime cells were first trained width-matched, then absorbed into the shared cell.
|
|
|
|
| 125 |
### Tier 9 and the reduction-boundary position
|
| 126 |
|
| 127 |
The tier-9 prime range is value-uniform on `[2^513, 2^1024)`, so a large fraction of tier-9
|
| 128 |
+
primes are **shorter than 1024 bits**, and the position where the modular reduction must occur
|
| 129 |
+
(`p`'s most-significant set bit) differs per prime width, so the trained convolution must learn
|
| 130 |
+
that boundary at every position. A cell trained only on near-`2^1024` primes learns it at one
|
| 131 |
+
position and scores
|
| 132 |
**~0.00 on shorter primes**: tier 9 started at **0.73**, dominated by a single ~1020-bit
|
| 133 |
benchmark prime failing entirely (0/22). The fix is to train on a mix of value-uniform primes
|
| 134 |
(benchmark-faithful) and **bit-length-uniform primes over [990, 1024]** (equal weight to every
|
|
|
|
| 137 |
loss, this took tier 9 from **0.73 -> 0.99**, even across prime widths (held-out value-uniform
|
| 138 |
validation 0.99; per-width 1015-1024 all ~0.99).
|
| 139 |
|
| 140 |
+
The training scripts and the intermediate checkpoints they reference live in the companion
|
| 141 |
+
research repo (not shipped in this model repo); the commands below document *how the weights were
|
| 142 |
+
obtained* (the provenance the rules ask for) and are not runnable as-is from this repo alone.
|
| 143 |
+
Intermediate warm-start files such as `weights_shared_64_512.pt` are prior in-flight cells, not
|
| 144 |
+
redistributed here.
|
| 145 |
|
| 146 |
```bash
|
| 147 |
# Historical small-prime cells were first trained width-matched, then absorbed into the shared cell.
|