etwk commited on
Commit
f704813
Β·
1 Parent(s): 93db0e9

Docs: companion-repo note for provenance recipes, qualify dead links, neutral phrasing; gitignore .claude/

Browse files
Files changed (3) hide show
  1. .gitignore +1 -0
  2. EVALUATION.md +1 -1
  3. README.md +9 -5
.gitignore CHANGED
@@ -1,2 +1,3 @@
1
  __pycache__/
2
  *.pyc
 
 
1
  __pycache__/
2
  *.pyc
3
+ .claude/
EVALUATION.md CHANGED
@@ -147,7 +147,7 @@ Reproduce any row with `modchallenge evaluate horner_rnn --total 1100 --seed <he
147
  This matches the larger faithful 5-prime bootstrap on the shipped weights
148
  (`diag_5prime_boot.py` in the research repo): `P(tier < 0.90) β‰ˆ 0.000 %` for tiers 1–9 and
149
  β‰ˆ 0.002 % for tier 10; `E[tier10] β‰ˆ 0.991`, worst observed near-max tier-10 prime β‰ˆ 0.875. A
150
- 40k-draw width sweep (`audit_width_robustness.py`) finds **no accuracy "knee"** anywhere in the
151
  samplable range β€” the residual misses are rare per-`(a,b)` reduction-boundary events scattered
152
  β‰ˆ uniformly, in the deep tail only.
153
 
 
147
  This matches the larger faithful 5-prime bootstrap on the shipped weights
148
  (`diag_5prime_boot.py` in the research repo): `P(tier < 0.90) β‰ˆ 0.000 %` for tiers 1–9 and
149
  β‰ˆ 0.002 % for tier 10; `E[tier10] β‰ˆ 0.991`, worst observed near-max tier-10 prime β‰ˆ 0.875. A
150
+ 40k-draw width sweep (`audit_width_robustness.py`, research repo) finds **no accuracy "knee"** anywhere in the
151
  samplable range β€” the residual misses are rare per-`(a,b)` reduction-boundary events scattered
152
  β‰ˆ uniformly, in the deep tail only.
153
 
README.md CHANGED
@@ -125,9 +125,10 @@ accuracy, and both are about *matching the test distribution*:
125
  ### Tier 9 and the reduction-boundary position
126
 
127
  The tier-9 prime range is value-uniform on `[2^513, 2^1024)`, so a large fraction of tier-9
128
- primes are **shorter than 1024 bits**, and the conditional-subtraction reduction boundary
129
- lands at `p`'s most-significant set bit β€” at a *different position* for each prime width. A
130
- cell trained only on near-`2^1024` primes learns that boundary at one position and scores
 
131
  **~0.00 on shorter primes**: tier 9 started at **0.73**, dominated by a single ~1020-bit
132
  benchmark prime failing entirely (0/22). The fix is to train on a mix of value-uniform primes
133
  (benchmark-faithful) and **bit-length-uniform primes over [990, 1024]** (equal weight to every
@@ -136,8 +137,11 @@ position. Combined with gradient accumulation (effective batch ~26k) and the wor
136
  loss, this took tier 9 from **0.73 -> 0.99**, even across prime widths (held-out value-uniform
137
  validation 0.99; per-width 1015-1024 all ~0.99).
138
 
139
- The training scripts live in the companion research repo (not shipped in this model repo); the
140
- commands below document *how the weights were obtained* (the provenance the rules ask for):
 
 
 
141
 
142
  ```bash
143
  # Historical small-prime cells were first trained width-matched, then absorbed into the shared cell.
 
125
  ### Tier 9 and the reduction-boundary position
126
 
127
  The tier-9 prime range is value-uniform on `[2^513, 2^1024)`, so a large fraction of tier-9
128
+ primes are **shorter than 1024 bits**, and the position where the modular reduction must occur
129
+ (`p`'s most-significant set bit) differs per prime width, so the trained convolution must learn
130
+ that boundary at every position. A cell trained only on near-`2^1024` primes learns it at one
131
+ position and scores
132
  **~0.00 on shorter primes**: tier 9 started at **0.73**, dominated by a single ~1020-bit
133
  benchmark prime failing entirely (0/22). The fix is to train on a mix of value-uniform primes
134
  (benchmark-faithful) and **bit-length-uniform primes over [990, 1024]** (equal weight to every
 
137
  loss, this took tier 9 from **0.73 -> 0.99**, even across prime widths (held-out value-uniform
138
  validation 0.99; per-width 1015-1024 all ~0.99).
139
 
140
+ The training scripts and the intermediate checkpoints they reference live in the companion
141
+ research repo (not shipped in this model repo); the commands below document *how the weights were
142
+ obtained* (the provenance the rules ask for) and are not runnable as-is from this repo alone.
143
+ Intermediate warm-start files such as `weights_shared_64_512.pt` are prior in-flight cells, not
144
+ redistributed here.
145
 
146
  ```bash
147
  # Historical small-prime cells were first trained width-matched, then absorbed into the shared cell.