Upload web/TEST_RESULTS.md with huggingface_hub
Browse files- web/TEST_RESULTS.md +23 -1
web/TEST_RESULTS.md
CHANGED
|
@@ -8,7 +8,7 @@ against the verified units at init.
|
|
| 8 |
|---|---|---|
|
| 9 |
| `test_core.js` | float trainer converges, replicas bit-identical | PASS β loss 33.71 β 0.000000, replica diff 0.000e+0 |
|
| 10 |
| `test_verified.js` | training THROUGH the int8 units converges, replicas bit-identical | PASS β loss 300.6 β 1.41, replica diff 0.000e+0 |
|
| 11 |
-
| `test_ieee.js` | the JS epilogue mirror is IEEE-754 spec-correct, not merely agreeable | PASS β
|
| 12 |
| `test_gates.js` | the exact kernel gate rejects real bugs, accepts the real kernel | PASS β 5/5 injected bugs rejected, clean kernel accepted, audit sees the sign of zero |
|
| 13 |
| `test_metamorphic.js` | correctness properties that need no reference implementation | PASS β 6/6 properties hold; catches stride/swap/acc= mutants |
|
| 14 |
| `test_corpus.js` | mutation-scores the oracles with an external bug taxonomy | PASS β properties 4/4 (2/2 loop, 2/2 math), differential 4/4, control clean |
|
|
@@ -34,6 +34,28 @@ the oracle REJECTS the round-once mirror shipped before: 68314/200000 inputs (34
|
|
| 34 |
That last line is the teeth: an oracle that never disagrees with anything
|
| 35 |
proves nothing. This one rejects the exact bug the old `1e-6` tolerance hid.
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
## Oracle mutation scores (`test_corpus.js`)
|
| 38 |
|
| 39 |
Bugs ported from an external taxonomy
|
|
|
|
| 8 |
|---|---|---|
|
| 9 |
| `test_core.js` | float trainer converges, replicas bit-identical | PASS β loss 33.71 β 0.000000, replica diff 0.000e+0 |
|
| 10 |
| `test_verified.js` | training THROUGH the int8 units converges, replicas bit-identical | PASS β loss 300.6 β 1.41, replica diff 0.000e+0 |
|
| 11 |
+
| `test_ieee.js` | the JS epilogue mirror is IEEE-754 spec-correct, not merely agreeable | PASS β 1.4M+ checks (mul, add, fma), 0 disagreements; rejects the old round-once mirror on 34% of inputs; agrees bit-for-bit with an independent big-int fma golden on 8000 vectors |
|
| 12 |
| `test_gates.js` | the exact kernel gate rejects real bugs, accepts the real kernel | PASS β 5/5 injected bugs rejected, clean kernel accepted, audit sees the sign of zero |
|
| 13 |
| `test_metamorphic.js` | correctness properties that need no reference implementation | PASS β 6/6 properties hold; catches stride/swap/acc= mutants |
|
| 14 |
| `test_corpus.js` | mutation-scores the oracles with an external bug taxonomy | PASS β properties 4/4 (2/2 loop, 2/2 math), differential 4/4, control clean |
|
|
|
|
| 34 |
That last line is the teeth: an oracle that never disagrees with anything
|
| 35 |
proves nothing. This one rejects the exact bug the old `1e-6` tolerance hid.
|
| 36 |
|
| 37 |
+
The oracle now also covers **addition** and **fused multiply-add**:
|
| 38 |
+
|
| 39 |
+
- `addF32Spec` (exact BigInt sum, one rounding) certifies that `fround(a+b)`
|
| 40 |
+
is the correctly-rounded f32 sum (Figueroa: 53 β₯ 2Β·24+2 makes the double
|
| 41 |
+
rounding innocuous for add) β the fact every per-add mirror schedule in the
|
| 42 |
+
codebase stands on. 300k draws including extreme exponent gaps, 0
|
| 43 |
+
disagreements.
|
| 44 |
+
- `fmaF32Spec` (exact product, never rounded, plus addend, ONE rounding) β
|
| 45 |
+
ported from the neural-rdna2 project's from-the-definition fma golden,
|
| 46 |
+
which correctly rejects the float64 shortcut (it double-rounds on rare
|
| 47 |
+
ties). Cross-checked **bit-for-bit against that independent Python
|
| 48 |
+
implementation on 8000 generated vectors** (quantize-domain, catastrophic
|
| 49 |
+
cancellation, raw finite bit patterns): two oracles, two codebases, two
|
| 50 |
+
implementations of the same paragraph of the standard, zero disagreements.
|
| 51 |
+
Fused really is different: it differs from the round-twice composition on
|
| 52 |
+
100% of cancellation cases.
|
| 53 |
+
- The fma-contraction immunity claim now stands on checked facts instead of
|
| 54 |
+
arguments: on the quantize domain the f64 emulation used by `test_b2b.js`
|
| 55 |
+
equals the true fma (300k draws), and the floor-invisibility result holds
|
| 56 |
+
against the true fma at the binade edges (66k last-ulp diffs, 0
|
| 57 |
+
floor-visible).
|
| 58 |
+
|
| 59 |
## Oracle mutation scores (`test_corpus.js`)
|
| 60 |
|
| 61 |
Bugs ported from an external taxonomy
|