Quazim0t0 commited on
Commit
61bbf62
Β·
verified Β·
1 Parent(s): 98ede26

Upload web/TEST_RESULTS.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. web/TEST_RESULTS.md +23 -1
web/TEST_RESULTS.md CHANGED
@@ -8,7 +8,7 @@ against the verified units at init.
8
  |---|---|---|
9
  | `test_core.js` | float trainer converges, replicas bit-identical | PASS β€” loss 33.71 β†’ 0.000000, replica diff 0.000e+0 |
10
  | `test_verified.js` | training THROUGH the int8 units converges, replicas bit-identical | PASS β€” loss 300.6 β†’ 1.41, replica diff 0.000e+0 |
11
- | `test_ieee.js` | the JS epilogue mirror is IEEE-754 spec-correct, not merely agreeable | PASS β€” 500k+ checks, 0 disagreements; rejects the old round-once mirror on 34% of inputs |
12
  | `test_gates.js` | the exact kernel gate rejects real bugs, accepts the real kernel | PASS β€” 5/5 injected bugs rejected, clean kernel accepted, audit sees the sign of zero |
13
  | `test_metamorphic.js` | correctness properties that need no reference implementation | PASS β€” 6/6 properties hold; catches stride/swap/acc= mutants |
14
  | `test_corpus.js` | mutation-scores the oracles with an external bug taxonomy | PASS β€” properties 4/4 (2/2 loop, 2/2 math), differential 4/4, control clean |
@@ -34,6 +34,28 @@ the oracle REJECTS the round-once mirror shipped before: 68314/200000 inputs (34
34
  That last line is the teeth: an oracle that never disagrees with anything
35
  proves nothing. This one rejects the exact bug the old `1e-6` tolerance hid.
36
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
  ## Oracle mutation scores (`test_corpus.js`)
38
 
39
  Bugs ported from an external taxonomy
 
8
  |---|---|---|
9
  | `test_core.js` | float trainer converges, replicas bit-identical | PASS β€” loss 33.71 β†’ 0.000000, replica diff 0.000e+0 |
10
  | `test_verified.js` | training THROUGH the int8 units converges, replicas bit-identical | PASS β€” loss 300.6 β†’ 1.41, replica diff 0.000e+0 |
11
+ | `test_ieee.js` | the JS epilogue mirror is IEEE-754 spec-correct, not merely agreeable | PASS β€” 1.4M+ checks (mul, add, fma), 0 disagreements; rejects the old round-once mirror on 34% of inputs; agrees bit-for-bit with an independent big-int fma golden on 8000 vectors |
12
  | `test_gates.js` | the exact kernel gate rejects real bugs, accepts the real kernel | PASS β€” 5/5 injected bugs rejected, clean kernel accepted, audit sees the sign of zero |
13
  | `test_metamorphic.js` | correctness properties that need no reference implementation | PASS β€” 6/6 properties hold; catches stride/swap/acc= mutants |
14
  | `test_corpus.js` | mutation-scores the oracles with an external bug taxonomy | PASS β€” properties 4/4 (2/2 loop, 2/2 math), differential 4/4, control clean |
 
34
  That last line is the teeth: an oracle that never disagrees with anything
35
  proves nothing. This one rejects the exact bug the old `1e-6` tolerance hid.
36
 
37
+ The oracle now also covers **addition** and **fused multiply-add**:
38
+
39
+ - `addF32Spec` (exact BigInt sum, one rounding) certifies that `fround(a+b)`
40
+ is the correctly-rounded f32 sum (Figueroa: 53 β‰₯ 2Β·24+2 makes the double
41
+ rounding innocuous for add) β€” the fact every per-add mirror schedule in the
42
+ codebase stands on. 300k draws including extreme exponent gaps, 0
43
+ disagreements.
44
+ - `fmaF32Spec` (exact product, never rounded, plus addend, ONE rounding) β€”
45
+ ported from the neural-rdna2 project's from-the-definition fma golden,
46
+ which correctly rejects the float64 shortcut (it double-rounds on rare
47
+ ties). Cross-checked **bit-for-bit against that independent Python
48
+ implementation on 8000 generated vectors** (quantize-domain, catastrophic
49
+ cancellation, raw finite bit patterns): two oracles, two codebases, two
50
+ implementations of the same paragraph of the standard, zero disagreements.
51
+ Fused really is different: it differs from the round-twice composition on
52
+ 100% of cancellation cases.
53
+ - The fma-contraction immunity claim now stands on checked facts instead of
54
+ arguments: on the quantize domain the f64 emulation used by `test_b2b.js`
55
+ equals the true fma (300k draws), and the floor-invisibility result holds
56
+ against the true fma at the binade edges (66k last-ulp diffs, 0
57
+ floor-visible).
58
+
59
  ## Oracle mutation scores (`test_corpus.js`)
60
 
61
  Bugs ported from an external taxonomy