WillHeld commited on
Commit
b42a8f2
·
verified ·
1 Parent(s): ddf96a0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -43,7 +43,7 @@ Please reason step by step, and put your final answer within \boxed{}.<|im_end|>
43
  <|im_start|>assistant
44
  ```
45
 
46
- ## Example problems
47
  Append each to the 3-shot prefix above. Sampling: greedy, stop=`<|im_end|>`.
48
 
49
  | Problem | Answer |
@@ -51,8 +51,8 @@ Append each to the 3-shot prefix above. Sampling: greedy, stop=`<|im_end|>`.
51
  | What is the remainder when $2^{10}$ is divided by 7? | 2 |
52
  | A right square pyramid has base edge 6 and lateral edge 5. Find the total area of its four triangular faces. | 48 |
53
  | A right triangle has legs 9 and 12. What is the length of the hypotenuse? | 15 |
54
- | What is the largest prime factor of 2024? | 23 |
55
- | How many positive divisors does 36 have? | 9 |
56
 
57
  ## Capability notes (honest)
58
- RL gave a weak base **genuine but narrow** competence. It reliably executes **short, single-thread computations** (modular cycles, one Pythagorean step, small factorizations) and reasons in the correct shape (steps -> single \boxed{} answer -> clean stop). It is **unreliable on problems requiring multi-term bookkeeping** (combining several intermediate quantities), where it drops terms or slips on arithmetic. ~29% on hard (level 3-5) MATH reflects this. It is a demonstration that the SimpleRL recipe works mechanically on a weak base; it is **not** a strong general math model.
 
43
  <|im_start|>assistant
44
  ```
45
 
46
+ ## Example problems (illustrative of the reliable type; not guaranteed)
47
  Append each to the 3-shot prefix above. Sampling: greedy, stop=`<|im_end|>`.
48
 
49
  | Problem | Answer |
 
51
  | What is the remainder when $2^{10}$ is divided by 7? | 2 |
52
  | A right square pyramid has base edge 6 and lateral edge 5. Find the total area of its four triangular faces. | 48 |
53
  | A right triangle has legs 9 and 12. What is the length of the hypotenuse? | 15 |
54
+ | What is 15% of 80? | 12 |
55
+ | A rectangle has length 8 and width 5. What is its area? | 40 |
56
 
57
  ## Capability notes (honest)
58
+ RL gave a weak base **genuine but narrow** competence, and reasoning in the correct shape (steps -> single \boxed{} answer -> clean stop). It is reliable on problems solvable by **a single operation or one known formula with small/obvious inputs** (e.g. a Pythagorean step, a short modular cycle, a percentage). It is **unreliable** whenever it must (a) **track/combine several quantities** (multi-term word problems) or (b) **discover** something, such as a non-trivial factorization — in these cases it tends to confabulate a relation or factorization and not check it. ~29% on hard (level 3-5) MATH reflects this. It is a demonstration that the SimpleRL recipe works mechanically on a weak base; it is **not** a strong general math model.