|
Download ABLATION_SAMPLES.md from Shivam3002/OxMini: direct link, hf CLI and curl.
- Browser
- Download file 3.22 kB
-
https://huggingface.co/Shivam3002/OxMini/resolve/main/ABLATION_SAMPLES.md
- Command line
-
hf download hf://Shivam3002/OxMini/ABLATION_SAMPLES.md
-
curl -L -o ABLATION_SAMPLES.md https://huggingface.co/Shivam3002/OxMini/resolve/main/ABLATION_SAMPLES.md
3.22 kB
| # OxMini ablation samples | |
| These are the unedited fixed-prompt generations from the three matched 120-step runs (seed 1337, top-k 40). They are preserved to make the qualitative comparison auditable rather than reducing it to a subjective summary. | |
| ## Plain GPT baseline | |
| ### `ROMEO:\n`, temperature 0.7 | |
| ```text | |
| ROMEO: | |
| ABEVIUU o d He indRTIad ratomenwerein un mangcou ad rind | |
| MESinee d | |
| KOKL'ades th | |
| ``` | |
| ### `ROMEO:\n`, temperature 1.0 | |
| ```text | |
| ROMEO: | |
| Yerm: | |
| -h | |
| TAVooceoom t to ieund, | |
| qA! | |
| Whg reunth ad mIOCTiokin rSme is ate ule his | |
| ``` | |
| ### `KING:\n`, temperature 0.7 | |
| ```text | |
| KING: | |
| ABe nou o d He indRTcbd ratomenwerein un mangcou ad rind | |
| MESinee d | |
| KOKL:auso th | |
| ``` | |
| ### `KING:\n`, temperature 1.0 | |
| ```text | |
| KING: | |
| Y ym: | |
| -h | |
| TAVooceoom t to ieund, | |
| qA! | |
| Whg reunth ad mIOCTiokin rSme i? | |
| :te ule his | |
| ``` | |
| ### `First Citizen:\n`, temperature 0.7 | |
| ```text | |
| First Citizen: | |
| Ane nouso d He indRTcbd ratomenwerein un mangcou ad rind | |
| MjubCee d | |
| KOes auso th | |
| ``` | |
| ### `First Citizen:\n`, temperature 1.0 | |
| ```text | |
| First Citizen: | |
| Yerm: | |
| -h | |
| Thaooceoomy, thoieund, | |
| qAbe yg reunth ad mI asiokin rSme is ate ule his | |
| ``` | |
| ## Hybrid KDA-lite/MLA-lite, one stream | |
| ### `ROMEO:\n`, temperature 0.7 | |
| ```text | |
| ROMEO: | |
| And of so do me and cbd rathes with thaw maHJone ad rind | |
| MourCHAjut thes ad a th | |
| ``` | |
| ### `ROMEO:\n`, temperature 1.0 | |
| ```text | |
| ROMEO: | |
| Yerm: | |
| -hOuraooch's the to wund, | |
| qAbe hghreunto ad mIOCTIZkinHKS'iti? | |
| , stull his | |
| ``` | |
| ### `KING:\n`, temperature 0.7 | |
| ```text | |
| KING: | |
| And of so do me and cbd rathes with thaw maHN'se ad rind | |
| MourCHAjut thes ad a th | |
| ``` | |
| ### `KING:\n`, temperature 1.0 | |
| ```text | |
| KING: | |
| Yerm: | |
| -hOuraoA: | |
| Fom tHMHoieund, | |
| qAbe hghreunto ad mIOCTIZkinHKSjet ? | |
| , stull his | |
| ``` | |
| ### `First Citizen:\n`, temperature 0.7 | |
| ```text | |
| First Citizen: | |
| And on so do me and cbd rathes with thaw maHN'se ad rind | |
| MourCHAjut thes ad a th | |
| ``` | |
| ### `First Citizen:\n`, temperature 1.0 | |
| ```text | |
| First Citizen: | |
| Yerm: | |
| -hOuraoA: | |
| Fom tHMHoieund, | |
| qAbe hghreunto ad mIOCTIZkinHKS'iti? | |
| , stull his | |
| ``` | |
| ## Full OxMini hybrid + mHC-lite | |
| ### `ROMEO:\n`, temperature 0.7 | |
| ```text | |
| ROMEO: | |
| Her no st do me and cbd ratorst lonit and pelcou ad rind | |
| Moubiee se thes ad a th | |
| ``` | |
| ### `ROMEO:\n`, temperature 1.0 | |
| ```text | |
| ROMEO: | |
| Yerm: | |
| -zONA;oA: | |
| Fom to to eund, | |
| qube hghreumy tad mIOCTI?Ol or me i? | |
| , stule his | |
| ``` | |
| ### `KING:\n`, temperature 0.7 | |
| ```text | |
| KING: | |
| And not ond hen and cbd ratorst lonit and pelcou ad rind | |
| Moubiee se thes ad a th | |
| ``` | |
| ### `KING:\n`, temperature 1.0 | |
| ```text | |
| KING: | |
| Yerm: | |
| -zONA;oA: | |
| Fom to to eund, | |
| qube hghreumy tad mIOCTI?Ol or me i? | |
| , stule his | |
| ``` | |
| ### `First Citizen:\n`, temperature 0.7 | |
| ```text | |
| First Citizen: | |
| And not ond hen and cbd ratorst lonit and pelcou ad rind | |
| Moubiee se thes ad a th | |
| ``` | |
| ### `First Citizen:\n`, temperature 1.0 | |
| ```text | |
| First Citizen: | |
| Yerm: | |
| -hOuraoA: | |
| Fom to to eunr: | |
| qube hghreumy tad mI as okindrome i? | |
| , stule his | |
| ``` | |
| ## Qualitative reading | |
| All three models are still mostly garbled after only 120 updates. Hybrid and full OxMini emit more word-like fragments and slightly more stable speaker formatting than baseline, consistent with their lower held-out loss, but the difference is not strong enough to claim useful language ability. The full mHC-lite arm is not visibly better than hybrid-only. | |