olmo-compassion-part1 / eval /retention.json
sparrow8i8's picture
Anchor eval: TAC (fixed, 52) + Betley + HarvestBench + retention
141c20e verified
Raw History Blame Contribute Delete
307 Bytes
{
"arm": "olmo-compassion",
"n_docs": 200,
"max_tokens": 2048,
"results": {
"pretrained": {
"loss": 2.9418,
"retained": 0.0
},
"midtrained": {
"loss": 1.6292,
"retained": 1.0
},
"CompassioninMachineLearning/olmo-compassion-part1": {
"loss": 1.8086,
"retained": 0.863
}
}
}