gemma-e2b-rlcd / reports /encoder-check.json
larkooo's picture
Publish Gemma E2B RLCD with multimodal checkpoint and parallel scoring
53e24ca verified
Raw History Blame Contribute Delete
608 Bytes
{
"compute_dtype": "float16",
"state_layers": 4,
"results": [
{
"state": "text",
"native_layer_max_abs_delta": 0.0,
"dense_vs_indexed_embedding_max_abs_delta": 0.0
},
{
"state": "image",
"native_layer_max_abs_delta": 0.0,
"dense_vs_indexed_embedding_max_abs_delta": 0.0
},
{
"state": "speech",
"native_layer_max_abs_delta": 0.0,
"dense_vs_indexed_embedding_max_abs_delta": 0.0
},
{
"state": "video_speech",
"native_layer_max_abs_delta": 0.0,
"dense_vs_indexed_embedding_max_abs_delta": 0.0
}
]
}