Manuel Muñoz Plá commited on
Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,39 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# angular-separation-vit — reproduction checkpoints
|
| 6 |
+
|
| 7 |
+
Final (`_last.pt`) checkpoints backing *"Dos modelos idénticos, dos
|
| 8 |
+
podas distintas: la dirección dominante de $W_O$ bajo intervención
|
| 9 |
+
libre, suave y dura"* ("Same function, different pruning: the
|
| 10 |
+
dominant direction of $W_O$ under free, soft, and hard intervention").
|
| 11 |
+
These are verification artifacts for reproducing the paper's tables —
|
| 12 |
+
not meant as general-purpose pretrained weights.
|
| 13 |
+
|
| 14 |
+
Code: <https://github.com/mmunozpl/angular-separation-vit>
|
| 15 |
+
CSV results derived from these checkpoints: <https://huggingface.co/datasets/ManuelPla/angular-separation-vit-results>
|
| 16 |
+
|
| 17 |
+
## Layout
|
| 18 |
+
|
| 19 |
+
```
|
| 20 |
+
vitb_clean/attnA_{base,blanda,dura}_seed{42..46}_last.pt # ancla, n=5
|
| 21 |
+
vitl_clean/attnA_{base,blanda,dura}_seed{42..44}_last.pt # n=3
|
| 22 |
+
dinov2_clean/attnA_base_seed42_last.pt # frozen, n=1
|
| 23 |
+
```
|
| 24 |
+
|
| 25 |
+
`base` = fine-tuned ViT with no angular regularizer. `blanda` = soft
|
| 26 |
+
angular probe (`R_div`, eq. 5). `dura` = hard variant, reprojected to
|
| 27 |
+
the spherical code after every optimizer step. DINOv2 is analyzed
|
| 28 |
+
frozen (no fine-tuning), hence a single realization.
|
| 29 |
+
|
| 30 |
+
All backbones derive from `timm` pretrained weights (ImageNet-1k for
|
| 31 |
+
ViT-B/16 and ViT-L/16; LVD-142M self-supervised pretraining for
|
| 32 |
+
DINOv2), fine-tuned on ImageNet-100 for the two supervised columns.
|
| 33 |
+
Redistributed under Apache-2.0, consistent with the code license;
|
| 34 |
+
verify compatibility with upstream pretraining licenses before reuse
|
| 35 |
+
beyond reproduction of this paper.
|
| 36 |
+
|
| 37 |
+
## License
|
| 38 |
+
|
| 39 |
+
Apache-2.0.
|