Manuel Muñoz Plá commited on
Commit
f354559
·
verified ·
1 Parent(s): ca0aa2d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ # angular-separation-vit — reproduction checkpoints
6
+
7
+ Final (`_last.pt`) checkpoints backing *"Dos modelos idénticos, dos
8
+ podas distintas: la dirección dominante de $W_O$ bajo intervención
9
+ libre, suave y dura"* ("Same function, different pruning: the
10
+ dominant direction of $W_O$ under free, soft, and hard intervention").
11
+ These are verification artifacts for reproducing the paper's tables —
12
+ not meant as general-purpose pretrained weights.
13
+
14
+ Code: <https://github.com/mmunozpl/angular-separation-vit>
15
+ CSV results derived from these checkpoints: <https://huggingface.co/datasets/ManuelPla/angular-separation-vit-results>
16
+
17
+ ## Layout
18
+
19
+ ```
20
+ vitb_clean/attnA_{base,blanda,dura}_seed{42..46}_last.pt # ancla, n=5
21
+ vitl_clean/attnA_{base,blanda,dura}_seed{42..44}_last.pt # n=3
22
+ dinov2_clean/attnA_base_seed42_last.pt # frozen, n=1
23
+ ```
24
+
25
+ `base` = fine-tuned ViT with no angular regularizer. `blanda` = soft
26
+ angular probe (`R_div`, eq. 5). `dura` = hard variant, reprojected to
27
+ the spherical code after every optimizer step. DINOv2 is analyzed
28
+ frozen (no fine-tuning), hence a single realization.
29
+
30
+ All backbones derive from `timm` pretrained weights (ImageNet-1k for
31
+ ViT-B/16 and ViT-L/16; LVD-142M self-supervised pretraining for
32
+ DINOv2), fine-tuned on ImageNet-100 for the two supervised columns.
33
+ Redistributed under Apache-2.0, consistent with the code license;
34
+ verify compatibility with upstream pretraining licenses before reuse
35
+ beyond reproduction of this paper.
36
+
37
+ ## License
38
+
39
+ Apache-2.0.