Describe objective as uncha; drop internal codename from card
Browse files
README.md
CHANGED
|
@@ -9,14 +9,12 @@ tags:
|
|
| 9 |
- clip
|
| 10 |
- research
|
| 11 |
- scratch-training
|
| 12 |
-
- hier-beta
|
| 13 |
-
- argent
|
| 14 |
---
|
| 15 |
|
| 16 |
# Hyper3-CLIP beta
|
| 17 |
|
| 18 |
Hyper3-CLIP beta is the hyper³labs ViT-B scratch checkpoint trained with the
|
| 19 |
-
|
| 20 |
|
| 21 |
This repository publishes the raw PyTorch training checkpoint for the completed
|
| 22 |
500k-step paper-scratch run. It is not the older Hyper3-CLIP v0.5
|
|
@@ -27,8 +25,7 @@ SentenceTransformers package.
|
|
| 27 |
- Checkpoint: `checkpoint_final.pt`
|
| 28 |
- Config: `config.yaml`
|
| 29 |
- Training metadata: `metadata.json`
|
| 30 |
-
-
|
| 31 |
-
- Objective: `uncha` with `uncha_entailment_loss: hier_beta_argent`
|
| 32 |
- Vision backbone: `vit_base_patch16_224`
|
| 33 |
- Vision pretrained: `false`
|
| 34 |
- Text model architecture/tokenizer: `openai/clip-vit-base-patch32`
|
|
|
|
| 9 |
- clip
|
| 10 |
- research
|
| 11 |
- scratch-training
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
# Hyper3-CLIP beta
|
| 15 |
|
| 16 |
Hyper3-CLIP beta is the hyper³labs ViT-B scratch checkpoint trained with the
|
| 17 |
+
UNCHA objective.
|
| 18 |
|
| 19 |
This repository publishes the raw PyTorch training checkpoint for the completed
|
| 20 |
500k-step paper-scratch run. It is not the older Hyper3-CLIP v0.5
|
|
|
|
| 25 |
- Checkpoint: `checkpoint_final.pt`
|
| 26 |
- Config: `config.yaml`
|
| 27 |
- Training metadata: `metadata.json`
|
| 28 |
+
- Objective: `uncha` (see `config.yaml` for the full loss configuration)
|
|
|
|
| 29 |
- Vision backbone: `vit_base_patch16_224`
|
| 30 |
- Vision pretrained: `false`
|
| 31 |
- Text model architecture/tokenizer: `openai/clip-vit-base-patch32`
|