Feature Extraction
OpenCLIP
English
clip
open-clip
vision-language
image-text-retrieval
cross-modal-retrieval
long-context
hyperbolic-learning
hyperbolic-geometry
lorentz-model
eccv-2026
Instructions to use jeeit17/HyFL-CLIP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- OpenCLIP
How to use jeeit17/HyFL-CLIP with OpenCLIP:
import open_clip model, preprocess_train, preprocess_val = open_clip.create_model_and_transforms('hf-hub:jeeit17/HyFL-CLIP') tokenizer = open_clip.get_tokenizer('hf-hub:jeeit17/HyFL-CLIP') - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,8 +24,22 @@ tags:
|
|
| 24 |
|
| 25 |
**ECCV 2026**
|
| 26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
</div>
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
## Model Description
|
| 30 |
|
| 31 |
**HyFL-CLIP** is a hyperbolic fine-tuning framework that improves the robustness of CLIP to long and compositional text descriptions.
|
|
@@ -52,24 +66,9 @@ Summarized tokens, short captions, long-form descriptions, and images are embedd
|
|
| 52 |
|
| 53 |
Token- and phrase-level representations are aggregated using the Lorentzian centroid, also known as the Einstein midpoint. This provides a geometry-consistent method for combining partial representations into whole-level representations.
|
| 54 |
|
| 55 |
-
The main hyperbolic operations include:
|
| 56 |
-
|
| 57 |
-
- exponential and logarithmic maps at the origin;
|
| 58 |
-
- Lorentzian inner products and distances;
|
| 59 |
-
- parallel transport; and
|
| 60 |
-
- Einstein midpoint aggregation.
|
| 61 |
|
| 62 |
## Results
|
| 63 |
|
| 64 |
-
HyFL-CLIP improves long-text cross-modal retrieval and demonstrates greater robustness to textual perturbations.
|
| 65 |
-
|
| 66 |
-
The model reports improvements of up to **19.5%** in long-text cross-modal retrieval under perturbations including:
|
| 67 |
-
|
| 68 |
-
- caption reordering;
|
| 69 |
-
- caption summarization;
|
| 70 |
-
- caption condensation; and
|
| 71 |
-
- partial text deletion.
|
| 72 |
-
|
| 73 |
The evaluation covers:
|
| 74 |
|
| 75 |
- long-context cross-modal retrieval;
|
|
@@ -312,7 +311,3 @@ Please cite the following paper when using HyFL-CLIP:
|
|
| 312 |
}
|
| 313 |
```
|
| 314 |
|
| 315 |
-
## Links
|
| 316 |
-
|
| 317 |
-
- [Project Page](https://janeyeon.github.io/hyflclip/)
|
| 318 |
-
- [Paper](https://arxiv.org/abs/2607.00428)
|
|
|
|
| 24 |
|
| 25 |
**ECCV 2026**
|
| 26 |
|
| 27 |
+
• [Project Page](https://janeyeon.github.io/hyflclip/)
|
| 28 |
+
• [Paper](https://arxiv.org/abs/2607.00428)
|
| 29 |
+
• [Code](https://github.com/janeyeon/hyfl-clip)
|
| 30 |
+
|
| 31 |
</div>
|
| 32 |
|
| 33 |
+
## Overview
|
| 34 |
+
|
| 35 |
+
HyFL-CLIP improves the **robustness of long-context vision-language understanding** by transferring OpenCLIP’s pretrained Euclidean alignment into a **hyperbolic representation space**.
|
| 36 |
+
The model reports improvements of up to **19.5%** in long-text cross-modal retrieval under perturbations including:
|
| 37 |
+
|
| 38 |
+
- caption reordering;
|
| 39 |
+
- caption summarization;
|
| 40 |
+
- caption condensation; and
|
| 41 |
+
- partial text deletion.
|
| 42 |
+
|
| 43 |
## Model Description
|
| 44 |
|
| 45 |
**HyFL-CLIP** is a hyperbolic fine-tuning framework that improves the robustness of CLIP to long and compositional text descriptions.
|
|
|
|
| 66 |
|
| 67 |
Token- and phrase-level representations are aggregated using the Lorentzian centroid, also known as the Einstein midpoint. This provides a geometry-consistent method for combining partial representations into whole-level representations.
|
| 68 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
|
| 70 |
## Results
|
| 71 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
The evaluation covers:
|
| 73 |
|
| 74 |
- long-context cross-modal retrieval;
|
|
|
|
| 311 |
}
|
| 312 |
```
|
| 313 |
|
|
|
|
|
|
|
|
|
|
|
|