Text Ranking
sentence-transformers
Safetensors
Transformers
multilingual
t5gemma2
text2text-generation
reranker
encoder-decoder
FBNL
matryoshka
retrieval
RAG
Instructions to use KaLM-Embedding/KaLM-Reranker-V1-Nano-R2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use KaLM-Embedding/KaLM-Reranker-V1-Nano-R2 with sentence-transformers:
from sentence_transformers import CrossEncoder model = CrossEncoder("KaLM-Embedding/KaLM-Reranker-V1-Nano-R2") query = "Which planet is known as the Red Planet?" passages = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", "Saturn, famous for its rings, is sometimes mistaken for the Red Planet." ] scores = model.predict([(query, passage) for passage in passages]) print(scores) - Transformers
How to use KaLM-Embedding/KaLM-Reranker-V1-Nano-R2 with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("KaLM-Embedding/KaLM-Reranker-V1-Nano-R2") model = AutoModelForMultimodalLM.from_pretrained("KaLM-Embedding/KaLM-Reranker-V1-Nano-R2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -113,7 +113,7 @@ R2 consistently outperforms V1 at every shared compression ratio. The gains incr
|
|
| 113 |
|
| 114 |
|
| 115 |
|
| 116 |
-
## Model family
|
| 117 |
|
| 118 |
| Models | Activated Params. | Non-Embedding Params. | Embedding Params. | #Layers (encoder + decoder) | Sequence Length | Document Token Dim. | MEP Support | Instruction Aware | Test-Time Compute |
|
| 119 |
| ------------------------------------------------------------------------------------------------- | -----------------: | --------------------: | ----------------: | --------------------------: | --------------: | ------------------: | ----------: | ----------------: | ----------------: |
|
|
@@ -124,7 +124,7 @@ R2 consistently outperforms V1 at every shared compression ratio. The gains incr
|
|
| 124 |
The reported sizes are **activated parameters**. Nano, Small, and Large are initialized from the T5Gemma2 270M-270M, 1B-1B, and 4B-4B encoder-decoder families, respectively.
|
| 125 |
|
| 126 |
|
| 127 |
-
# Prompt Template
|
| 128 |
```python
|
| 129 |
f"<Document>: {document}"
|
| 130 |
|
|
@@ -142,10 +142,22 @@ The reported sizes are **activated parameters**. Nano, Small, and Large are init
|
|
| 142 |
|
| 143 |

|
| 144 |
|
| 145 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 146 |
We sincerely thank `jina-reranker-v3` and `Qwen3-Reranker` for their valuable inspiration and contributions to the reranking community, from which we have learned a lot.
|
| 147 |
|
| 148 |
-
# Citation
|
| 149 |
If you find this model useful, please consider citing our papers.
|
| 150 |
```
|
| 151 |
@misc{zhao2026kalmrerankerv1,
|
|
@@ -179,5 +191,5 @@ If you find this model useful, please consider citing our papers.
|
|
| 179 |
}
|
| 180 |
```
|
| 181 |
|
| 182 |
-
## Contact
|
| 183 |
If you encounter any issues, feel free to contact us via the email: <zhaoxinping@stu.hit.edu.cn>
|
|
|
|
| 113 |
|
| 114 |
|
| 115 |
|
| 116 |
+
### Model family
|
| 117 |
|
| 118 |
| Models | Activated Params. | Non-Embedding Params. | Embedding Params. | #Layers (encoder + decoder) | Sequence Length | Document Token Dim. | MEP Support | Instruction Aware | Test-Time Compute |
|
| 119 |
| ------------------------------------------------------------------------------------------------- | -----------------: | --------------------: | ----------------: | --------------------------: | --------------: | ------------------: | ----------: | ----------------: | ----------------: |
|
|
|
|
| 124 |
The reported sizes are **activated parameters**. Nano, Small, and Large are initialized from the T5Gemma2 270M-270M, 1B-1B, and 4B-4B encoder-decoder families, respectively.
|
| 125 |
|
| 126 |
|
| 127 |
+
### Prompt Template
|
| 128 |
```python
|
| 129 |
f"<Document>: {document}"
|
| 130 |
|
|
|
|
| 142 |
|
| 143 |

|
| 144 |
|
| 145 |
+
|
| 146 |
+
### Evaluation
|
| 147 |
+
#### BEIR
|
| 148 |
+
|
| 149 |
+
The KaLM-Reranker-V1 series matches or outperforms strong industrial rerankers from the Qwen, BGE, Jina, and Mxbai families.
|
| 150 |
+

|
| 151 |
+
|
| 152 |
+
#### MIRACL
|
| 153 |
+
KaLM-Reranker-V1 achieves competitive performance on MIRACL. Within its parameter group, KaLM-Reranker-V1-Large ranks first in 11 of the 18 languages (i.e., ar, bn, de, en, es, fi, fr, ja,
|
| 154 |
+
ko, ru, and sw); six of these languages (i.e., en, es, de, ja, fr, and ru) have reported website usage rates totaling approximately 74.2% among websites with known content languages ([W3Techs, 2026](https://w3techs.com/technologies/overview/content_language)).
|
| 155 |
+

|
| 156 |
+
|
| 157 |
+
### Acknowledgements
|
| 158 |
We sincerely thank `jina-reranker-v3` and `Qwen3-Reranker` for their valuable inspiration and contributions to the reranking community, from which we have learned a lot.
|
| 159 |
|
| 160 |
+
### Citation
|
| 161 |
If you find this model useful, please consider citing our papers.
|
| 162 |
```
|
| 163 |
@misc{zhao2026kalmrerankerv1,
|
|
|
|
| 191 |
}
|
| 192 |
```
|
| 193 |
|
| 194 |
+
### Contact
|
| 195 |
If you encounter any issues, feel free to contact us via the email: <zhaoxinping@stu.hit.edu.cn>
|