Text Ranking
sentence-transformers
Safetensors
Transformers
multilingual
t5gemma2
text2text-generation
reranker
encoder-decoder
FBNL
matryoshka
retrieval
RAG
Yuki131 commited on
Commit
c03cbf7
·
verified ·
1 Parent(s): f01f4eb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -157,6 +157,14 @@ On LMEB-Dialogue, a compact embedding model paired with our Nano reranker, which
157
  ![lmeb](./assets/lmeb.jpg)
158
  ![lmeb_emb](./assets/lmeb_emb.jpg)
159
 
 
 
 
 
 
 
 
 
160
  ### Acknowledgements
161
  We sincerely thank `jina-reranker-v3` and `Qwen3-Reranker` for their valuable inspiration and contributions to the reranking community, from which we have learned a lot.
162
 
 
157
  ![lmeb](./assets/lmeb.jpg)
158
  ![lmeb_emb](./assets/lmeb_emb.jpg)
159
 
160
+ #### Ablation on multi-stage training
161
+
162
+ Across all three model sizes and all seven compression ratios, performance on BEIR and MIRACL improves consistently from Stage 1 to Stage 3, demonstrating the effectiveness of our multi-stage training pipeline. Concretely, Stage 1 establishes a robust foundation for document reranking, distillation in Stage 2 substantially improves performance, and Stage 3 yields further modest gains. More importantly, robustness to compression generally improves across the three training stages. For example, from Stage 1 to Stage 3, the performance retention of KaLM-Reranker-V1-Nano at r = 128 relative to r = 2 increases from 92.88% to 93.80% on BEIR and from 90.93% to 92.15% on MIRACL.
163
+
164
+ ![lmeb_emb](./assets/ablation.jpg)
165
+
166
+ ![kalm-reranker-v1-r2 training](./assets/training.jpg)
167
+
168
  ### Acknowledgements
169
  We sincerely thank `jina-reranker-v3` and `Qwen3-Reranker` for their valuable inspiration and contributions to the reranking community, from which we have learned a lot.
170