Instructions to use RESMP-DEV/LFM2.5-Encoder-230M-Code-BF16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use RESMP-DEV/LFM2.5-Encoder-230M-Code-BF16 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="RESMP-DEV/LFM2.5-Encoder-230M-Code-BF16", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("RESMP-DEV/LFM2.5-Encoder-230M-Code-BF16", trust_remote_code=True) model = AutoModel.from_pretrained("RESMP-DEV/LFM2.5-Encoder-230M-Code-BF16", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add files using upload-large-folder tool
Browse files
README.md
CHANGED
|
@@ -73,8 +73,9 @@ vectors = F.normalize((hidden * mask).sum(1) / mask.sum(1), dim=-1)
|
|
| 73 |
|
| 74 |
## Training and data receipts
|
| 75 |
|
| 76 |
-
Full-backbone symmetric in-batch InfoNCE training used 24,626
|
| 77 |
-
|
|
|
|
| 78 |
training report records the NVIDIA RTX A6000 runtime and validation history.
|
| 79 |
|
| 80 |
- `train`: 42,626 rows, SHA-256 `426ebfaad34b14d7627ba6e668ae36e08e548c9d057b0edc208bcfa6fe527629`
|
|
|
|
| 73 |
|
| 74 |
## Training and data receipts
|
| 75 |
|
| 76 |
+
Full-backbone symmetric in-batch InfoNCE training used 24,626
|
| 77 |
+
language-balanced pairs selected from the 42,626-row source training
|
| 78 |
+
split, two epochs, batch size 32, learning rate 2e-5, temperature 0.05, and seed 17. The
|
| 79 |
training report records the NVIDIA RTX A6000 runtime and validation history.
|
| 80 |
|
| 81 |
- `train`: 42,626 rows, SHA-256 `426ebfaad34b14d7627ba6e668ae36e08e548c9d057b0edc208bcfa6fe527629`
|
artifact_manifest.json
CHANGED
|
@@ -14,8 +14,8 @@
|
|
| 14 |
"sha256": "0e920ae71b97a4e96633c212099b9df56f3fba4de2535d13f51a8dbf4595cf0a"
|
| 15 |
},
|
| 16 |
"README.md": {
|
| 17 |
-
"bytes":
|
| 18 |
-
"sha256": "
|
| 19 |
},
|
| 20 |
"benchmarks/jina-code-calibrated-4k.json": {
|
| 21 |
"bytes": 5151,
|
|
@@ -38,8 +38,8 @@
|
|
| 38 |
"sha256": "d62f44c1a8514dccf749630b9b4ba2da240588c2eae6af93b1816003a29e025d"
|
| 39 |
},
|
| 40 |
"benchmarks/lfm25-230m-gptq-mxfp8-vs-bf16-bootstrap.json": {
|
| 41 |
-
"bytes":
|
| 42 |
-
"sha256": "
|
| 43 |
},
|
| 44 |
"benchmarks/lfm25-230m-rtn-mxfp4-4k.json": {
|
| 45 |
"bytes": 5588,
|
|
@@ -99,5 +99,5 @@
|
|
| 99 |
}
|
| 100 |
},
|
| 101 |
"schema_version": 1,
|
| 102 |
-
"total_bytes":
|
| 103 |
}
|
|
|
|
| 14 |
"sha256": "0e920ae71b97a4e96633c212099b9df56f3fba4de2535d13f51a8dbf4595cf0a"
|
| 15 |
},
|
| 16 |
"README.md": {
|
| 17 |
+
"bytes": 5010,
|
| 18 |
+
"sha256": "1ec64135a153ff681a4a809351d0819f695f5e2a05cee4b0a311b25a4d742452"
|
| 19 |
},
|
| 20 |
"benchmarks/jina-code-calibrated-4k.json": {
|
| 21 |
"bytes": 5151,
|
|
|
|
| 38 |
"sha256": "d62f44c1a8514dccf749630b9b4ba2da240588c2eae6af93b1816003a29e025d"
|
| 39 |
},
|
| 40 |
"benchmarks/lfm25-230m-gptq-mxfp8-vs-bf16-bootstrap.json": {
|
| 41 |
+
"bytes": 669,
|
| 42 |
+
"sha256": "41792201ed7898ff2e2cc361316e959f6d11f0c664e0a4ca12bb219a6a19387a"
|
| 43 |
},
|
| 44 |
"benchmarks/lfm25-230m-rtn-mxfp4-4k.json": {
|
| 45 |
"bytes": 5588,
|
|
|
|
| 99 |
}
|
| 100 |
},
|
| 101 |
"schema_version": 1,
|
| 102 |
+
"total_bytes": 464216795
|
| 103 |
}
|
benchmarks/lfm25-230m-gptq-mxfp8-vs-bf16-bootstrap.json
CHANGED
|
@@ -1,11 +1,15 @@
|
|
| 1 |
{
|
| 2 |
"bootstrap_samples": 10000,
|
|
|
|
|
|
|
| 3 |
"candidate_mrr": 0.39336530977743367,
|
| 4 |
"difference_ci_95_lower": -0.004237095202471089,
|
| 5 |
"difference_ci_95_upper": -0.0009771653320113183,
|
| 6 |
"mrr_difference": -0.0026152420061133245,
|
| 7 |
"pairs": 6995,
|
| 8 |
"probability_difference_le_zero": 0.9991,
|
|
|
|
|
|
|
| 9 |
"reference_mrr": 0.39598055178354696,
|
| 10 |
"seed": 17
|
| 11 |
}
|
|
|
|
| 1 |
{
|
| 2 |
"bootstrap_samples": 10000,
|
| 3 |
+
"candidate_embeddings": "lfm25-230m-gptq-mxfp8-4k-embeddings.npz",
|
| 4 |
+
"candidate_embeddings_sha256": "e6886573caf693e3a6b002ccd1933a054d24a22b54dd4913647dee7d566b7c19",
|
| 5 |
"candidate_mrr": 0.39336530977743367,
|
| 6 |
"difference_ci_95_lower": -0.004237095202471089,
|
| 7 |
"difference_ci_95_upper": -0.0009771653320113183,
|
| 8 |
"mrr_difference": -0.0026152420061133245,
|
| 9 |
"pairs": 6995,
|
| 10 |
"probability_difference_le_zero": 0.9991,
|
| 11 |
+
"reference_embeddings": "lfm25-230m-bf16-4k-embeddings.npz",
|
| 12 |
+
"reference_embeddings_sha256": "49758382ac6c95350c74070f92dc2aa86b6738fc2f53914a54372624a6163c91",
|
| 13 |
"reference_mrr": 0.39598055178354696,
|
| 14 |
"seed": 17
|
| 15 |
}
|