Instructions to use RESMP-DEV/LFM2.5-Encoder-230M-Code-MXFP8-GPTQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use RESMP-DEV/LFM2.5-Encoder-230M-Code-MXFP8-GPTQ with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir LFM2.5-Encoder-230M-Code-MXFP8-GPTQ RESMP-DEV/LFM2.5-Encoder-230M-Code-MXFP8-GPTQ
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Add files using upload-large-folder tool
Browse files
README.md
CHANGED
|
@@ -66,8 +66,9 @@ and candidate code with `passage: ` when calling the model directly.
|
|
| 66 |
|
| 67 |
## Training and data receipts
|
| 68 |
|
| 69 |
-
Full-backbone symmetric in-batch InfoNCE training used 24,626
|
| 70 |
-
|
|
|
|
| 71 |
training report records the NVIDIA RTX A6000 runtime and validation history.
|
| 72 |
|
| 73 |
- `train`: 42,626 rows, SHA-256 `426ebfaad34b14d7627ba6e668ae36e08e548c9d057b0edc208bcfa6fe527629`
|
|
|
|
| 66 |
|
| 67 |
## Training and data receipts
|
| 68 |
|
| 69 |
+
Full-backbone symmetric in-batch InfoNCE training used 24,626
|
| 70 |
+
language-balanced pairs selected from the 42,626-row source training
|
| 71 |
+
split, two epochs, batch size 32, learning rate 2e-5, temperature 0.05, and seed 17. The
|
| 72 |
training report records the NVIDIA RTX A6000 runtime and validation history.
|
| 73 |
|
| 74 |
- `train`: 42,626 rows, SHA-256 `426ebfaad34b14d7627ba6e668ae36e08e548c9d057b0edc208bcfa6fe527629`
|
artifact_manifest.json
CHANGED
|
@@ -14,8 +14,8 @@
|
|
| 14 |
"sha256": "1a1986e116cac6fd3a666f330d847ad013cd550a449bcd0ea3806eff33661725"
|
| 15 |
},
|
| 16 |
"README.md": {
|
| 17 |
-
"bytes":
|
| 18 |
-
"sha256": "
|
| 19 |
},
|
| 20 |
"benchmarks/jina-code-calibrated-4k.json": {
|
| 21 |
"bytes": 5151,
|
|
@@ -38,8 +38,8 @@
|
|
| 38 |
"sha256": "d62f44c1a8514dccf749630b9b4ba2da240588c2eae6af93b1816003a29e025d"
|
| 39 |
},
|
| 40 |
"benchmarks/lfm25-230m-gptq-mxfp8-vs-bf16-bootstrap.json": {
|
| 41 |
-
"bytes":
|
| 42 |
-
"sha256": "
|
| 43 |
},
|
| 44 |
"benchmarks/lfm25-230m-rtn-mxfp4-4k.json": {
|
| 45 |
"bytes": 5588,
|
|
@@ -103,5 +103,5 @@
|
|
| 103 |
}
|
| 104 |
},
|
| 105 |
"schema_version": 1,
|
| 106 |
-
"total_bytes":
|
| 107 |
}
|
|
|
|
| 14 |
"sha256": "1a1986e116cac6fd3a666f330d847ad013cd550a449bcd0ea3806eff33661725"
|
| 15 |
},
|
| 16 |
"README.md": {
|
| 17 |
+
"bytes": 4826,
|
| 18 |
+
"sha256": "788af540e48d22067d87e655b4905e4932a5cf9373f415c9af5390fcfcbf144b"
|
| 19 |
},
|
| 20 |
"benchmarks/jina-code-calibrated-4k.json": {
|
| 21 |
"bytes": 5151,
|
|
|
|
| 38 |
"sha256": "d62f44c1a8514dccf749630b9b4ba2da240588c2eae6af93b1816003a29e025d"
|
| 39 |
},
|
| 40 |
"benchmarks/lfm25-230m-gptq-mxfp8-vs-bf16-bootstrap.json": {
|
| 41 |
+
"bytes": 669,
|
| 42 |
+
"sha256": "41792201ed7898ff2e2cc361316e959f6d11f0c664e0a4ca12bb219a6a19387a"
|
| 43 |
},
|
| 44 |
"benchmarks/lfm25-230m-rtn-mxfp4-4k.json": {
|
| 45 |
"bytes": 5588,
|
|
|
|
| 103 |
}
|
| 104 |
},
|
| 105 |
"schema_version": 1,
|
| 106 |
+
"total_bytes": 306812271
|
| 107 |
}
|
benchmarks/lfm25-230m-gptq-mxfp8-vs-bf16-bootstrap.json
CHANGED
|
@@ -1,11 +1,15 @@
|
|
| 1 |
{
|
| 2 |
"bootstrap_samples": 10000,
|
|
|
|
|
|
|
| 3 |
"candidate_mrr": 0.39336530977743367,
|
| 4 |
"difference_ci_95_lower": -0.004237095202471089,
|
| 5 |
"difference_ci_95_upper": -0.0009771653320113183,
|
| 6 |
"mrr_difference": -0.0026152420061133245,
|
| 7 |
"pairs": 6995,
|
| 8 |
"probability_difference_le_zero": 0.9991,
|
|
|
|
|
|
|
| 9 |
"reference_mrr": 0.39598055178354696,
|
| 10 |
"seed": 17
|
| 11 |
}
|
|
|
|
| 1 |
{
|
| 2 |
"bootstrap_samples": 10000,
|
| 3 |
+
"candidate_embeddings": "lfm25-230m-gptq-mxfp8-4k-embeddings.npz",
|
| 4 |
+
"candidate_embeddings_sha256": "e6886573caf693e3a6b002ccd1933a054d24a22b54dd4913647dee7d566b7c19",
|
| 5 |
"candidate_mrr": 0.39336530977743367,
|
| 6 |
"difference_ci_95_lower": -0.004237095202471089,
|
| 7 |
"difference_ci_95_upper": -0.0009771653320113183,
|
| 8 |
"mrr_difference": -0.0026152420061133245,
|
| 9 |
"pairs": 6995,
|
| 10 |
"probability_difference_le_zero": 0.9991,
|
| 11 |
+
"reference_embeddings": "lfm25-230m-bf16-4k-embeddings.npz",
|
| 12 |
+
"reference_embeddings_sha256": "49758382ac6c95350c74070f92dc2aa86b6738fc2f53914a54372624a6163c91",
|
| 13 |
"reference_mrr": 0.39598055178354696,
|
| 14 |
"seed": 17
|
| 15 |
}
|