Fix lfm-2.5 layout: distinguish VL from text + colocate tokenizers
Browse files- .gitattributes +2 -0
- {lfm2.5-1.2B-instruct → 1_2b}/tokenizer.json +0 -0
- {lfm2.5-1.2B-instruct → 1_2b}/tokenizer_config.json +0 -0
- {lfm2.5-350M → 350m}/tokenizer.json +0 -0
- {lfm2.5-350M → 350m}/tokenizer_config.json +0 -0
- lfm2.5-1.2B-instruct/.gitattributes +0 -36
- lfm2.5-1.2B-instruct/README.md +0 -26
- lfm2.5-350M/.gitattributes +0 -38
- lfm2.5-350M/README.md +0 -26
- lfm2.5-VL-1.6B/.gitattributes +0 -36
- lfm2.5-VL-1.6B/README.md +0 -29
- {lfm2.5-VL-1.6B → vl_1_6b}/tokenizer.json +0 -0
- {lfm2.5-VL-1.6B → vl_1_6b}/tokenizer_config.json +0 -0
- {1_6b → vl_1_6b}/xnnpack/config.json +0 -0
- 1_6b/xnnpack/lfm_2_5_1_6b_xnnpack_8da4w.pte → vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte +0 -0
- {lfm2.5-VL-450M → vl_450m}/tokenizer.json +0 -0
- {lfm2.5-VL-450M → vl_450m}/tokenizer_config.json +0 -0
- {450m → vl_450m}/xnnpack/config.json +0 -0
- 450m/xnnpack/lfm_2_5_450m_xnnpack_8da4w.pte → vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte +0 -0
.gitattributes
CHANGED
|
@@ -45,3 +45,5 @@ lfm2.5-VL-450M/lfm2_5_vl_450m_8da4w_xnnpack.pte filter=lfs diff=lfs merge=lfs -t
|
|
| 45 |
350m/xnnpack/lfm_2_5_350m_xnnpack_fp16.pte filter=lfs diff=lfs merge=lfs -text
|
| 46 |
1_6b/xnnpack/lfm_2_5_1_6b_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
|
| 47 |
450m/xnnpack/lfm_2_5_450m_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 45 |
350m/xnnpack/lfm_2_5_350m_xnnpack_fp16.pte filter=lfs diff=lfs merge=lfs -text
|
| 46 |
1_6b/xnnpack/lfm_2_5_1_6b_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
|
| 47 |
450m/xnnpack/lfm_2_5_450m_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
|
{lfm2.5-1.2B-instruct → 1_2b}/tokenizer.json
RENAMED
|
File without changes
|
{lfm2.5-1.2B-instruct → 1_2b}/tokenizer_config.json
RENAMED
|
File without changes
|
{lfm2.5-350M → 350m}/tokenizer.json
RENAMED
|
File without changes
|
{lfm2.5-350M → 350m}/tokenizer_config.json
RENAMED
|
File without changes
|
lfm2.5-1.2B-instruct/.gitattributes
DELETED
|
@@ -1,36 +0,0 @@
|
|
| 1 |
-
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
-
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
-
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
-
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
-
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
-
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
-
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
-
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
-
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
-
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
-
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
-
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
-
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
-
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
-
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
-
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
-
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
-
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
-
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
-
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
-
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
-
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
-
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
-
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
-
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
-
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
-
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
-
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
-
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
-
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
-
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
-
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
-
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
-
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
-
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
-
*.pte filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
lfm2.5-1.2B-instruct/README.md
DELETED
|
@@ -1,26 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: other
|
| 3 |
-
license_name: lfm1.0
|
| 4 |
-
license_link: https://huggingface.co/LiquidAI/LFM2.5-1.2B-Thinking/blob/main/LICENSE
|
| 5 |
-
pipeline_tag: text-generation
|
| 6 |
-
tags:
|
| 7 |
-
- executorch
|
| 8 |
-
- liquid
|
| 9 |
-
- lfm2.5
|
| 10 |
-
- edge
|
| 11 |
-
---
|
| 12 |
-
# Introduction
|
| 13 |
-
|
| 14 |
-
This repository hosts the **LFM2.5-1.2B-Instruct** model for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes **quantized** version of it in `.pte` format, ready for use in the **ExecuTorch** runtime.
|
| 15 |
-
|
| 16 |
-
If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
|
| 17 |
-
|
| 18 |
-
## Compatibility
|
| 19 |
-
|
| 20 |
-
If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
|
| 21 |
-
|
| 22 |
-
### Repository Structure
|
| 23 |
-
|
| 24 |
-
The repository is organized as follows:
|
| 25 |
-
- The `.pte` file should be passed to the `modelSource` parameter.
|
| 26 |
-
- The tokenizer for the models is available within the repo root, under `tokenizer.json` and `tokenizer_config.json`
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
lfm2.5-350M/.gitattributes
DELETED
|
@@ -1,38 +0,0 @@
|
|
| 1 |
-
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
-
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
-
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
-
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
-
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
-
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
-
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
-
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
-
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
-
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
-
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
-
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
-
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
-
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
-
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
-
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
-
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
-
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
-
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
-
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
-
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
-
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
-
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
-
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
-
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
-
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
-
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
-
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
-
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
-
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
-
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
-
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
-
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
-
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
-
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
-
xnnpack/lfm2_5_350m_xnnpack_8w4da.pte filter=lfs diff=lfs merge=lfs -text
|
| 37 |
-
xnnpack/lfm2_5_350m_fp16.pte filter=lfs diff=lfs merge=lfs -text
|
| 38 |
-
xnnpack/lfm2_5_350m_xnnpack_fp16.pte filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
lfm2.5-350M/README.md
DELETED
|
@@ -1,26 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: other
|
| 3 |
-
license_name: lfm1.0
|
| 4 |
-
license_link: https://huggingface.co/LiquidAI/LFM2.5-350M/blob/main/LICENSE
|
| 5 |
-
pipeline_tag: text-generation
|
| 6 |
-
tags:
|
| 7 |
-
- executorch
|
| 8 |
-
- liquid
|
| 9 |
-
- lfm2.5
|
| 10 |
-
- edge
|
| 11 |
-
---
|
| 12 |
-
# Introduction
|
| 13 |
-
|
| 14 |
-
This repository hosts the **LFM2.5-350M** model for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes **quantized** version of it in `.pte` format, ready for use in the **ExecuTorch** runtime.
|
| 15 |
-
|
| 16 |
-
If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
|
| 17 |
-
|
| 18 |
-
## Compatibility
|
| 19 |
-
|
| 20 |
-
If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
|
| 21 |
-
|
| 22 |
-
### Repository Structure
|
| 23 |
-
|
| 24 |
-
The repository is organized as follows:
|
| 25 |
-
- The `.pte` file should be passed to the `modelSource` parameter.
|
| 26 |
-
- The tokenizer for the models is available within the repo root, under `tokenizer.json` and `tokenizer_config.json`
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
lfm2.5-VL-1.6B/.gitattributes
DELETED
|
@@ -1,36 +0,0 @@
|
|
| 1 |
-
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
-
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
-
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
-
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
-
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
-
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
-
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
-
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
-
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
-
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
-
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
-
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
-
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
-
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
-
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
-
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
-
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
-
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
-
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
-
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
-
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
-
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
-
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
-
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
-
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
-
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
-
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
-
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
-
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
-
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
-
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
-
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
-
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
-
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
-
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
-
quantized/lfm2_5_vl_1_6b_8da4w_xnnpack.pte filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
lfm2.5-VL-1.6B/README.md
DELETED
|
@@ -1,29 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: other
|
| 3 |
-
license_name: lfm1.0
|
| 4 |
-
license_link: https://huggingface.co/LiquidAI/LFM2.5-VL-1.6B/blob/main/LICENSE
|
| 5 |
-
pipeline_tag: image-text-to-text
|
| 6 |
-
tags:
|
| 7 |
-
- liquid
|
| 8 |
-
- lfm2
|
| 9 |
-
- lfm2-vl
|
| 10 |
-
- edge
|
| 11 |
-
- lfm2.5-vl
|
| 12 |
-
- lfm2.5
|
| 13 |
-
---
|
| 14 |
-
|
| 15 |
-
# Introduction
|
| 16 |
-
|
| 17 |
-
This repository hosts the **LFM2.5-VL-1.6B** vision-language model for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes a **quantized** version in `.pte` format, ready for use in the **ExecuTorch** runtime.
|
| 18 |
-
|
| 19 |
-
If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
|
| 20 |
-
|
| 21 |
-
## Compatibility
|
| 22 |
-
|
| 23 |
-
If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with the runtime used behind the scenes.
|
| 24 |
-
|
| 25 |
-
## Repository Structure
|
| 26 |
-
|
| 27 |
-
The repository is organized as follows:
|
| 28 |
-
- The `.pte` file should be passed to the `modelSource` parameter.
|
| 29 |
-
- The tokenizer files are available in the repo root: `tokenizer.json` and `tokenizer_config.json` should be passed to `tokenizerSource` and `tokenizerConfigSource` respectively.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
{lfm2.5-VL-1.6B → vl_1_6b}/tokenizer.json
RENAMED
|
File without changes
|
{lfm2.5-VL-1.6B → vl_1_6b}/tokenizer_config.json
RENAMED
|
File without changes
|
{1_6b → vl_1_6b}/xnnpack/config.json
RENAMED
|
File without changes
|
1_6b/xnnpack/lfm_2_5_1_6b_xnnpack_8da4w.pte → vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte
RENAMED
|
File without changes
|
{lfm2.5-VL-450M → vl_450m}/tokenizer.json
RENAMED
|
File without changes
|
{lfm2.5-VL-450M → vl_450m}/tokenizer_config.json
RENAMED
|
File without changes
|
{450m → vl_450m}/xnnpack/config.json
RENAMED
|
File without changes
|
450m/xnnpack/lfm_2_5_450m_xnnpack_8da4w.pte → vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte
RENAMED
|
File without changes
|