| --- |
| license: apache-2.0 |
| tags: |
| - coreml |
| - sentence-transformers |
| - embedding |
| - nomic |
| - code |
| base_model: nomic-ai/nomic-embed-code |
| library_name: coremltools |
| pipeline_tag: feature-extraction |
| --- |
| |
| # nomic-embed-code — CoreML (.mlpackage) |
|
|
| CoreML conversion of [nomic-ai/nomic-embed-code](https://huggingface.co/nomic-ai/nomic-embed-code) for native Apple Neural Engine / GPU inference on macOS and iOS. |
|
|
| ## Files |
|
|
| | File | Description | |
| |------|-------------| |
| | `model.mlpackage/` | CoreML model (FP16, flexible shapes) | |
| | `tokenizer.json` | HF fast tokenizer | |
| | `config.json` | Model configuration | |
|
|
| ## Details |
|
|
| - **Architecture**: NomicBERT (RoPE, SwiGLU, no token_type_ids) |
| - **Precision**: FP16 (native ANE precision) |
| - **Compute units**: `.all` — CoreML schedules across ANE, GPU, and CPU |
| - **Input shapes**: batch=1, seq_len=1..8192 (flexible range) |
| - **Embedding dimension**: 768 |
| |
| ## Usage with cai |
| |
| ```bash |
| cai index --embed-backend swift --embed-model "rsvalerio/nomic-embed-code-coreml" |
| ``` |
| |
| The Swift backend downloads the `.mlpackage` from this repo, compiles it to `.mlmodelc` on first run (~30-60s), and caches the compiled model for subsequent runs. |
| |
| ## Conversion |
| |
| Converted using [rsvalerio/models](https://github.com/rsvalerio/models) CI pipeline with `coremltools`. |
| |
| ```bash |
| pip install coremltools transformers torch |
| python convert.py |
| ``` |
| |
