File size: 758 Bytes
b0d601c
 
 
 
 
 
fa439c3
 
b0d601c
fa439c3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
language: en
library_name: mlx
pipeline_tag: text-generation
tags:
- mlx
base_model:
- Maincode/Maincoder-1B
---

# Maincoder-1B — MLX 8bits

Quantized to 8bits format.

Converted from [Maincode/Maincoder-1B](Maincode/Maincoder-1B) using mlx-lm.

## Requirements

The `Maincoder` model type is support in my mlx-lm fork([AlphaKure/mlx-lm](https://github.com/AlphaKure/mlx-lm/issues/4)).

Update at: 2026/09/09

```bash
pip install git+https://github.com/AlphaKure/mlx-lm.git@19ed84b1e3333bc9c320109b15dec38fe0784d29
```

## Use

* use --extra-eos-token '<|im_end|>'  to avoid loop response

```bash
mlx_lm.generate --model AlphaOxO/Maincoder-1B-8bits-mlx --prompt "def insert_sort(nums: list[int]):" --max-tokens 2048 --extra-eos-token '<|im_end|>'
```