AlphaOxO's picture
Update README.md
fa439c3 verified
|
Raw
History Blame Contribute Delete
758 Bytes
metadata
language: en
library_name: mlx
pipeline_tag: text-generation
tags:
  - mlx
base_model:
  - Maincode/Maincoder-1B

Maincoder-1B — MLX 8bits

Quantized to 8bits format.

Converted from Maincode/Maincoder-1B using mlx-lm.

Requirements

The Maincoder model type is support in my mlx-lm fork(AlphaKure/mlx-lm).

Update at: 2026/09/09

pip install git+https://github.com/AlphaKure/mlx-lm.git@19ed84b1e3333bc9c320109b15dec38fe0784d29

Use

  • use --extra-eos-token '<|im_end|>' to avoid loop response
mlx_lm.generate --model AlphaOxO/Maincoder-1B-8bits-mlx --prompt "def insert_sort(nums: list[int]):" --max-tokens 2048 --extra-eos-token '<|im_end|>'