How to use N8Programs/Musicroll-50M with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("N8Programs/Musicroll-50M") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True)
How to use N8Programs/Musicroll-50M with MLX LM:
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "N8Programs/Musicroll-50M" --prompt "Once upon a time"
abf4441
1
2
3
4
5
{ "bos_token_id": 256, "eos_token_id": 257, "pad_token_id": 258 }
