MiniMax-M2.7-TurboQuant-MLX-3bit

MLX 3-bit quantized variant of MiniMaxAI/MiniMax-M2.7 with TurboQuant KV-cache compression, optimized for Apple Silicon.

Overview

MiniMax-M2.7 is a massive 256-expert Mixture-of-Experts (MoE) model with 8 experts active per token, totaling approximately 456 billion parameters. This variant combines 3-bit MLX weight quantization with TurboQuant KV-cache quantization for deployment on Apple Silicon hardware.

TurboQuant uses asymmetric per-channel quantization on the KV cache, optimized for throughput and long-context generation. At 3-bit, quality degradation becomes more noticeable -- consider RotorQuant if quality is paramount.

Property	Value
Architecture	MoE (256 experts, 8 active/token)
Total Parameters	~456B
Layers	62
Hidden Size	3072
Attention Heads	48
Weight Quantization	3-bit (MLX)
KV-Cache Quantization	TurboQuant
Estimated Size	~170 GB
Base Model	MiniMaxAI/MiniMax-M2.7

Quickstart

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("majentik/MiniMax-M2.7-TurboQuant-MLX-3bit")

prompt = "What is a Comprehensive Geriatric Assessment?"
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)

response = generate(
    model,
    tokenizer,
    prompt=text,
    max_tokens=512,
)
print(response)

TurboQuant vs RotorQuant

Feature	TurboQuant	RotorQuant
Technique	Asymmetric per-channel KV quantization	Rotation-based KV quantization (Hadamard transform)
Throughput	Higher throughput, lower latency	Slightly lower throughput
Quality	Good quality preservation	Better quality preservation at low bit-widths
Best For	High-throughput serving, long contexts	Quality-sensitive tasks, research

At 3-bit quantization, RotorQuant typically preserves more quality than TurboQuant. Consider the RotorQuant variant for quality-sensitive workloads.

Memory Estimates (Apple Silicon)

Variant	Estimated Size	Minimum Unified Memory
MLX 8-bit	~456 GB	512 GB (Mac Studio M2/M3/M4 Ultra)
MLX 5-bit	~280 GB	384 GB
MLX 4-bit	~225 GB	256 GB
MLX 3-bit	~170 GB	192 GB
MLX 2-bit	~110 GB	128 GB

Note: 3-bit quantization requires Apple Silicon with 192 GB+ unified memory, such as a Mac Studio with M2/M3/M4 Ultra.

See Also

• MiniMaxAI/MiniMax-M2.7 -- Base model
• majentik/MiniMax-M2.7-TurboQuant -- KV-cache only (transformers)
• majentik/MiniMax-M2.7-RotorQuant-MLX-3bit -- RotorQuant MLX 3-bit
• majentik/MiniMax-M2.7-TurboQuant-MLX-4bit -- MLX 4-bit
• majentik/MiniMax-M2.7-TurboQuant-MLX-2bit -- MLX 2-bit