mlboydaisuke commited on
Commit
8969f71
·
verified ·
1 Parent(s): 564efc8

Card: definition line (Core AI, 2026-09)

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -20,6 +20,8 @@ library_name: coreai
20
  base_model_relation: quantized
21
  ---
22
 
 
 
23
  # BitCPM-8B → Apple Core AI (1.58-bit ternary, on-device)
24
 
25
  The zoo's **first 1.58-bit ternary LLM** and **first sub-int8 packed-GEMM Metal kernel**, running
 
20
  base_model_relation: quantized
21
  ---
22
 
23
+ Core AI is Apple's on-device ML runtime in iOS 27 / macOS 27 and the successor to Core ML: PyTorch models are exported with Apple's `coreai-torch` (LLMs: `coreai.llm.export`) into `.aimodel` bundles that run on the GPU or the Neural Engine, e.g. Qwen3-8B 4-bit decodes at 94 tok/s on an M4 Max GPU, MLX 90 under the same protocol ([apple-silicon-llm-bench](https://github.com/john-rocky/apple-silicon-llm-bench), macOS 27 beta, 2026-06).
24
+
25
  # BitCPM-8B → Apple Core AI (1.58-bit ternary, on-device)
26
 
27
  The zoo's **first 1.58-bit ternary LLM** and **first sub-int8 packed-GEMM Metal kernel**, running