compunerd commited on
Commit
732c41e
·
verified ·
1 Parent(s): 2fae150

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +76 -0
README.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: Phox BQSM Model Weights
3
+ organization: emerging.systems
4
+ license: apache-2.0
5
+ tags:
6
+ - bqsm
7
+ - ternary
8
+ - wave-rider
9
+ - phoenix
10
+ - oscillator
11
+ - kuramoto
12
+ - inference-engine
13
+ - cpu
14
+ language: en
15
+ ---
16
+
17
+ # Phox — BQSM Ternary Model Weights
18
+
19
+ Model weights for the Phox BQSM (Basin-Quotient-Machine) wave-rider inference engine.
20
+
21
+ ## Overview
22
+
23
+ This repository contains ternary-quantized model weights for the Phoenix Brain — a Kuramoto oscillator interference engine that performs inference through traveling wave activation rather than traditional matrix multiplication.
24
+
25
+ ### Architecture
26
+
27
+ - **Engine**: Phoenix Brain (`phoenix_brain.c`) — 4-ring Kuramoto core + demand-driven tendrils
28
+ - **Weights**: 4-level ternary quantization (80% sparsity, 2 bits per weight)
29
+ - **Compute**: AVX2 SIMD + OpenMP parallelism (CPU only)
30
+ - **No GPU required**: Engine is pure C with AVX2, runs on any x86-64 CPU
31
+
32
+ ### Models
33
+
34
+ | File | Size | Description |
35
+ |------|------|-------------|
36
+ | `gemma4-12b-ternary-normed.bqsm` | 2.8GB | Gemma-4-12B ternary weights (normalized) |
37
+ | `gemma4-12b-bf16-ternary.bqsm` | 1.2GB | Gemma-4-12B BF16-derived ternary |
38
+ | `gemma4-12b.vocab` | 2.8MB | Token vocabulary |
39
+ | `hermes-3b-ternary.bqsm` | 766MB | Hermes-3-3B ternary weights |
40
+ | `hermes-3b.vocab` | 1.3MB | Token vocabulary |
41
+ | `phoenix-evolved.pbrain` | ~2MB | Evolved brain state file |
42
+
43
+ ### Files
44
+
45
+ - `gemma4-12b-ternary-normed.bqsm` — Main 12B parameter model with normalized weights
46
+ - `tokenizer/` — Gemma 4 tokenizer files (compatible with HuggingFace transformers)
47
+ - `gemma4-12b.vocab` — Token-to-ID vocabulary mapping for the C engine
48
+
49
+ ### Usage
50
+
51
+ **Compile the engine:**
52
+ ```bash
53
+ cc -O3 -std=c11 -march=native -fopenmp phoenix_brain.c -o phoenix -lm
54
+ ```
55
+
56
+ **Run inference:**
57
+ ```bash
58
+ ./phoenix gemma4-12b-ternary-normed.bqsm 20
59
+ ```
60
+
61
+ **Chat mode (with ring buffer I/O):**
62
+ ```bash
63
+ ./phoenix gemma4-12b-ternary-normed.bqsm --chat
64
+ ```
65
+
66
+ ### Performance
67
+
68
+ - ~4.9 tok/s on 12B model (12-core CPU, AVX2)
69
+ - Model loaded via mmap (no RAM duplication)
70
+ - 48 layers of wave-rider physics per token
71
+
72
+ ### Citation
73
+
74
+ If you use this work, please reference:
75
+ - Nicholas Bumgarner, emerging.systems
76
+ - "Basin-Quotient-Machine: Cross-Harmonic Computation"