Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,114 @@
+---
+license: other
+license_name: bcz-proprietary
+license_link: https://huggingface.co/sprappcom/kat-coder-v25-dev-pqm/blob/main/NOTICE
+language:
+  - en
+tags:
+  - moe
+  - code
+  - tool-calling
+  - gated-deltanet
+  - pqm
+  - prism-engine
+  - q4_k
+base_model: Kwaipilot/KAT-Coder-V2.5-Dev
+---
+
+# kat-coder-v25-dev-pqm
+
+Standalone **[Kwaipilot/KAT-Coder-V2.5-Dev](https://huggingface.co/Kwaipilot/KAT-Coder-V2.5-Dev)**
+(clean upstream code / tool-calling model, Qwen3.6-35B-A3B MoE) exported to `.pqm`
+for the `prism-engine` inference server. **GGUF-free standalone boot** — this single
+`.pqm` container is self-contained and boots directly on `prism-engine`, with no
+GGUF, safetensors, or transformers checkpoint alongside it.
+
+## License & attribution
+
+This repository distributes a **composite work** under a dual arrangement:
+
+- **Proprietary layer — © 2026 BCZ Singapore Pte Ltd. All rights reserved.**
+  The `.pqm` container format and packaging, and the `prism-engine` inference server
+  (Rust/CUDA) are proprietary and are **not** licensed under Apache-2.0.
+- **Base model weights — Apache-2.0.** The underlying weights are an **unmodified**
+  (repacked-only) derivative of a single Apache-2.0 upstream:
+
+  | Component | Source | Copyright | License | Modification |
+  |---|---|---|---|---|
+  | Full model (backbone + experts) | [Kwaipilot/KAT-Coder-V2.5-Dev](https://huggingface.co/Kwaipilot/KAT-Coder-V2.5-Dev) | © 2026 Kwaipilot / Kuaishou | Apache-2.0 | weights repacked to `.pqm` (mixed Q4_K/Q6_K/F32); no fine-tune, no merge |
+
+  `KAT-Coder-V2.5-Dev` (the open Apache-2.0 weights, itself Qwen3.6-35B-A3B-based) — **not**
+  the separate closed API-only "KAT-Coder" product. These base weights remain licensed under
+  **Apache-2.0**. The full Apache-2.0 license text and per-component attribution are in the
+  [`NOTICE`](https://huggingface.co/sprappcom/kat-coder-v25-dev-pqm/blob/main/NOTICE) file
+  in this repo.
+
+This is **not** an original, trained-from-scratch foundation model — it is a
+quantized repack of the Apache-2.0 upstream named above. Use of the base weights is
+governed by Apache-2.0; use of the proprietary `.pqm` packaging and `prism-engine`
+requires a separate license from BCZ Singapore Pte Ltd.
+
+## Requirements — read before downloading
+
+- **Inference engine:** `.pqm` is a proprietary container, **not** readable by vLLM,
+  llama.cpp, Ollama, or transformers. Runs only on `prism-engine` (proprietary
+  Rust/CUDA server, **not included in this repo**). Contact sprappcom for engine access.
+- **Tokenizer sidecar:** `.pqm` does **not** embed a tokenizer. Use the `kat_v25.tok`
+  shipped in this repo via `PRISMX_TOKENIZER`.
+- **Hardware:** A100 (sm_80) / Ada-Ampere (sm_86/sm_89) validated. Full residency ~20 GB
+  VRAM, or run with CPU-RAM expert offload on smaller cards.
+
+## Architecture
+
+- Qwen3.6-35B-A3B MoE, hidden_size=2048, 40 layers (30 Gated DeltaNet + 10 full attention)
+- 256 routed experts + 1 shared expert, top-8 routing
+- vocab_size=248320
+
+## Quantization
+
+| Tensor group | Type |
+|---|---|
+| token embedding, attn_qkv/attn_output/attn_gate, routed experts (ffn_*_exps) | Q4_K |
+| shared expert (ffn_*_shexp), output.weight | Q6_K |
+| norms, SSM gates | F32 |
+
+~4.56 BPW. Container ~39.9 GB (routed experts stored raw for CPU-offload support).
+
+## Usage
+
+```bash
+export PRISMX_PQM_STANDALONE=1
+export PRISMX_PQM=/path/to/kat_v25.pqm
+export PRISMX_TOKENIZER=/path/to/kat_v25.tok
+prism_server 0.0.0.0:8080 \
+  --n-cpu-moe 28 \
+  --max-prefill-chunk 8 \
+  --moe-cache-experts 2048 \
+  --max-batch 1
+```
+
+Standalone mode always binds `0.0.0.0:8080`. OpenAI-compatible `/v1/completions` and
+`/v1/chat/completions`. Use `temperature >= 0.15` (greedy decoding can collapse).
+
+## Verification
+
+Boot-verified GGUF-free on A100 (sm_80) with `prism_server`
+(`PRISMX_PQM_STANDALONE=1 --n-cpu-moe 28 --max-prefill-chunk 8 --moe-cache-experts 2048
+--max-batch 1`, tokenizer `kat_v25.tok` from this repo): coherent English code and
+tool-calling completions, no NaN/garbage output.
+
+## Known limitations
+
+- **Text-only.** This `.pqm` carries no vision weights; image input is available on the
+  separate AWQ variant, not this file.
+- Intermittent sub-word token drop/duplication on some code/arithmetic prompts is a
+  known open issue; validate structured output downstream.
+
+## Integrity
+
+| File | Bytes | SHA-256 |
+|---|---|---|
+| `kat_v25.pqm` | 39870623744 | `0050a596155bee84d162148a3e9248099f2dc838c41dca1391eb5a33ef693b15` |
+| `kat_v25.tok` | 8949400 | md5 `907b88ec3a1f5aed0e234472eb441520` |
+
+Check: `sha256sum kat_v25.pqm` must print the hash above.