deploy/openai_server_push.py: launch_openai_server serves a LoRA natively over
the base (vLLM --enable-lora --lora-modules, SGLang --enable-lora --lora-paths)
or merged (--merge, merge_lora_adapter); builds the exact argv; launches in its
own session with server.log / server.pid / launch.json under
out/runs/<run>/serve/<to>/; polls /v1/models (+ vLLM /health) until the tag is
listed; optionally swaps mindX's fallback (provider vllm|sglang).
stop_openai_server SIGTERMs the process group and verifies it is gone. CPU
hosts get bfloat16, VLLM_CPU_KVCACHE_SPACE, SGLang --device cpu; quantized
checkpoints and tensor_parallel > 1 are refused without a GPU; a missing server
is reported with its install hint. Results never raise.
CLI: --dry-run, --stop, --merge, --host, --port, --dtype, --server-bin,
--server-arg, --ready-timeout, --cpu-kvcache-gib. Gradio Serve room offers
sglang. Docs: docs/serve.md (flag provenance), cli.md, README, NAV, CHANGELOG,
llm.txt. Tests: 21 new (Popen/which monkey…
bankml: the verified CPU engine as backend, serve target and imprint probe
bankml (github.com/cryptoAGI/bankml) is reached over HTTP and its CLI only;
nothing is vendored.
- operator/backends/bankml.py: @register_backend("bankml"), default
MINDXTRAIN_BANKML_BASE_URL http://127.0.0.1:18093/v1; keeps the
bankml_receipt (ChatResponse.receipt, last_receipt for streams); HTTP 400
becomes BankmlRefusal(reason) and is never retried with altered params.
- operator: backend_kwargs() replaces the duplicated per-backend branches in
app.py and coach/api.py; GET /bankml + /v1/models health probes;
auto-detect tries bankml only after ollama and vllm; the governance panel
env chain gains MINDXTRAIN_BANKML_BASE_URL last, only when set.
- deploy/bankml_push.py + `serve --to bankml`: merge -> Modelfile through
bankml_sanitize (refuses ADAPTER, a foreign TEMPLATE, penalties, mirostat,
typical_p, resource params; never drops them) -> bankml create; records
the model sha256; refuses quantized configs and non-Llama archs; a bankml
without create/convert (pre-0…
fork mindXtrain from GitHub (Professor-Codephreak/mindXtrain@661bd41) as the mindX-specific line
