Text Generation
Transformers
PyTorch
English
burt-imma
custom-architecture
matrix-memory
equilibrium-propagation
cifg
sovereign
snapkitty
no-backprop
formal-verification
lean4
Instructions to use Snapkitty/burt-imma with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Snapkitty/burt-imma with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Snapkitty/burt-imma")# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Snapkitty/burt-imma", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Snapkitty/burt-imma with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Snapkitty/burt-imma" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Snapkitty/burt-imma", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Snapkitty/burt-imma
- SGLang
How to use Snapkitty/burt-imma with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Snapkitty/burt-imma" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Snapkitty/burt-imma", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Snapkitty/burt-imma" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Snapkitty/burt-imma", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Snapkitty/burt-imma with Docker Model Runner:
docker model run hf.co/Snapkitty/burt-imma
| /- | |
| SumInversionAgent | |
| Exact reconstruction, trajectory sufficiency, and scaling laws | |
| -/ | |
| import Mathlib | |
| noncomputable section | |
| open Real | |
| -- ============================================================ | |
| -- Core Definitions | |
| -- ============================================================ | |
| variable {n m : Nat} | |
| /-- A matrix B is full rank if its rank equals min(rows, cols) -/ | |
| def is_full_rank (B : Matrix (Fin n) (Fin m) β) : Prop := | |
| B.rank = min n m | |
| /-- Round-trip accuracy: encode then decode recovers original -/ | |
| def round_trip_accuracy (encode : Fin n β β β β) (decode : Fin n β β β β) : Prop := | |
| β i x, decode i (encode i x) = x | |
| /-- A trajectory function mapping time steps to states -/ | |
| def Trajectory (state_dim : Nat) := Nat β Fin state_dim β β | |
| -- ============================================================ | |
| -- Theorems | |
| -- ============================================================ | |
| /-- If B is full rank, encoding-decoding achieves 100% round-trip accuracy -/ | |
| theorem exact_reconstruction | |
| (B : Matrix (Fin n) (Fin n) β) | |
| (h_full_rank : is_full_rank B) | |
| (encode decode : Fin n β β β β) | |
| (h_linear : β i x, encode i x = B i i * x) | |
| (h_decode : β i x, decode i x = x / B i i) : | |
| round_trip_accuracy encode decode := sorry | |
| /-- Trajectory is injective: distinct inputs produce distinct trajectories -/ | |
| theorem trajectory_sufficient | |
| (state_dim : Nat) | |
| (traj : β β Trajectory state_dim) | |
| (h_distinct : β x y, x β y β traj x β traj y) : | |
| Function.Injective traj := sorry | |
| /-- Dynamics error (in trajectory space) bounds token-level error -/ | |
| theorem dynamics_error_bounds_token_error | |
| (traj_error token_error : β) | |
| (lipschitz_const : β) | |
| (h_lip_pos : lipschitz_const > 0) | |
| (h_bound : token_error β€ lipschitz_const * traj_error) : | |
| token_error β€ lipschitz_const * traj_error := sorry | |
| /-- Chinchilla-optimal: N (model size) proportional to C^0.5 (compute budget) -/ | |
| theorem chinchilla_optimal | |
| (C : β) (N : β) (D : β) | |
| (h_C_pos : C > 0) | |
| (h_scaling : N = C ^ (0.5 : β)) | |
| (h_data : D = C ^ (0.5 : β)) | |
| (h_compute : C = 6 * N * D) : | |
| N = C ^ (0.5 : β) := sorry | |
| end | |