Instructions to use OpenRussianAI/OpenAirAI-X with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use OpenRussianAI/OpenAirAI-X with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="OpenRussianAI/OpenAirAI-X")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("OpenRussianAI/OpenAirAI-X")
model = AutoModelForCausalLM.from_pretrained("OpenRussianAI/OpenAirAI-X", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use OpenRussianAI/OpenAirAI-X with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf OpenRussianAI/OpenAirAI-X
# Run inference directly in the terminal:
llama cli -hf OpenRussianAI/OpenAirAI-X

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf OpenRussianAI/OpenAirAI-X
# Run inference directly in the terminal:
llama cli -hf OpenRussianAI/OpenAirAI-X

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf OpenRussianAI/OpenAirAI-X
# Run inference directly in the terminal:
./llama-cli -hf OpenRussianAI/OpenAirAI-X

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf OpenRussianAI/OpenAirAI-X
# Run inference directly in the terminal:
./build/bin/llama-cli -hf OpenRussianAI/OpenAirAI-X

Use Docker

docker model run hf.co/OpenRussianAI/OpenAirAI-X

LM Studio
Jan

vLLM

How to use OpenRussianAI/OpenAirAI-X with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "OpenRussianAI/OpenAirAI-X"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "OpenRussianAI/OpenAirAI-X",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/OpenRussianAI/OpenAirAI-X

SGLang

How to use OpenRussianAI/OpenAirAI-X with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "OpenRussianAI/OpenAirAI-X" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "OpenRussianAI/OpenAirAI-X",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "OpenRussianAI/OpenAirAI-X" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "OpenRussianAI/OpenAirAI-X",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Ollama
How to use OpenRussianAI/OpenAirAI-X with Ollama:
```
ollama run hf.co/OpenRussianAI/OpenAirAI-X
```
Unsloth Desktop
Docker Model Runner
How to use OpenRussianAI/OpenAirAI-X with Docker Model Runner:
```
docker model run hf.co/OpenRussianAI/OpenAirAI-X
```

Lemonade

How to use OpenRussianAI/OpenAirAI-X with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull OpenRussianAI/OpenAirAI-X

Run and chat with the model

lemonade run user.OpenAirAI-X-{{QUANT_TAG}}

List all available models

lemonade list

Atomic Chat

OpenAirAI-X

Commit History

Delete vocab.json

094bb36
verified

X commited on Jul 17

Delete tokenizer_config.json

abe32c0
verified

X commited on Jul 17

Delete special_tokens_map.json

2a3c5a4
verified

X commited on Jul 17

Delete pytorch_model.bin

317903a
verified

X commited on Jul 17

Delete config.json

d2a557f
verified

X commited on Jul 17

Delete Build.py

63ac388
verified

X commited on Jul 17

Update Build.py

22a987d
verified

X commited on Jul 8

Rename t.py to Build.py

0a9e01e
verified

X commited on Jul 4

Create t.py

eefaf7a
verified

X commited on Jun 24

Rename Без названия(1).png to Без названия.png

c1ea960
verified

X commited on Jun 23

Upload Без названия(1).png

0d42437
verified

X commited on Jun 23

Delete Без названия.png

d36bee9
verified

X commited on Jun 23

Update README.md

827bd4f
verified

X commited on Jun 23

Upload Без названия.png

c35f43a
verified

X commited on Jun 23

Create vocab.json

cc4d970
verified

X commited on Jun 23

Create special_tokens_map.json

e454592
verified

X commited on Jun 23

Create tokenizer_config.json

32143f5
verified

X commited on Jun 23

Update config.json

8a32b2b
verified

X commited on Jun 23

Create config.json

fdd6bea
verified

X commited on Jun 23

Update README.md

28545fe
verified

X commited on Jun 23

Update README.md

aa2ca3d
verified

X commited on Jun 23

Update README.md

66c9ecb
verified

X commited on Jun 23

Rename pytorch_model_00001.bin to pytorch_model.bin

1b6d9de
verified

X commited on Jun 23

Upload pytorch_model_00001.bin

f48e777
verified

X commited on Jun 23

Delete Example_Loader.py

7324c00
verified

X commited on Jun 23

Delete andrey_full.pt

1d96c8c
verified

X commited on Jun 23

Update README.md

e231f2e
verified

X commited on Jun 18

Update README.md

8c803d1
verified

X commited on Jun 18

Update README.md

25af9c0
verified

X commited on Jun 18

Update README.md

3ccb689
verified

X commited on Jun 17

Create Example_Loader.py

b8af3c7
verified

X commited on Jun 9

Update README.md

e1faf2d
verified

X commited on Jun 4

Upload andrey_full.pt

426a5d6
verified

X commited on Jun 4

Delete vocab.json

8b948f0
verified

X commited on Jun 4

Delete config.json

cd4f705
verified

X commited on Jun 4

Update README.md

9dcb0a5

X commited on Jun 4

Create config.json

6a18edd

X commited on Jun 4

Create License

a798cb6

X commited on Jun 4

Update README.md

26cccfb

X commited on Jun 4

Create vocab.json

404c52b

X commited on Jun 4

initial commit

62428da

X commited on Jun 4

Commit History

Delete vocab.json 094bb36 verified

Delete tokenizer_config.json abe32c0 verified

Delete special_tokens_map.json 2a3c5a4 verified

Delete pytorch_model.bin 317903a verified

Delete config.json d2a557f verified

Delete Build.py 63ac388 verified

Update Build.py 22a987d verified

Rename t.py to Build.py 0a9e01e verified

Create t.py eefaf7a verified

Rename Без названия(1).png to Без названия.png c1ea960 verified

Upload Без названия(1).png 0d42437 verified

Delete Без названия.png d36bee9 verified

Update README.md 827bd4f verified

Upload Без названия.png c35f43a verified

Create vocab.json cc4d970 verified

Create special_tokens_map.json e454592 verified

Create tokenizer_config.json 32143f5 verified

Update config.json 8a32b2b verified

Create config.json fdd6bea verified

Update README.md 28545fe verified

Update README.md aa2ca3d verified

Update README.md 66c9ecb verified

Rename pytorch_model_00001.bin to pytorch_model.bin 1b6d9de verified

Upload pytorch_model_00001.bin f48e777 verified

Delete Example_Loader.py 7324c00 verified

Delete andrey_full.pt 1d96c8c verified

Update README.md e231f2e verified

Update README.md 8c803d1 verified

Update README.md 25af9c0 verified

Update README.md 3ccb689 verified

Create Example_Loader.py b8af3c7 verified

Update README.md e1faf2d verified

Upload andrey_full.pt 426a5d6 verified

Delete vocab.json 8b948f0 verified

Delete config.json cd4f705 verified

Update README.md 9dcb0a5

Create config.json 6a18edd

Create License a798cb6

Update README.md 26cccfb

Create vocab.json 404c52b

initial commit 62428da

Delete vocab.json

094bb36
verified

Delete tokenizer_config.json

abe32c0
verified

Delete special_tokens_map.json

2a3c5a4
verified

Delete pytorch_model.bin

317903a
verified

Delete config.json

d2a557f
verified

Delete Build.py

63ac388
verified

Update Build.py

22a987d
verified

Rename t.py to Build.py

0a9e01e
verified

Create t.py

eefaf7a
verified

Rename Без названия(1).png to Без названия.png

c1ea960
verified

Upload Без названия(1).png

0d42437
verified

Delete Без названия.png

d36bee9
verified

Update README.md

827bd4f
verified

Upload Без названия.png

c35f43a
verified

Create vocab.json

cc4d970
verified

Create special_tokens_map.json

e454592
verified

Create tokenizer_config.json

32143f5
verified

Update config.json

8a32b2b
verified

Create config.json

fdd6bea
verified

Update README.md

28545fe
verified

Update README.md

aa2ca3d
verified

Update README.md

66c9ecb
verified

Rename pytorch_model_00001.bin to pytorch_model.bin

1b6d9de
verified

Upload pytorch_model_00001.bin

f48e777
verified

Delete Example_Loader.py

7324c00
verified

Delete andrey_full.pt

1d96c8c
verified

Update README.md

e231f2e
verified

Update README.md

8c803d1
verified

Update README.md

25af9c0
verified

Update README.md

3ccb689
verified

Create Example_Loader.py

b8af3c7
verified

Update README.md

e1faf2d
verified

Upload andrey_full.pt

426a5d6
verified

Delete vocab.json

8b948f0
verified

Delete config.json

cd4f705
verified

Update README.md

9dcb0a5

Create config.json

6a18edd

Create License

a798cb6

Update README.md

26cccfb

Create vocab.json

404c52b

initial commit

62428da