Instructions to use TobDeBer/myContainers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use TobDeBer/myContainers with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="TobDeBer/myContainers",
	filename="arco_BE8.gguf",
)

output = llm(
	"Once upon a time,",
	max_tokens=512,
	echo=True
)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use TobDeBer/myContainers with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf TobDeBer/myContainers
# Run inference directly in the terminal:
llama-cli -hf TobDeBer/myContainers

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf TobDeBer/myContainers
# Run inference directly in the terminal:
llama-cli -hf TobDeBer/myContainers

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf TobDeBer/myContainers
# Run inference directly in the terminal:
./llama-cli -hf TobDeBer/myContainers

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf TobDeBer/myContainers
# Run inference directly in the terminal:
./build/bin/llama-cli -hf TobDeBer/myContainers

Use Docker

docker model run hf.co/TobDeBer/myContainers

LM Studio
Jan
Ollama
How to use TobDeBer/myContainers with Ollama:
```
ollama run hf.co/TobDeBer/myContainers
```

Unsloth Studio new

How to use TobDeBer/myContainers with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for TobDeBer/myContainers to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for TobDeBer/myContainers to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for TobDeBer/myContainers to start chatting

Docker Model Runner
How to use TobDeBer/myContainers with Docker Model Runner:
```
docker model run hf.co/TobDeBer/myContainers
```

Lemonade

How to use TobDeBer/myContainers with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull TobDeBer/myContainers

Run and chat with the model

lemonade run user.myContainers-{{QUANT_TAG}}

List all available models

lemonade list

myContainers

Commit History

Upload stream_c.exe

3882aaa
verified

TobDeBer commited on Feb 7, 2025

Upload fox.txt

35a8bec
verified

TobDeBer commited on Feb 7, 2025

sd compiles

68b37ff

TobDeBer commited on Oct 9, 2024

slim with gomp

5dd8514

TobDeBer commited on Oct 5, 2024

more libcuda

a0d645c

TobDeBer commited on Oct 4, 2024

external libcuda

cd3a367

TobDeBer commited on Oct 4, 2024

add mesa

bc62ed1

TobDeBer commited on Oct 4, 2024

cuda keyring

90151fb

TobDeBer commited on Oct 3, 2024

sd-server

e833e25

TobDeBer commited on Oct 3, 2024

add mesa

2c6f446

TobDeBer commited on Oct 3, 2024

add diffusion container

a3d2829

TobDeBer commited on Sep 12, 2024

diffusion container

250649f

Tob De Ber commited on Sep 12, 2024

diffusion build

8daab62

TobDeBer commited on Sep 11, 2024

Update README.md

aca3f5d
verified

TobDeBer commited on Sep 11, 2024

update README

a653b79

TobDeBer commited on Sep 11, 2024

clean up containers

ee372b9

TobDeBer commited on Sep 11, 2024

z static server binary

84f15e2

TobDeBer commited on Sep 10, 2024

chmod

8b9f724

Tobias Bergmann commited on Sep 10, 2024

merge

a3a43cc

TobDeBer commited on Sep 10, 2024

arco big endian

2a86f38

TobDeBer commited on Sep 10, 2024

add slim Z container

2a69b08

Tobias Bergmann commited on Sep 9, 2024

add static server

0c30dec

TobDeBer commited on Sep 9, 2024

assistant patches

4d0c2cb

TobDeBer commited on Sep 9, 2024

add curl to server

c7050ab

Tob De Ber commited on Sep 4, 2024

add libraries to slim container

a796f0d

Tob De Ber commited on Sep 4, 2024

add curl support

c3d6e83

Tob De Ber commited on Sep 4, 2024

attribs

5d5743e

Tob De Ber commited on Sep 2, 2024

server tar

bddff9d

Tob De Ber commited on Sep 2, 2024