| | --- |
| | base_model: darkc0de/XortronCriminalComputingConfig |
| | library_name: transformers |
| | tags: |
| | - mergekit |
| | - merge |
| | - uncensored |
| | - harmful |
| | - mlx |
| | - mlx-my-repo |
| | license: wtfpl |
| | language: |
| | - en |
| | pipeline_tag: text-generation |
| | --- |
| | |
| | # mlx-community/XortronCriminalComputingConfig-mlx-8Bit |
| |
|
| | The Model [mlx-community/XortronCriminalComputingConfig-mlx-8Bit](https://huggingface.co/mlx-community/XortronCriminalComputingConfig-mlx-8Bit) was converted to MLX format from [darkc0de/XortronCriminalComputingConfig](https://huggingface.co/darkc0de/XortronCriminalComputingConfig) using mlx-lm version **0.22.3**. |
| |
|
| | ## Use with mlx |
| |
|
| | ```bash |
| | pip install mlx-lm |
| | ``` |
| |
|
| | ```python |
| | from mlx_lm import load, generate |
| | |
| | model, tokenizer = load("mlx-community/XortronCriminalComputingConfig-mlx-8Bit") |
| | |
| | prompt="hello" |
| | |
| | if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None: |
| | messages = [{"role": "user", "content": prompt}] |
| | prompt = tokenizer.apply_chat_template( |
| | messages, tokenize=False, add_generation_prompt=True |
| | ) |
| | |
| | response = generate(model, tokenizer, prompt=prompt, verbose=True) |
| | ``` |
| |
|