Text Generation
Transformers
Safetensors
mimo_v2
Mixture of Experts
pruned
reap
hope
multimodal
conversational
custom_code
8-bit precision
fp8
Instructions to use patrickbdevaney/MiMo-V2.6-Flash-REAP50 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use patrickbdevaney/MiMo-V2.6-Flash-REAP50 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="patrickbdevaney/MiMo-V2.6-Flash-REAP50", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("patrickbdevaney/MiMo-V2.6-Flash-REAP50", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use patrickbdevaney/MiMo-V2.6-Flash-REAP50 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "patrickbdevaney/MiMo-V2.6-Flash-REAP50" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "patrickbdevaney/MiMo-V2.6-Flash-REAP50", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/patrickbdevaney/MiMo-V2.6-Flash-REAP50
- SGLang
How to use patrickbdevaney/MiMo-V2.6-Flash-REAP50 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "patrickbdevaney/MiMo-V2.6-Flash-REAP50" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "patrickbdevaney/MiMo-V2.6-Flash-REAP50", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "patrickbdevaney/MiMo-V2.6-Flash-REAP50" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "patrickbdevaney/MiMo-V2.6-Flash-REAP50", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use patrickbdevaney/MiMo-V2.6-Flash-REAP50 with Docker Model Runner:
docker model run hf.co/patrickbdevaney/MiMo-V2.6-Flash-REAP50
Add files using upload-large-folder tool
Browse files- model_mtp.safetensors +3 -0
- model_pp0_ep11_shard0.safetensors +3 -0
- model_pp0_ep13_shard0.safetensors +3 -0
- model_pp0_ep14_shard0.safetensors +3 -0
- model_pp0_ep16_shard0.safetensors +3 -0
- model_pp0_ep17_shard0.safetensors +3 -0
- model_pp0_ep18_shard0.safetensors +3 -0
- model_pp0_ep23_shard0.safetensors +3 -0
- model_pp0_ep24_shard0.safetensors +3 -0
- model_pp0_ep25_shard0.safetensors +3 -0
- model_pp0_ep26_shard0.safetensors +3 -0
- model_pp0_ep28_shard0.safetensors +3 -0
- model_pp0_ep32_shard0.safetensors +3 -0
- model_pp0_ep34_shard0.safetensors +3 -0
- model_pp0_ep35_shard0.safetensors +3 -0
- model_pp0_ep37_shard0.safetensors +3 -0
- model_pp0_ep39_shard0.safetensors +3 -0
- model_pp0_ep40_shard0.safetensors +3 -0
- model_pp0_ep41_shard0.safetensors +3 -0
- model_pp0_ep46_shard0.safetensors +3 -0
- model_pp0_ep48_shard0.safetensors +3 -0
- model_pp0_ep49_shard0.safetensors +3 -0
- model_pp0_ep51_shard0.safetensors +3 -0
- model_pp0_ep52_shard0.safetensors +3 -0
- model_pp0_ep53_shard0.safetensors +3 -0
- model_pp0_ep55_shard0.safetensors +3 -0
- model_pp0_ep58_shard0.safetensors +3 -0
- model_pp0_ep5_shard0.safetensors +3 -0
- model_pp0_ep60_shard0.safetensors +3 -0
- model_pp0_ep61_shard0.safetensors +3 -0
- model_pp0_ep62_shard0.safetensors +3 -0
- model_pp0_ep63_shard0.safetensors +3 -0
- model_pp0_ep6_shard0.safetensors +3 -0
model_mtp.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:01bdcd4f6f964e310ef4aceec6db2c16be96b00ad2ecb93a7f0f0effe459ab56
|
| 3 |
+
size 1189405992
|
model_pp0_ep11_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:277725feae63ab586688d5def967cc5c997fc21d03db396d48920cb6f1f42bee
|
| 3 |
+
size 1337008744
|
model_pp0_ep13_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e2b240087b572f224c03e8f42a053592b2a7bac6697a5b2cd1cf7251d7f262f
|
| 3 |
+
size 1163197472
|
model_pp0_ep14_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:62be3eddefb811fd3838019b7d386d6a22dd765206485a283ea3f19c6d109476
|
| 3 |
+
size 1283528344
|
model_pp0_ep16_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cc811ced56958680857fbbd3d75255488436d91d5704058a958efba007a4c1d0
|
| 3 |
+
size 1283528344
|
model_pp0_ep17_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c4a91c2613af21cb0f9e3b14594edbd47b761b13453e59ad375d426f707bb8bd
|
| 3 |
+
size 1323638640
|
model_pp0_ep18_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3587fc514eb75fb63d4dc3657b1ba3f8cf58b3bddb9105988196c563bfe18ae6
|
| 3 |
+
size 1337008744
|
model_pp0_ep23_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3a939dfb1a68d65ab3d0b474a6ee1bd3586e585893cbc7a6d65dde6c63435291
|
| 3 |
+
size 1377119024
|
model_pp0_ep24_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:354f6b9ae481fa3fcddbf5ae53cac1c541112fe98aae9ae50af5edae280b6714
|
| 3 |
+
size 1270158256
|
model_pp0_ep25_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3134efd7557457e99620ae9f2f43e5b335afe8ac1c931c0262f697c8cc93a8de
|
| 3 |
+
size 1323638616
|
model_pp0_ep26_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a0f0ff2e6aa07b981dbd994d3d536083ffdbeec276cf4d55b67489ae5258ab03
|
| 3 |
+
size 1363748912
|
model_pp0_ep28_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72b0ccfde0a4994412275b399fb5244f61cc1d0df2bc115fada4fd04bd018b13
|
| 3 |
+
size 1163197488
|
model_pp0_ep32_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72640fda3698ff06f18953bebda44b6647dc59d72c460bd0a2f418d4bfebb7a3
|
| 3 |
+
size 1216677880
|
model_pp0_ep34_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0a0c42d5d66a8e97e9db2908141d6a20bcb90ac7ca4df128e78b2c4d325c26db
|
| 3 |
+
size 1256788176
|
model_pp0_ep35_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a0d542b1bd757649d43b887bfcf562d82cfb77fad55cc786dd7a2633a77f4843
|
| 3 |
+
size 1163197448
|
model_pp0_ep37_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:78bb9d03af03fd46ce0ab26439573ee2d82dd4a4e2155be4ea1681c9bb1890dc
|
| 3 |
+
size 1016126416
|
model_pp0_ep39_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:01d98f9337c338ebb43062f76b6d01acc5a6b800feab27fb24332f61ed998311
|
| 3 |
+
size 1283528344
|
model_pp0_ep40_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bef2c8f2a896442d9443c9d87cad916b1661772f0f783a6bd68cb192b4622a8f
|
| 3 |
+
size 1123087176
|
model_pp0_ep41_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e81766abd6fc6c5313d7d3e471d7f6e2fc292503721ac9f8ec6e5c8e7865c78a
|
| 3 |
+
size 1176567584
|
model_pp0_ep46_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:009ce9ed9e8990adfa1ebc4060c87cecb6fb26f13b927ce587332f23cb94afbf
|
| 3 |
+
size 1216677880
|
model_pp0_ep48_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ce48dfaeb810a33be27803184be66e62f41327c8edfd957287d6d80117588d9
|
| 3 |
+
size 1430599504
|
model_pp0_ep49_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b0ffa6af11ae01dfe4a3fef35b18beb7737416eeb93b4e30329888b2fd5dd05a
|
| 3 |
+
size 1310268728
|
model_pp0_ep51_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:78a190922c2d1b072e447d46bfac13ac2031167d216739072dfe6395289fc88b
|
| 3 |
+
size 1056237128
|
model_pp0_ep52_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a21e3586a1b76e755452ab096a62a2e6b69165a4743d1fe5b62f5b49bfa4144b
|
| 3 |
+
size 1323639168
|
model_pp0_ep53_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b51575cfd5480637732b76c2ffc4b9fbabea165f9fc0add601398f50cae62cd8
|
| 3 |
+
size 1377119608
|
model_pp0_ep55_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e1a3747e68e4b5f70edf86c43d7f3b1d26e218d23306d7c37427bbaede7ad647
|
| 3 |
+
size 1256788728
|
model_pp0_ep58_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:669d5c7f7bbd27c53cfbd3b9df6ac9235e1b57dbd86b03493e320009122941b9
|
| 3 |
+
size 1216678376
|
model_pp0_ep5_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:881e9d9e89acf8b9e00bcda6c692d228fcb83fd1e15dc25f0cd99bfe4ef138d8
|
| 3 |
+
size 1417229128
|
model_pp0_ep60_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:adca17999152a1eb60395b5dc56fff4788cb51e58e231295869d15038908561f
|
| 3 |
+
size 1323639232
|
model_pp0_ep61_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d0af9c0035f853737e212c5a7d3d6fc862330d281bf7949e3a2e3a04cf857e3
|
| 3 |
+
size 1270158808
|
model_pp0_ep62_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f5aa5f077083a341e2ab1915c6907bbc2bdfd285ceb03e7eb258ba154938849
|
| 3 |
+
size 1270158808
|
model_pp0_ep63_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a0b0cb56640525ce7056d9438ac74c84bdd32965c5634ac57e208b358ad4618d
|
| 3 |
+
size 1243418640
|
model_pp0_ep6_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8d6b7263caeb0a06fc902437a09f5191a55130d507551174841e78bc8b367f8
|
| 3 |
+
size 1149827320
|