Mohammad Karami
mmd-k
AI & ML interests
Machine learning and fine tuning LLMs
Recent Activity
upvoted an article 1 day ago
Up to 3.2x Faster Inference with LFM2.5-DSpark reacted to nwaughachukwuma's post with 🔥 1 day ago
# VLM Run Gateway: Run GLM-OCR, DeepSeek-OCR-2, and Dots.mocr with an OpenAI Compatible API
Open-weight OCR VLMs have advanced significantly over the past year, yet most teams still rely on frontier VLMs for document parsing because researching, evaluating, and deploying the right models remains challenging.
So we built VLM Run Gateway: one OpenAI-compatible endpoint for open-weight OCR and VLM models.
If you’re using frontier VLMs primarily for OCR/document parsing, open-weight OCR models can be dramatically cheaper and often very accurate. With a one-line change, you can switch between open-weight OCR VLMs (DeepSeek OCR 2, GLM-OCR, dots.mocr, Paddle OCR VL, PP-OCRv6, etc.) and process 100K+ pages for under $60.
Try it out quickly via OpenAI SDK:
```
client = OpenAI(
base_url="https://gateway.vlm.run/v1/openai",
api_key="<VLMRUN_API_KEY>",
)
response = client.chat.completions.create(
model="rednote-hilab/dots.mocr",
messages=[{
"role": "user",
"content": [{
"type": "document_url",
"document_url": {"url": "https://.../invoice.pdf"},
}],
}],
extra_body={"document_dpi": 72},
)
```
or via our CLI:
```
pip install vlmrun
vlmrun gw models
vlmrun config set --api-key 'vlmrun' # anon-user, rate-limited
vlmrun gw chat <doc>.pdf -m zai-org/glm-ocr
vlmrun gw chat <doc>.pdf -m zai-org/glm-ocr --json-mode
vlmrun gw chat <doc>.pdf -m deepseek-ai/deepseek-ocr-2
vlmrun gw chat <doc>.pdf -m rednote-hilab/dots.mocr
vlmrun gw chat <doc>.pdf -m paddleocr/pp-ocrv6
```
Docs: https://docs.vlm.run/gateway
Catalog: https://docs.vlm.run/gateway/models
MCP: https://docs.vlm.run/gateway/mcp-server
Colab Quickstart: https://colab.research.google.com/drive/1RkuVIyuc5Po-UlcSlFyJCam5tjCm9IHM?usp=sharing
Read the full post here: https://huggingface.co/blog/vlm-run/intro-to-vlmrun-gateway liked a model 8 days ago
Qwen/Qwen3.8-27BOrganizations
None yet