| | --- |
| | tags: |
| | - text-generation-inference |
| | - transformers |
| | - unsloth |
| | - qwen3_vl |
| | - trl |
| | - sft |
| | - chemistry |
| | - code |
| | - climate |
| | - art |
| | - biology |
| | - finance |
| | - legal |
| | - music |
| | - medical |
| | - agent |
| | license: apache-2.0 |
| | language: |
| | - en |
| | - ab |
| | - aa |
| | - ae |
| | - af |
| | - ak |
| | - am |
| | - an |
| | - ar |
| | - as |
| | - av |
| | - ay |
| | - az |
| | - ba |
| | - be |
| | - bg |
| | - bh |
| | - bi |
| | - bm |
| | - bn |
| | - bo |
| | - br |
| | - bs |
| | - ca |
| | - ce |
| | - ch |
| | - co |
| | - cr |
| | - cs |
| | - cu |
| | - cv |
| | - cy |
| | - da |
| | - de |
| | - dv |
| | - dz |
| | - ee |
| | - el |
| | - eo |
| | - es |
| | - et |
| | - eu |
| | - fa |
| | - ff |
| | - fi |
| | - fj |
| | - fo |
| | - fr |
| | - fy |
| | - ga |
| | - gd |
| | - gl |
| | - gn |
| | - gv |
| | - ha |
| | - he |
| | - hi |
| | - ho |
| | - gu |
| | - hr |
| | - ht |
| | - hu |
| | - hz |
| | - hy |
| | - id |
| | - ia |
| | - ig |
| | - ie |
| | - ik |
| | - ii |
| | - is |
| | - io |
| | - iu |
| | - it |
| | - jv |
| | - ja |
| | - kg |
| | - ka |
| | - kj |
| | - ki |
| | - kl |
| | - kk |
| | - kn |
| | - km |
| | - kr |
| | - ko |
| | - ku |
| | - ks |
| | - kw |
| | - kv |
| | - la |
| | - ky |
| | - lg |
| | - lb |
| | - ln |
| | - li |
| | - lt |
| | - lo |
| | - lv |
| | - lu |
| | - mg |
| | - mi |
| | - mh |
| | - ml |
| | - mk |
| | - mr |
| | - mn |
| | - mt |
| | - ms |
| | - na |
| | - my |
| | - nd |
| | - nb |
| | - ng |
| | - nl |
| | - ne |
| | - 'no' |
| | - nn |
| | - nv |
| | - nr |
| | - oc |
| | - oj |
| | - om |
| | - ny |
| | - os |
| | - or |
| | - pa |
| | - pi |
| | - pl |
| | - ps |
| | - pt |
| | - rm |
| | - rn |
| | - qu |
| | - ro |
| | - ru |
| | - sn |
| | - rw |
| | - so |
| | - sa |
| | - sc |
| | - sd |
| | pipeline_tag: image-text-to-text |
| | library_name: transformers |
| | --- |
| | <img src='bannerocr.png'> |
| |
|
| | # 🖼️ Next OCR 8B |
| |
|
| | ### *Compact OCR AI — Accurate, Fast, Multilingual, Math-Optimized* |
| |
|
| | [](https://opensource.org/licenses/MIT) |
| | []() |
| | [](https://huggingface.co/Lamapi/next-ocr) |
| | [](https://discord.gg/XgH4EpyPD2) |
| |
|
| | --- |
| |
|
| | ## 📖 Overview |
| |
|
| | **Next OCR 8B** is an **8-billion parameter model** optimized for **optical character recognition (OCR) tasks** with **mathematical and tabular content understanding**. |
| |
|
| | Supports **multilingual OCR** (Turkish, English, German, Spanish, French, Chinese, Japanese, Korean, Russian...) with high accuracy, including structured documents like tables, forms, and formulas. |
| |
|
| | --- |
| |
|
| | ## ⚡ Highlights |
| |
|
| | * 🖼️ Accurate text extraction, including math and tables |
| | * 🌍 Multilingual support (30+ languages) |
| | * ⚡ Lightweight and efficient |
| | * 💬 Instruction-tuned for document understanding and analysis |
| |
|
| | --- |
| |
|
| | ## 📊 Benchmark & Comparison |
| |
|
| |  |
| |
|
| | --- |
| |
|
| | | Model | OCR-Bench Accuracy (%) | Multilingual Accuracy (%) | Layout / Table Understanding (%) | |
| | | ------------------------------- | ------------------------ | ------------------------- | -------------------------------- | |
| | | **Next OCR** | **99.0** | **96.8** | **95.3** | |
| | | PaddleOCR | 95.2 | 93.9 | 95.3 | |
| | | Deepseek OCR | 90.6 | 87.4 | 86.1 | |
| | | Tesseract | 92.0 | 88.4 | 72.0 | |
| | | EasyOCR | 90.4 | 84.7 | 78.9 | |
| | | Google Cloud Vision / DocAI | 98.7 | 95.5 | 93.6 | |
| | | Amazon Textract | 94.7 | 86.2 | 86.1 | |
| | | Azure Document Intelligence | 95.1 | 93.6 | 91.4 | |
| |
|
| | --- |
| |
|
| | | Model | Handwriting (%) | Scene Text (%) | Complex Tables (%) | |
| | | --------------------------- | --------------- | -------------- | ------------------ | |
| | | **Next OCR** | 92 | 96 | 91 | |
| | | PaddleOCR | 88 | 92 | 90 | |
| | | Deepseek OCR | 80 | 85 | 83 | |
| | | Tesseract | 75 | 88 | 70 | |
| | | EasyOCR | 78 | 86 | 75 | |
| | | Google Cloud Vision / DocAI | 90 | 95 | 92 | |
| | | Amazon Textract | 85 | 90 | 88 | |
| | | Azure Document Intelligence | 87 | 91 | 89 | |
| |
|
| | --- |
| |
|
| | ## 🚀 Installation & Usage |
| |
|
| | ```python |
| | from transformers import AutoTokenizer, AutoModelForVision2Seq |
| | import torch |
| | |
| | model_id = "Lamapi/next-ocr" |
| | |
| | tokenizer = AutoTokenizer.from_pretrained(model_id) |
| | model = AutoModelForVision2Seq.from_pretrained(model_id, torch_dtype=torch.float16) |
| | |
| | img = Image.open("image.jpg") |
| | |
| | # ATTENTION: The content list must include both an image and text. |
| | messages = [ |
| | {"role": "system", "content": "You are Next-OCR, an helpful AI assistant trained by Lamapi."}, |
| | { |
| | "role": "user", |
| | "content": [ |
| | {"type": "image", "image": img}, |
| | {"type": "text", "text": "Read the text in this image and summarize it."} |
| | ] |
| | } |
| | ] |
| | |
| | # Apply the chat template correctly |
| | prompt = processor.apply_chat_template(messages, tokenize=False, add_generation_prompt=True) |
| | inputs = processor(text=prompt, images=[img], return_tensors="pt").to(model.device) |
| | |
| | with torch.no_grad(): |
| | generated = model.generate(**inputs, max_new_tokens=256) |
| | |
| | print(processor.decode(generated[0], skip_special_tokens=True)) |
| | ``` |
| |
|
| | --- |
| |
|
| | ## 🧩 Key Features |
| |
|
| | | Feature | Description | |
| | | -------------------------- | --------------------------------------------------------------- | |
| | | 🖼️ High-Accuracy OCR | Extracts text from images, documents, and screenshots reliably. | |
| | | 🇹🇷 Multilingual Support | Works with 30+ languages including Turkish. | |
| | | ⚡ Lightweight & Efficient | Optimized for resource-constrained environments. | |
| | | 📄 Layout & Math Awareness | Handles tables, forms, and mathematical formulas. | |
| | | 🏢 Reliable Outputs | Suitable for enterprise document workflows. | |
| |
|
| | --- |
| |
|
| | ## 📐 Model Specifications |
| |
|
| | | Specification | Details | |
| | | ----------------- | --------------------------------------------------------- | |
| | | **Base Model** | Qwen 3 | |
| | | **Parameters** | 8 Billion | |
| | | **Architecture** | Vision + Transformer (OCR LLM) | |
| | | **Modalities** | Image-to-text | |
| | | **Fine-Tuning** | OCR datasets with multilingual and math/tabular content | |
| | | **Optimizations** | Quantization-ready, FP16 support | |
| | | **Primary Focus** | Text extraction, document understanding, mathematical OCR | |
| |
|
| | --- |
| |
|
| | ## 🎯 Ideal Use Cases |
| |
|
| | * Document digitization |
| | * Invoice & receipt processing |
| | * Multilingual OCR pipelines |
| | * Tables, forms, and formulas extraction |
| | * Enterprise document management |
| |
|
| | --- |
| |
|
| | ## 📄 License |
| |
|
| | MIT License — free for commercial & non-commercial use. |
| |
|
| | --- |
| |
|
| | ## 📞 Contact & Support |
| |
|
| | * 📧 Email: [lamapicontact@gmail.com](mailto:lamapicontact@gmail.com) |
| | * 🤗 HuggingFace: [Lamapi](https://huggingface.co/Lamapi) |
| |
|
| | --- |
| |
|
| | > **Next OCR** — Compact *OCR + math-capable* AI, blending **accuracy**, **speed**, and **multilingual document intelligence**. |
| |
|
| | [](https://huggingface.co/Lamapi) |
