merve PRO
merve
AI & ML interests
I love this website
VLMs, vision & co
Recent Activity
updated a Space 5 days ago
merve/helium-browser-env upvoted an article 5 days ago
A curriculum for post-training agentsOrganizations
![Unofficial Mistral Community [deprecated]'s profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/6141a88b3a0ec78603c9e784/HAdAzcs1CDB9OxgxT2W9K.png)
-
SeerRay-Lab/Xiaomi-OCR-0
Image-Text-to-Text • 0.9B • Updated • 10.7k • 53 -
emperorofrome/Gmcoder
Text Generation • 9B • Updated • 5.44k • 25 -
RunningHubAI/rh-qwen-image-2.1-lora-2104918997757157378
Text-to-Image • Updated • 88 -
vllm-sr/Decision-2.0-Vega-27B
Zero-Shot Classification • Updated • 3.14k • 77
detection, segmentation, OCR, depth, pose, grounding, VLM detection
-
PaddlePaddle/PP-OCRv6_medium_det
Image-to-Text • Updated • 62.3k • 36 -
PaddlePaddle/PP-OCRv6_tiny_det_safetensors
Image-to-Text • 438k • Updated • 442 • 27 -
moonshotai/Kimi-K2.7-Code
Image-Text-to-Text • 1T • Updated • 89.2k • • 1.42k -
PaddlePaddle/PP-OCRv6_small_rec_onnx
Image-to-Text • Updated • 32.7k • 23
-
internlm/Intern-S2-Preview
Image-Text-to-Text • 36B • Updated • 2.11k • 123 -
nvidia/nemotron-3.5-asr-streaming-0.6b
Automatic Speech Recognition • 0.6B • Updated • 1.09M • • 1.24k -
internlm/Intern-S2-Preview-FP8
Image-Text-to-Text • 36B • Updated • 293 • 24 -
Aratako/Irodori-TTS-500M-v3
Text-to-Speech • 0.5B • Updated • 118
Curated collection of notable models, datasets, and spaces from the week.
-
google/translategemma-27b-it
Image-Text-to-Text • 27B • Updated • 6.01k • 409 -
kakaocorp/kanana-2-30b-a3b-mid-2601
Text Generation • 31B • Updated • 198 • 31 -
black-forest-labs/FLUX.2-klein-base-4B
Image-to-Image • 4B • Updated • 562k • • 187 -
google/translategemma-12b-it
Image-Text-to-Text • 12B • Updated • 7.86k • 359
A collection of real-time detectors.
-
facebook/metaclip-2-worldwide-s16
Zero-Shot Image Classification • 0.4B • Updated • 698 • 13 -
facebook/metaclip-2-worldwide-m16
Zero-Shot Image Classification • 0.5B • Updated • 61 • 4 -
facebook/metaclip-2-worldwide-l14
Zero-Shot Image Classification • 1B • Updated • 1.04k • 16 -
facebook/metaclip-2-worldwide-b32
Zero-Shot Image Classification • 0.6B • Updated • 151 • 10
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
Models and datasets of the second week of Jan 2025.
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • 8B • Updated • 15.5k • 209 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 3.26k • 48 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 17.5k • 461 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 5.56k • • 303
Recent depth models
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • 25.6M • Updated • 252k • • 529 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 86.4M • Updated • 1.07M • 431 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 88M • Updated • 15.6k • 28 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 850k • 126
-
facebook/detr-resnet-50
Object Detection • 41.6M • Updated • 115k • • 989 -
facebook/detr-resnet-101-dc5
Object Detection • 60.7M • Updated • 4.57k • 26 -
facebook/detr-resnet-50-dc5
Object Detection • 41.6M • Updated • 1.89k • 10 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 6.45M • 2.13k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 16.7M • 1.27k -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 97.8k • 322 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 22.7k • 31
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 73.7k • 125 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 15.3k • 47 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 9.37k • 15 -
google/vivit-b-16x2
Video Classification • Updated • 43.8k • 20
This collection contains models and demos of SAM and it's smaller friends.
A collection dedicated to SigLIP applications
-
Draw To Search Art
🐠74Draw/upload image and search among WikiART using SigLIP
-
Compare Clip Siglip
🏃24Compare strong zero-shot image classification models
-
Multilingual Zero Shot Image Clf
🏢13Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 197 • 48
A collection of everything SegGPT.
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 20k • 22 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 7.48k • 33 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.3k • 36
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 20k • 22 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 7.48k • 33 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.3k • 36
A collection of video-language models
-
Video Llava
🐨21Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 32.6k • 126 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 589 • 12 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 428 • 9
-
thinkingmachines/Inkling
Image-Text-to-Text • 952B • Updated • 1.59M • • 1.83k -
Lightricks/LTX-2.3-22b-LoRA-Foley-V2A
Text-to-Audio • Updated • 578 • 38 -
genzeonplatform/healthcare-brain-diagnosis-icd-ner
Token Classification • 0.1B • Updated • 27 • 22 -
Hippotes/Ideogram4-Fal-ComfyUI
Updated • 2.44k • 33
RF-DETR checkpoints converted to be used with 🤗 Transformers
Curated collection of notable models and spaces from the week of April 17.
-
OpenMOSS-Team/MOSS-Audio-4B-Instruct
Audio-Text-to-Text • 5B • Updated • 6.99k • 88 -
OpenMOSS-Team/MOSS-Audio-8B-Thinking
Audio-Text-to-Text • 9B • Updated • 1.18k • 90 -
bytedance-research/Timer-S1
Time Series Forecasting • 8B • Updated • 334 • 36 -
BugTraceAI/BugTraceAI-Apex-G4-26B-Q4
25B • Updated • 934 • 99
YOLO26 models: detection, segmentation, classification, pose, and OBB variants with demos and ONNX variants.
-
Wuli-art/Qwen-Image-2512-Turbo-LoRA
Text-to-Image • Updated • 3.91k • • 227 -
miromind-ai/MiroThinker-v1.5-235B
Text Generation • 235B • Updated • 73 • 254 -
prithivMLmods/Qwen-Image-Edit-2511-Object-Remover
Image-to-Image • Updated • 7.05k • • 75 -
tencent/Youtu-LLM-2B-Base
Text Generation • 2B • Updated • 1.02k • 43
-
facebook/sam3
Mask Generation • 0.9B • Updated • 1.85M • 5.09k -
SAM3 Video Segmentation
🐠118Track and label objects in videos using text prompts or clicks
-
onnx-community/sam3-tracker-ONNX
Mask Generation • Updated • 1.04k • 39 -
SAM3 Tracker WebGPU
🎯32Segment images with click points and download cutouts
-
moonshotai/Kimi-VL-A3B-Thinking
Image-Text-to-Text • 16B • Updated • 12.1k • 455 -
agentica-org/DeepCoder-14B-Preview
Text Generation • 15B • Updated • 747 • • 684 -
HiDream-ai/HiDream-I1-Full
Text-to-Image • 17B • Updated • 790 • • 1.01k -
OpenGVLab/InternVL3-78B
Image-Text-to-Text • 78B • Updated • 8.66k • 239
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 75 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 20 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 49 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 123
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 850k • 126 -
google/flan-t5-xl
3B • Updated • 128k • 542 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 32.5k • 20 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 15.6k • 29
-
facebook/deit-base-distilled-patch16-384
Image Classification • 87.6M • Updated • 14.4k • • 12 -
facebook/convnextv2-base-1k-224
Image Classification • 88.7M • Updated • 544 • 6 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 14.2k • • 38 -
google/vit-base-patch32-384
Image Classification • 88.3M • Updated • 17k • • 31
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 289 • 27 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 3.75M • Updated • 285k • • 209 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 43M • Updated • 129 • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 45.3k • • 49
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
-
timbrooks/instruct-pix2pix
Image-to-Image • 0.9B • Updated • 63.1k • 1.19k -
TencentARC/t2i-adapter-canny-sdxl-1.0
Image-to-Image • 79M • Updated • 2.16k • 54 -
TencentARC/t2i-adapter-sketch-sdxl-1.0
Image-to-Image • 79M • Updated • 2.45k • 77 -
CrucibleAI/ControlNetMediaPipeFace
Image-to-Image • 0.4B • Updated • 518 • 576
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 481k • 1.5k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 1.26M • 904 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 119k • 532 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 2.49k • 111
Foundation models for computer vision.
Models and applications of OWL-ViT and OWLv2.
A collection of open-source document AI 📄 📝 📈
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 39 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 49 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 13 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 20k • 22 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 7.48k • 33 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.3k • 36
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
-
Vidore Leaderboard
🥇212Browse and compare visual document retrieval model scores
-
Open VLM Leaderboard
🌎1.03kVLMEvalKit Evaluation Results Collection
-
Vision Arena (Testing VLMs side-by-side)
🖼560Open the Vision Arena interface for image tasks
-
SEED-Bench Leaderboard
🏆85Submit model evaluation results to leaderboard
All the models and demos for SAM2
-
SeerRay-Lab/Xiaomi-OCR-0
Image-Text-to-Text • 0.9B • Updated • 10.7k • 53 -
emperorofrome/Gmcoder
Text Generation • 9B • Updated • 5.44k • 25 -
RunningHubAI/rh-qwen-image-2.1-lora-2104918997757157378
Text-to-Image • Updated • 88 -
vllm-sr/Decision-2.0-Vega-27B
Zero-Shot Classification • Updated • 3.14k • 77
-
thinkingmachines/Inkling
Image-Text-to-Text • 952B • Updated • 1.59M • • 1.83k -
Lightricks/LTX-2.3-22b-LoRA-Foley-V2A
Text-to-Audio • Updated • 578 • 38 -
genzeonplatform/healthcare-brain-diagnosis-icd-ner
Token Classification • 0.1B • Updated • 27 • 22 -
Hippotes/Ideogram4-Fal-ComfyUI
Updated • 2.44k • 33
detection, segmentation, OCR, depth, pose, grounding, VLM detection
-
PaddlePaddle/PP-OCRv6_medium_det
Image-to-Text • Updated • 62.3k • 36 -
PaddlePaddle/PP-OCRv6_tiny_det_safetensors
Image-to-Text • 438k • Updated • 442 • 27 -
moonshotai/Kimi-K2.7-Code
Image-Text-to-Text • 1T • Updated • 89.2k • • 1.42k -
PaddlePaddle/PP-OCRv6_small_rec_onnx
Image-to-Text • Updated • 32.7k • 23
-
internlm/Intern-S2-Preview
Image-Text-to-Text • 36B • Updated • 2.11k • 123 -
nvidia/nemotron-3.5-asr-streaming-0.6b
Automatic Speech Recognition • 0.6B • Updated • 1.09M • • 1.24k -
internlm/Intern-S2-Preview-FP8
Image-Text-to-Text • 36B • Updated • 293 • 24 -
Aratako/Irodori-TTS-500M-v3
Text-to-Speech • 0.5B • Updated • 118
RF-DETR checkpoints converted to be used with 🤗 Transformers
Curated collection of notable models, datasets, and spaces from the week.
Curated collection of notable models and spaces from the week of April 17.
-
OpenMOSS-Team/MOSS-Audio-4B-Instruct
Audio-Text-to-Text • 5B • Updated • 6.99k • 88 -
OpenMOSS-Team/MOSS-Audio-8B-Thinking
Audio-Text-to-Text • 9B • Updated • 1.18k • 90 -
bytedance-research/Timer-S1
Time Series Forecasting • 8B • Updated • 334 • 36 -
BugTraceAI/BugTraceAI-Apex-G4-26B-Q4
25B • Updated • 934 • 99
-
google/translategemma-27b-it
Image-Text-to-Text • 27B • Updated • 6.01k • 409 -
kakaocorp/kanana-2-30b-a3b-mid-2601
Text Generation • 31B • Updated • 198 • 31 -
black-forest-labs/FLUX.2-klein-base-4B
Image-to-Image • 4B • Updated • 562k • • 187 -
google/translategemma-12b-it
Image-Text-to-Text • 12B • Updated • 7.86k • 359
YOLO26 models: detection, segmentation, classification, pose, and OBB variants with demos and ONNX variants.
-
Wuli-art/Qwen-Image-2512-Turbo-LoRA
Text-to-Image • Updated • 3.91k • • 227 -
miromind-ai/MiroThinker-v1.5-235B
Text Generation • 235B • Updated • 73 • 254 -
prithivMLmods/Qwen-Image-Edit-2511-Object-Remover
Image-to-Image • Updated • 7.05k • • 75 -
tencent/Youtu-LLM-2B-Base
Text Generation • 2B • Updated • 1.02k • 43
A collection of real-time detectors.
-
facebook/sam3
Mask Generation • 0.9B • Updated • 1.85M • 5.09k -
SAM3 Video Segmentation
🐠118Track and label objects in videos using text prompts or clicks
-
onnx-community/sam3-tracker-ONNX
Mask Generation • Updated • 1.04k • 39 -
SAM3 Tracker WebGPU
🎯32Segment images with click points and download cutouts
-
facebook/metaclip-2-worldwide-s16
Zero-Shot Image Classification • 0.4B • Updated • 698 • 13 -
facebook/metaclip-2-worldwide-m16
Zero-Shot Image Classification • 0.5B • Updated • 61 • 4 -
facebook/metaclip-2-worldwide-l14
Zero-Shot Image Classification • 1B • Updated • 1.04k • 16 -
facebook/metaclip-2-worldwide-b32
Zero-Shot Image Classification • 0.6B • Updated • 151 • 10
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
-
moonshotai/Kimi-VL-A3B-Thinking
Image-Text-to-Text • 16B • Updated • 12.1k • 455 -
agentica-org/DeepCoder-14B-Preview
Text Generation • 15B • Updated • 747 • • 684 -
HiDream-ai/HiDream-I1-Full
Text-to-Image • 17B • Updated • 790 • • 1.01k -
OpenGVLab/InternVL3-78B
Image-Text-to-Text • 78B • Updated • 8.66k • 239
Models and datasets of the second week of Jan 2025.
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 75 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 20 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 49 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 123
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • 8B • Updated • 15.5k • 209 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 3.26k • 48 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 17.5k • 461 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 5.56k • • 303
Recent depth models
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 850k • 126 -
google/flan-t5-xl
3B • Updated • 128k • 542 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 32.5k • 20 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 15.6k • 29
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • 25.6M • Updated • 252k • • 529 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 86.4M • Updated • 1.07M • 431 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 88M • Updated • 15.6k • 28 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 850k • 126
-
facebook/deit-base-distilled-patch16-384
Image Classification • 87.6M • Updated • 14.4k • • 12 -
facebook/convnextv2-base-1k-224
Image Classification • 88.7M • Updated • 544 • 6 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 14.2k • • 38 -
google/vit-base-patch32-384
Image Classification • 88.3M • Updated • 17k • • 31
-
facebook/detr-resnet-50
Object Detection • 41.6M • Updated • 115k • • 989 -
facebook/detr-resnet-101-dc5
Object Detection • 60.7M • Updated • 4.57k • 26 -
facebook/detr-resnet-50-dc5
Object Detection • 41.6M • Updated • 1.89k • 10 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 289 • 27 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 3.75M • Updated • 285k • • 209 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 43M • Updated • 129 • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 45.3k • • 49
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 6.45M • 2.13k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 16.7M • 1.27k -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 97.8k • 322 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 22.7k • 31
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
-
timbrooks/instruct-pix2pix
Image-to-Image • 0.9B • Updated • 63.1k • 1.19k -
TencentARC/t2i-adapter-canny-sdxl-1.0
Image-to-Image • 79M • Updated • 2.16k • 54 -
TencentARC/t2i-adapter-sketch-sdxl-1.0
Image-to-Image • 79M • Updated • 2.45k • 77 -
CrucibleAI/ControlNetMediaPipeFace
Image-to-Image • 0.4B • Updated • 518 • 576
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 73.7k • 125 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 15.3k • 47 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 9.37k • 15 -
google/vivit-b-16x2
Video Classification • Updated • 43.8k • 20
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 481k • 1.5k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 1.26M • 904 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 119k • 532 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 2.49k • 111
Foundation models for computer vision.
This collection contains models and demos of SAM and it's smaller friends.
Models and applications of OWL-ViT and OWLv2.
A collection dedicated to SigLIP applications
-
Draw To Search Art
🐠74Draw/upload image and search among WikiART using SigLIP
-
Compare Clip Siglip
🏃24Compare strong zero-shot image classification models
-
Multilingual Zero Shot Image Clf
🏢13Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 197 • 48
A collection of open-source document AI 📄 📝 📈
A collection of everything SegGPT.
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 39 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 49 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 13 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 20k • 22 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 7.48k • 33 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.3k • 36
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 20k • 22 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 7.48k • 33 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.3k • 36
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 187k • 157 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 20k • 22 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 7.48k • 33 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.3k • 36
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
-
Vidore Leaderboard
🥇212Browse and compare visual document retrieval model scores
-
Open VLM Leaderboard
🌎1.03kVLMEvalKit Evaluation Results Collection
-
Vision Arena (Testing VLMs side-by-side)
🖼560Open the Vision Arena interface for image tasks
-
SEED-Bench Leaderboard
🏆85Submit model evaluation results to leaderboard
A collection of video-language models
-
Video Llava
🐨21Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 32.6k • 126 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 589 • 12 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 428 • 9
All the models and demos for SAM2