Image-to-text models Collection of image captioning models Salesforce/blip-image-captioning-large Image-to-Text • 0.5B • Updated Feb 3, 2025 • 769k • 1.48k microsoft/git-large-coco Image-to-Text • 0.4B • Updated Jun 26, 2023 • 4.18k • 105 Salesforce/instructblip-vicuna-7b Image-Text-to-Text • 8B • Updated Feb 3, 2025 • 9.76k • 101 Salesforce/blip2-flan-t5-xxl Image-Text-to-Text • 12B • Updated Feb 3, 2025 • 979 • 94
SigLIP release SigLIP improves upon CLIP with a sigmoid loss. Both English-only and multilingual checkpoints are released. Sigmoid Loss for Language Image Pre-Training Paper • 2303.15343 • Published Mar 27, 2023 • 12 google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 1.37M • 83 google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.8k • 6 google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.2k • 11
google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 1.37M • 83
google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.8k • 6
google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.2k • 11
Image-to-text models Collection of image captioning models Salesforce/blip-image-captioning-large Image-to-Text • 0.5B • Updated Feb 3, 2025 • 769k • 1.48k microsoft/git-large-coco Image-to-Text • 0.4B • Updated Jun 26, 2023 • 4.18k • 105 Salesforce/instructblip-vicuna-7b Image-Text-to-Text • 8B • Updated Feb 3, 2025 • 9.76k • 101 Salesforce/blip2-flan-t5-xxl Image-Text-to-Text • 12B • Updated Feb 3, 2025 • 979 • 94
SigLIP release SigLIP improves upon CLIP with a sigmoid loss. Both English-only and multilingual checkpoints are released. Sigmoid Loss for Language Image Pre-Training Paper • 2303.15343 • Published Mar 27, 2023 • 12 google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 1.37M • 83 google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.8k • 6 google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.2k • 11
google/siglip-base-patch16-224 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 1.37M • 83
google/siglip-base-patch16-256 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.8k • 6
google/siglip-base-patch16-384 Zero-Shot Image Classification • 0.2B • Updated Sep 26, 2024 • 29.2k • 11
Running on Zero Agents 5 SAM-3 vs SAM-3-LiteText 🖼 Compare text‑guided image segmentation with two SAM‑3 models
Running on Zero MCP 3 Videomt Transformers Demo 🐨 Segment videos with instance, semantic, or panoptic masks
Runtime error Agents 23 KOSMOS-2.5 Document AI Demo 📄 Upload an image to generate markdown, extract text, or ask questions
nielsr/arxiv-chandra-ocr-2-include-images-demo-2604-07429-retry-20260417 Viewer • Updated Apr 17 • 1 • 42
nielsr/arxiv-chandra-ocr-2-include-images-demo-2604-08626-duplicate-caption-fix-v2-20260416 Viewer • Updated Apr 16 • 1 • 27
nielsr/arxiv-chandra-ocr-2-include-images-demo-2604-08626-duplicate-caption-fix-20260416 Viewer • Updated Apr 16 • 1 • 34
nielsr/arxiv-chandra-ocr-2-include-images-demo-2604-08626-spacing-fix-v2-20260416 Viewer • Updated Apr 16 • 1 • 36
nielsr/arxiv-chandra-ocr-2-include-images-demo-2604-08626-spacing-fix-20260416 Viewer • Updated Apr 16 • 1 • 30