Skip to content
C.W.K.
Stream
Lesson 01 of 04 · published

Vision-Capable Local Models

~18 min · vision, multimodal

Level 0Downloader
0 XP0/41 lessons0/11 achievements
0/120 XP to next level120 XP to go0% complete

Local vision in 2026

Vision models accept images alongside text and answer questions about them. The 2026 local landscape is good enough for OCR, chart reading, screenshot analysis, and most "describe this image" tasks. It is still behind the current frontier cloud models on the hardest visual reasoning. Deliberately unnamed: whichever three you would list today will be wrong within a year, and the gap is what matters, not the leaderboard.

ModelSizesStrength
Llama 3.2-Vision11B, 90BStrong general vision; well-supported in Ollama
Gemma 34B / 12B / 27BStrong quality-per-size on modest hardware — check Gemma 4 before you settle on it
Qwen 2.5-VL3B / 7B / 32B / 72BStructured data extraction, OCR, multilingual — strong, though no longer the only serious OCR option
Qwen 3.50.8B–122B local; 397B cloud-onlyVision + tools + thinking — the most capable single model here
LLaVA7B / 13B / 34BThe OG open vision model; still serviceable
MiniCPM-V8BCompact, capable, good for edge deployment
Mistral Small 3.1variousVision support added in 3.1

Picking by use case

  • OCR / structured extraction: Qwen 2.5-VL, or a dedicated OCR model such as glm-ocr. Benchmark both on your own documents; the ranking here moves faster than any list survives.
  • General "describe this": Gemma 3 12B/27B or Llama 3.2-Vision 11B.
  • Tight memory: Gemma 3 4B or MiniCPM-V 8B.
  • Vision + tools + thinking: Qwen 3.5 — already in the Ollama library, 0.8B through 122B for local tags, so pick the size your machine fits. The 397B exists only as qwen3.5:397b-cloud.

Always verify capability

Vision support is binary at the model level — either the model has the visual encoder or it doesn't. The rows under ollama show MODEL's Capabilities header are the source of truth — a header, then one capability per row.

Code

Verify and pull vision models·bash
# Check capability (look for 'vision' among the rows).
# Grepping for the header would print 'Capabilities' and nothing else.
for m in llama3.2-vision gemma3:12b qwen2.5vl; do
  printf '%-20s ' "$m"
  ollama show "$m" | awk '/^  Capabilities/{f=1;next} f&&NF==0{exit} f{print $1}' | paste -sd' ' -
done

# Pull a daily-driver vision model
ollama pull gemma3:12b

# Pull an OCR-strong model
ollama pull qwen2.5vl:7b

External links

Exercise

Pull two vision models (one general, one OCR-strong) and read each one's Capabilities rows with the loop above. Hit each with the same image and the same prompt; note which one wins on the task you actually care about.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign in — Please sign in to comment.

No comments yet — be the first.