lmstudio-community/gemma-4-12B-it-GGUF Q4_K_M
LM Studio
Great at image understanding but can hallucinate
chat reasoning vision
Setup details
Running on a Macbook with 24GB alongside other applications is possible without using swap, at a reasonable 28 - 30 tokens/s.
I asked it to parse photos and blueprints of our building. It worked well for photos, and reasoning traces made sense.
For blueprint images (large resolution jpgs), the model started making up text labels and descriptions. I took photos of books to categorize them and it did okay but with spelling mistakes.
| M4 Pro | 1x |