lmstudio-community/gemma-4-12B-it-QAT-GGUF Q4_0
LM Studio
Great for vision, strong improvement over the non-QAT version
chat vision
Setup details
Tested especially the OCR capabilities, these are excellent for mobile photos.
It still fails to parse large jpegs and will hallucinate content, but again to a lesser extent than its non-QAT counterpart.
| M4 Pro | 1x |