Loading original post…Open on X ↗
Local "Jev"-style vision inference hack: maps candidate outputs to fixed labels, prefills then samples with capped tokens, running a 4-bit multimodal Qwen-3.5-0.8B on a 16GB M4 MacBook Pro to perform three-color item sorting in 200ms.
Original post
Loading original post…Open on X ↗
jev
Start typing to find a use case.