Jeff: The Tiny Local Model That Makes Decisions in ~30 ms
Jeff turns Qwen3.5 and Gemma 4 into small decision models that classify plain-language situations without generating a paragraph. The 0.8B version reports probabilities in roughly 22–28 ms on listed GPU and Apple silicon hardware, while local fine-tuning can adapt it to specialized tasks.