Streaming Gemma 4 26B on 2GB RAM: TurboFieldfare on M-series Macs
TurboFieldfare runs Gemma 4 26B-A4B on Apple Silicon with ~2GB RAM by keeping core weights + an FP16 KV cache resident and streaming only the routed MoE experts from SSD. This post explains the memory pieces (MoE routing, KV cache, quantization) and walks through building, installing, and tuning the runtime.