How a 125B Model Reaches 100 Tok/s on an RTX 4090
A 125B model can run quickly on a gaming PC when the system treats the GPU, RAM, CPU, and SSD as one memory hierarchy. This guide explains the Strata setup, quantization, expert caching, and speculative decoding behind fast Qwen3.8-Flash-Next inference.