Running Kimi K3 on AMD MI355X: The $/Token Win Comes From Two Kernel Problems
Kimi K3 is huge enough that serving it on commodity setups quickly becomes an HBM problem. On AMD MI355X, better $/token comes from fixing two ROCm bottlenecks: speculative decoding verification and prefill attention kernel selection for TTFT.