Mesh LLM on iroh: distributed LLM inference without vendor lock-in
Mesh LLM pools GPUs and memory across multiple machines and exposes the result as an OpenAI-compatible API on `localhost:9337/v1`. Powered by iroh, nodes connect securely over QUIC with NAT traversal, and requests can run locally, route to a peer, or split across machines in a pipeline.