Designing an Inference Gateway February 17, 2026 ยท #ai#distributed-systems Tracing a request through the system that sits between you and the LLM.