Respan released an open-source AI gateway written in Rust on Tuesday, after spending two years building more than 100,000 lines of wrapper code around LiteLLM. The new gateway replaces that system with a small core and plugins that handle model providers, routing, MCP tools, realtime voice, and security controls. A LiteLLM upgrade breaks The breaking point came in January 2026, when a routine LiteLLM upgrade caused intermittent connection failures. Respan rolled back the update but never figured out the problem. “We still haven’t figured out the cause,” the company said in its Hacker News...

Source: The New Stack