How vLLM Semantic Router turns vllm-sr/auto into a bounded micro-agent runtime for Confidence, Ratings, ReMoM, Fusion, Workflows, and benchmark-shaped collaboration.
Micro-Agent: Beat Frontier Models with Collaboration inside Model API
Source:vLLM Blog ↗