Test and promote inference endpoints to evaluate quality, latency, throughput, and cost.