Maximizing perf on AI-SQL queries with the KV-optimal left-deep join
Hitting a billion tokens per minute on one GPU by combining a query planner and an inference engine
Source:Modal Blog ↗
Maximizing perf on AI-SQL queries with the KV-optimal left-deep join