Assess the entire inference stack — not just open model benchmarks
Impressive benchmark results should make it easy for engineers to select the right open model for the outcome they are tasked with developing. However, that is not the case. Benchmarks indicate an...