When David Robinson joined OpenAI in May 2023 , the day after Sam Altman first testified before the Senate, the company’s idea of shipping a new frontier model generally meant training one from scratch. “We were going to bake a fresh cake with a new pretraining run, do the whole thing from scratch,” Robinson told Ezra Klein on the latest episode of “The Ezra Klein Show,” describing a process that took months and limited major releases to a few each year. “We were going to bake a fresh cake with a new pretraining run, do the whole thing from scratch,” Robinson, who led the writing of the...

Source: The New Stack