The article discusses how OpenAI’s next flagship model, codenamed Orion, may not represent as big of a leap forward as its previous models like GPT-3 and GPT-4.
Employees who tested Orion found that while its performance exceeds OpenAI’s existing models, the rate of improvement seems to be slowing down.
In some areas, Orion may not be reliably better than previous models, such as in coding.
In response, OpenAI has created a foundations team to explore new strategies to continue improving their models.