Ted Sanders of OpenAI explains that LLM performance is multidimensional, but model size accounts for much of the variation, with bigger models generally more reliable, costlier per token and better at obscure facts. He also describes how version numbers signal release order, relatedness and the size of improvement.

— via Simon Willison