The Era of Large AI Models Is Over

Size doesn’t matter

Alberto Romero
8 min readApr 26, 2023

--

Midjourney

Just kidding: we all know size matters. It’s definitely true for AI models, especially for those trained on text data, i.e., language models (LMs). If there’s one trend that has, above all others, dominated AI in the last five or six years, it is the steady increase in parameter count of the best models, which I’ve seen referred to as Moore’s law for large LMs. The GPT…

--

--