MIT Technology Review January 3, 2025
Large language models unleashed the power of AI. Now it’s time for more efficient AIs to take over.
Make no mistake: Size matters in the AI world. When OpenAI launched GPT-3 back in 2020, it was the largest language model ever built. The firm showed that supersizing this type of model was enough to send performance through the roof. That kicked off a technology boom that has been sustained by bigger models ever since. As Noam Brown, a research scientist at OpenAI, told an audience at TEDAI San Francisco in October, “The incredible progress in AI over the past five years can be summarized in one word: scale.”
But as the marginal gains for new high-end models trail off, researchers...
Today's Sponsors
Today's Sponsor