AXIOS November 13, 2024
The generative AI revolution — built on the belief that models will keep getting wildly better as they grow crazily bigger — faces new fears that it might plateau out.
Why it matters: Two years after ChatGPT launched, the tech industry, led by OpenAI, has bet billions on a scaling strategy — assemble mountains of chips and data, make tomorrow’s large language models even larger than today’s, and watch the technology advance. Those bets, always risky, could go bad.
Driving the news: Some OpenAI employees are saying the company’s next flagship model, called Orion, will not improve on its predecessor, GPT-4, as impressively as GPT-4 excelled over GPT-3, both The Information and Reuters reported over the weekend.
- Since GPT-4...