Forbes February 27, 2025
One thing that this year is teaching us is that innovators can get beyond the limits of traditional scaling laws, and pivot toward new kinds of AI systems that boost productivity and performance.
Last November we were hearing a lot about the scaling laws leading to diminishing returns, and what AI labs would be doing in response to this. Microsoft’s Satya Nadella (among others) mentioned test time compute research, saying: “we are seeing the emergence of a new scaling law.”
In actuality, you can go back to 2023, where Sam Altman was suggesting that the age of giant...