CNBC July 12, 2024
Before co-founding biotech startup Inceptive, Jakob Uszkoreit had an idea that would eventually make generative artificial intelligence possible. As a researcher at Google in 2017, Uszkoreit was trying to speed up the training of neural networks.
He suggested using a new way to interpret data called self-attention. That idea gave way to the transformer, the neural network architecture that underpins generative AI.
“There are actually applications, for example at Google and other places, where transformers have been deployed in production long before, but to much, much less fanfare,” Uszkoreit told CNBC in an interview in June. He said OpenAI’s ChatGPT, which was launched in late 2022, shined “the spotlight on these applications.”
The transformer idea was published by Uszkoreit and...
Today's Sponsors
Today's Sponsor