CNBC June 27, 2024
Before Illia Polosukhin left Google in 2017, he had a brainstorming lunch and then returned to his desk to build what may have been the very first transformer, the neural network architecture that makes generative artificial intelligence possible.
Now, Polosukhin is considered one of the founding fathers of modern AI.
Polosukhin co-wrote the now famous 2017 paper, “Attention Is All You Need” along with seven Google colleagues, who have collectively become known as the “Transformer 8.” Seven of them appeared on stage together for the first time at Nvidia‘s annual developer conference in March, where CEO Jensen Huang said, “Everything that we’re enjoying today can be traced back to that moment.”
Polosukhin said Google started utilizing transformers in 2018 in...