Chain Of Continuous Thought Promises Mighty Boost For LLMs And Generative AI By Blowing Up The Fixation On Tokens
Forbes December 18, 2024
In today’s column, I explore an innovative design approach that rejiggers the inner workings of generative AI and large language models (LLMs). The deal is this. Suppose that instead of being hyper-focused on words and language, we leveraged the internal mathematical representations within AI that seem to reflect a form of computational reasoning. By leaning heavily into those internal mechanisms, AI might be speedier and possibly improve in novel ways that could be quite remarkable.
The catchy moniker given to this unusual path is that we would aim to firmly establish a so-called chain of continuous thought.
Is this a solid approach or will it be unable to move the needle?
Let’s talk about it.
This analysis of an innovative...