Forbes November 15, 2024
Santhosh Vijayabaskar is a global thought leader, speaker and author in technology, focusing on digital transformation and innovation.
Large language models (LLMs) such as GPT-4o and other modern state-of-the-art generative models like Anthropic’s Claude, Google’s PaLM and Meta’s Llama have been dominating the AI field recently. These models have enabled advanced NLP tasks such as high-quality text generation, answering complex questions, code generation and even logical reasoning.
At the same time, these gigantic models are resource-hungry and are hindered by their size and complexity. LLMs require significant amounts of computing power and infrastructure. Think of your smartphone, your smart TV or even your fitness tracker—these devices don’t have the computational power to run large models like LLMs effectively.
Introducing Small...