Forbes March 13, 2025
More than two years after the release of ChatGPT, large language models (LLMs) are now becoming the foundation for agentic AI—autonomous systems that interact with tools in their environment to complete multi-step tasks for the user.
While LLMs like OpenAI’s GPT-4 and Meta’s Llama-3, as well as newer reasoning models such as o1 and DeepSeek-R1, are pushing the boundaries of what these systems can achieve, they still face significant challenges in handling specialized areas of knowledge. A recent study by the University of Massachusetts Amherst analyzed medical summaries generated by leading LLMs, including OpenAI’s GPT-4 and Meta’s Llama-3. The study identified widespread issues in nearly every response, such as inconsistencies in medical events, flawed reasoning and chronological errors.
These challenges...