LLMs are not ready to automate clinical coding, says Mount Sinai study
Healthcare IT News April 30, 2024
Researchers proposed that integrating AI with expert knowledge could automate medical coding to enhance billing accuracy and reduce administrative costs, but found available large language models vague and error-prone.
A new study from Mount Sinai suggests that using generative artificial intelligence to help with coding automation has some significant limitations.
WHY IT MATTERS
For the research, Mount Sinai’s Icahn School of Medicine evaluated the potential application for large language models in healthcare to automate medical code assignments – based on clinical text – for reimbursement and research purposes.
The study compared LLMs from OpenAI, Google and Meta to assess whether they could effectively match the right medical codes to their corresponding official text descriptions.
To assess and benchmark the...