Radiology Business April 16, 2024
GPT-4 can detect radiology report errors at the same rate as members of the specialty, according to new research published Tuesday.
Such mistakes can occur because of resident-to-attending discrepancies, speech-recognition software inaccuracies, and hefty physician workloads, experts wrote in Radiology. To assess the large language model’s skill at spotting errors, experts compiled 200 reports (including X-rays and cross-sectional CT/MR imaging) at a single institution. They inserted 150 errors from five common categories (i.e., omission, insertion, spelling, etc.) and tasked GPT-4 and six radiologists with spotting them.
The LLM was able to match radiologists’ performance, regardless of their experience, scoring a detection rate of nearly 83% compared to 89% for senior readers, 80% for attending physicians, and 80% among residents.
...Today's Sponsors
Today's Sponsor