Medical Economics April 4, 2024
AI models evaluated for accuracy in providing preventive medicine recommendations fare poorly compared to humans
Recent studies have highlighted gaps in accessing preventive services among Americans aged 35 and older, with only 8% receiving all recommended preventive services. As patients increasingly seek supplementary information beyond their physicians’ advice, the reliability of online resources becomes increasingly important.
A recent study in the American Journal of Preventive Medicine sought to evaluate the accuracy of two prominent AI models, ChatGPT-4 and Bard, in providing recommendations related to preventive medicine and primary care. Fifty-six questions covering screening guidelines, preventive strategies, and disease management were posed to these AI models. Each response generated was independently reviewed by two physicians and categorized as accurate, accurate with...