AXIOS January 3, 2024
Researchers found ChatGPT incorrectly diagnosed over 8 in 10 selected pediatric case studies, raising questions about some bots’ suitability for helping doctors size up complex conditions.
The big picture: Large language models like OpenAI’s ChatGPT are trained on massive amounts of internet data and can’t discriminate between reliable and unreliable information, researchers at Cohen Children’s Medical Center wrote.
- They also lack real-time access to medical information, preventing them from staying updated on new research and health trends.
What they found: The chatbot misdiagnosed 72 of 100 cases selected and delivered too broad a diagnosis to be considered correct for another 11, the researchers wrote in JAMA Pediatrics.
- It wasn’t able to identify relationships like the one between...