Becker's Healthcare November 18, 2024
Large language models can complete 50 simultaneous tasks and drive a seventeenfold cost reduction, but any additional tasks will cause performance deterioration, according to a study published Nov. 18 in Nature.
Researchers at the Icahn School of Medicine at Mount Sinai in New York City conducted more than 300,000 experiments to stress test LLMs, according to lead author Eyal Klang, MD. Dr. Klang is director of Icahn Mount Sinai’s generative AI research program.
The study used data from all 1,942,216 patient encounters at Mount Sinai Health System in 2023. The researchers evaluated 10 LLMs, including Meta’s...