AI can identify guardian authorship of messages in teen patient portal
Medical Xpress June 29, 2024
Large language model (LLM)-based classifiers can accurately detect guardian authorship of messages sent from an adolescent patient portal, according to a research letter published online June 25 in JAMA Network Open.
April S. Liang, M.D., from the Stanford University School of Medicine in Palo Alto, California, and colleagues examined the ability of a LLM to detect guardian authorship of messages originating from adolescent patient portals. Messages from adolescent patient portal accounts at Stanford Children’s Health were sampled and manually reviewed for authorship. Two prompts were iteratively engineered on a random subset of 20 messages until perfect performance was achieved: one focusing on authorship identification (single task) and one that generated response to the message and identified authorship (multitask). Both prompts...