Healthcare IT News October 14, 2021
Two scientists from University of Florida Health offer a deep-dive look at how they’re training GatorTron, their leading-edge natural language processing model, with billions of words for an array of EHR and analytics use cases.
Natural language processing is a branch of artificial intelligence that aims to enable computers to process, understand, interpret and manipulate human language. After decades of exploring, current state-of-the-art NLP solutions are based on deep learning models implemented using various types of neural networks.
THE PROBLEM
“Among the deep learning models, the transformer-based models implemented using a self-attention mechanism, such as BERT and GPT, are the current state-of-the-art solutions,” explained Yonghui Wu, director of NLP at the Clinical and Translational Science Institute at Gainesville-based University of...