- Researchers found that ChatGPT incorrectly diagnosed over 8 in 10 selected pediatric case studies, raising questions about some bots’ suitability for helping doctors size up complex conditions. The chatbot misdiagnosed 72 of 100 cases selected and delivered too broad a diagnosis to be considered correct for another 11, the researchers wrote in JAMA Pediatrics. The study is thought to be the first to explore the accuracy of bots in entirely pediatric scenarios, which require the consideration of the patient’s age alongside symptoms. The study shows that physicians may need to take a more active role in generating data sets for AI models to intentionally prepare them for medical functions — a process known as tuning. (Article here)
March 11, 2024
Health IT | Tea Leaves