AI models are still not reliable for unsupervised medical diagnosis
A team from the United States has analysed the performance of 21 large artificial intelligence (AI)-based language models—including ChatGPT, Gemini and Grok—for clinical diagnosis. Their conclusions are that, despite advances in these models, their reasoning capabilities remain limited for initial diagnosis and that they should not be relied upon without the supervision of a medical professional. According to the authors, who published their findings in JAMA Network Open and aimed to “help distinguish reality from hype in the use of these tools”, the results “reinforce the idea that language models in healthcare still require human intervention and very rigorous supervision”.
0