Venet Osmani
Professor of Clinical AI and Machine Learning, Queen Mary University of London
There are several reasons to be cautious about concluding that AI alone is causing a deskilling effect in clinicians. The study's findings might be influenced by other factors.
For example, the number of colonoscopies performed nearly doubled after the AI tool was introduced, going from 795 to 1382. It's possible that this sharp increase in workload, rather than the AI itself, could have led to a lower detection rate. A more intense schedule might mean doctors have less time or are more fatigued, which could affect their performance.
Furthermore, the introduction of a new technology like AI often comes with other changes, such as new clinical workflows or a shift in how resources are used. These organisational changes, which the study did not measure, could also be affecting detection rates.
Finally, the study suggests a drop in skill over just three months. This is a very short period, especially for a clinician with over 27 years of experience. It raises the question of whether a true loss of skill could happen so quickly, or if the doctors were simply changing their habits in a way that affected their performance when the AI was not available.