A study published today (July 27, 2020) in The Lancet Digital Health by UPMC and University of Pittsburgh researchers demonstrates the highest accuracy to date in recognizing and characterizing prostate cancer using an artificial intelligence (AI) program.
“Humans are good at recognizing anomalies, but they have their own biases or past experience,” said senior author Rajiv Dhir, M.D., M.B.A., chief pathologist and vice chair of pathology at UPMC Shadyside and professor of biomedical informatics at Pitt. “Machines are detached from the whole story. There’s definitely an element of standardizing care.”
To train the AI to recognize prostate cancer, Dhir and his colleagues provided images from more than a million parts of stained tissue slides taken from patient biopsies. Each image was labeled by expert pathologists to teach the AI how to discriminate between healthy and abnormal tissue. The algorithm was then tested on a separate set of 1,600 slides taken from 100 consecutive patients seen at UPMC for suspected prostate cancer.
During testing, the AI demonstrated 98% sensitivity and 97% specificity at detecting prostate cancer — significantly higher than previously reported for algorithms working from tissue slides.
Also, this is the first algorithm to extend beyond cancer detection, reporting high performance for tumor grading, sizing, and invasion of the surrounding nerves. These all are clinically important features required as part of the pathology report.
AI also flagged six slides that were not noted by the expert pathologists.
But Dhir explained that this doesn’t necessarily mean that the machine is superior to humans. For example, in the course of evaluating these cases, the pathologist could have simply seen enough evidence of malignancy elsewhere in that patient’s samples to recommend treatment. For less experienced pathologists, though, the algorithm could act as a failsafe to catch cases that might otherwise be missed.
“Algorithms like this are especially useful in lesions that are atypical,” Dhir said. “A nonspecialized person may not be able to make the correct assessment. That’s a major advantage of this kind of system.”
While these results are promising, Dhir cautions that new algorithms will have to be trained to detect different types of cancer. The pathology markers aren’t universal across all tissue types. But he didn’t see why that couldn’t be done to adapt this technology to work with breast cancer, for example.
Reference: “An artificial intelligence algorithm for prostate cancer diagnosis in whole slide images of core needle biopsies: a blinded clinical validation and deployment study” by Liron Pantanowitz, MD; Gabriela M Quiroga-Garza, MD; Lilach Bien; Ronen Heled; Daphna Laifenfeld, PhD; Chaim Linhart, PhD; Judith Sandbank, MD; Anat Albrecht Shach, MD; Varda Shalev, MD; Manuela Vecsler, PhD; Pamela Michelow, MBBCh; Scott Hazelhurst, PhD and Rajiv Dhir, MD, August 2020, The Lancet Digital Health.
Additional authors on the study include Liron Pantanowitz, M.B.B.Ch., of the University of Michigan; Gabriela Quiroga-Garza, M.D., of UPMC; Lilach Bien, Ronen Heled, Daphna Laifenfeld, Ph.D., Chaim Linhart, Judith Sandbank, M.D., Manuela Vecsler, of Ibex Medical Analytics; Anat Albrecht-Shach, M.D., of Shamir Medical Center; Varda Shalev, M.D., M.P.A., of Maccabbi Healthcare Services; and Pamela Michelow, M.S., and Scott Hazelhurst, Ph.D., of the University of the Witwatersrand.
Funding for this study was provided by Ibex, which also created this commercially available algorithm. Pantanowitz, Shalev and Albrecht-Shach report fees paid by Ibex, and Pantanowitz and Shalev serve on the medical advisory board. Bien and Linhart are authors on pending patents US 62/743,559 and US 62/981,925. Ibex had no influence over the design of the study or the interpretation of the results.