Artificial intelligence and robot solving equation

(Photo by Phonlamai Photo on Shutterstock)

“We train AIs to tell ‘A’ versus ‘B’ in a very clean, artificial environment, but, in real life, the AI will see a variety of materials that it hasn’t trained on. When it does, mistakes can happen,” says study corresponding author Dr. Jeffery Goldstein, director of perinatal pathology and an assistant professor of perinatal pathology and autopsy at Northwestern University Feinberg School of Medicine, in a university release.

“Our findings serve as a reminder that AI that works incredibly well in the lab may fall on its face in the real world. Patients should continue to expect that a human expert is the final decider on diagnoses made on biopsies and other tissue samples. Pathologists fear — and AI companies hope — that the computers are coming for our jobs. Not yet.”

When humans examine tissue on slides, they can only look at a limited field within the microscope, then move to a new field and so on
When humans examine tissue on slides, they can only look at a limited field within the microscope, then move to a new field and so on. (credit: Northwestern University)

The study involved training three AI models to identify specific conditions in placenta tissue samples, such as blood vessel damage, gestational age estimation, and macroscopic lesion classification. A fourth model was trained to detect prostate cancer in needle biopsy tissues. When exposed to small amounts of contaminant tissue (like bladder or blood tissue), each AI model focused excessively on these contaminants, leading to diagnostic errors.

“The AI model has to decide which pieces to pay attention to and which ones not to, and that’s zero sum,” explains Dr. Goldstein. “If it’s paying attention to tissue contaminants, then it’s paying less attention to the tissue from the patient that is being examined. For a human, we’d call it a distraction, like a bright, shiny object.”

This research is the first to investigate how tissue contamination impacts machine-learning models in pathology. While human pathologists, who may review up to 100 slides per day, are trained to overlook such contaminants, AI models showed a marked susceptibility to being misled by them.

Artificial Intelligence (AI)
A new study from Northwestern University has highlighted a significant challenge in the use of AI in medical pathology. (© NicoElNino – stock.adobe.com)

Despite these challenges, Dr. Goldstein remains optimistic about the potential of AI in pathology, particularly in perinatal pathology, where specialists like him are incredibly rare. With only 50 to 100 perinatal pathologists in the U.S., AI models embedded with expert knowledge could significantly aid pathologists nationwide, improving the speed and accuracy of their work.

“Our results make me confident that AI evaluations of placenta are doable. We ran into a real-world problem, but hitting that speed bump means we’re on the road to better integrating the use of machine learning in pathology,” notes Dr. Goldstein.

The study is published in the journal Modern Pathology.

About StudyFinds Staff

StudyFinds sets out to find new research that speaks to mass audiences — without all the scientific jargon. The stories we publish are digestible, summarized versions of research that are intended to inform the reader as well as stir civil, educated debate. StudyFinds Staff articles are AI assisted, but always thoroughly reviewed and edited by a Study Finds staff member. Read our AI Policy for more information.

Our Editorial Process

StudyFinds publishes digestible, agenda-free, transparent research summaries that are intended to inform the reader as well as stir civil, educated debate. We do not agree nor disagree with any of the studies we post, rather, we encourage our readers to debate the veracity of the findings themselves. All articles published on StudyFinds are vetted by our editors prior to publication and include links back to the source or corresponding journal article, if possible.

Our Editorial Team

Steve Fink

Editor-in-Chief

Chris Melore

Editor

Sophia Naughton

Associate Editor