TY - GEN
T1 - Outlier detection to identify presence of clinical confounders to AI performance
T2 - Medical Imaging 2025: Computer-Aided Diagnosis
AU - Zhang, Kuan
AU - Rostami, Behrouz
AU - Faghani, Shahriar
AU - Chang, Eric
AU - Svestka, Douglas
AU - Fetterly, Kenneth
AU - Erickson, Bradley J.
AU - Alkhouli, Mohamad
N1 - Publisher Copyright:
© 2025 SPIE.
PY - 2025
Y1 - 2025
N2 - Increasing integration of AI in medical imaging relies on robust models trained on large patient populations. However, models with high performance metrics may struggle in clinical practice due to confounding factors such as class imbalance, variability in image acquisition and quality, and natural variability of numeric clinical data used for labels. A practical example is the use of routine coronary angiography images to monitor non-coronary findings in real time, such as reduced left ventricular ejection fraction (LVEF). We recently developed an ensemble deep learning model, integrating 3D CNN and Transformer architectures, to distinguish patients with significant reduced LVEF (≤ 40%) from those with normal or mildly reduced LVEF (> 40%) as determined by echocardiography. Despite achieving an area under the curve (AUC) of 0.87, the model’s accuracy was 77%, notably lower than the class imbalance ratio (82%). In this work, we hypothesize that prior AI model performance was limited by confounders including dataset imbalance, technical image quality, variable presence of medical devices in the images, and temporally variable clinical data used as labels. We employed K-nearest-neighbor (KNN) outlier detection using cosine similarity on our model’s final-layer features, in priorly identifying test samples prone to reduced accuracy. A human reader study confirmed that outlier samples exhibited higher incidence of confounding factors, with 54 out of 88 outliers meeting exclusion criteria, compared to just 6 out of 88 inliers. By applying conformal prediction, we provided a confidence score for each test sample, resulting in a “certain” group with improved accuracy (91%) compared to the overall performance (77%) and an “uncertain” group with lower accuracy (44%). These findings underscore the value of identifying confounding cases to improve AI performance and provide clinicians insight into the confidence that the model has in its predictions.
AB - Increasing integration of AI in medical imaging relies on robust models trained on large patient populations. However, models with high performance metrics may struggle in clinical practice due to confounding factors such as class imbalance, variability in image acquisition and quality, and natural variability of numeric clinical data used for labels. A practical example is the use of routine coronary angiography images to monitor non-coronary findings in real time, such as reduced left ventricular ejection fraction (LVEF). We recently developed an ensemble deep learning model, integrating 3D CNN and Transformer architectures, to distinguish patients with significant reduced LVEF (≤ 40%) from those with normal or mildly reduced LVEF (> 40%) as determined by echocardiography. Despite achieving an area under the curve (AUC) of 0.87, the model’s accuracy was 77%, notably lower than the class imbalance ratio (82%). In this work, we hypothesize that prior AI model performance was limited by confounders including dataset imbalance, technical image quality, variable presence of medical devices in the images, and temporally variable clinical data used as labels. We employed K-nearest-neighbor (KNN) outlier detection using cosine similarity on our model’s final-layer features, in priorly identifying test samples prone to reduced accuracy. A human reader study confirmed that outlier samples exhibited higher incidence of confounding factors, with 54 out of 88 outliers meeting exclusion criteria, compared to just 6 out of 88 inliers. By applying conformal prediction, we provided a confidence score for each test sample, resulting in a “certain” group with improved accuracy (91%) compared to the overall performance (77%) and an “uncertain” group with lower accuracy (44%). These findings underscore the value of identifying confounding cases to improve AI performance and provide clinicians insight into the confidence that the model has in its predictions.
KW - clinical confounders
KW - coronary angiography
KW - deep learning
KW - left ventricular ejection fraction
KW - Outlier detection
KW - uncertainty quantification
UR - https://www.scopus.com/pages/publications/105004411905
UR - https://www.scopus.com/pages/publications/105004411905#tab=citedBy
U2 - 10.1117/12.3048988
DO - 10.1117/12.3048988
M3 - Conference contribution
AN - SCOPUS:105004411905
T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE
BT - Medical Imaging 2025
A2 - Astley, Susan M.
A2 - Wismuller, Axel
PB - SPIE
Y2 - 17 February 2025 through 20 February 2025
ER -