TY - JOUR
T1 - Evolutionary deep feature selection for compact representation of gigapixel images in digital pathology
AU - Bidgoli, Azam Asilian
AU - Rahnamayan, Shahryar
AU - Dehkharghanian, Taher
AU - Riasatian, Abtin
AU - Kalra, Shivam
AU - Zaveri, Manit
AU - Campbell, Clinton J.V.
AU - Parwani, Anil
AU - Pantanowitz, Liron
AU - Tizhoosh, H. R.
N1 - Funding Information:
This work is supported by Ontario Research Fund (ORF) .
Publisher Copyright:
© 2022 Elsevier B.V.
PY - 2022/10
Y1 - 2022/10
N2 - Despite the recent progress in Deep Neural Networks (DNNs) to characterize histopathology images, compactly representing a gigapixel whole-slide image (WSI) via salient features to enable computational pathology is still an urgent need and a significant challenge. In this paper, we propose a novel WSI characterization approach to represent, search and classify biopsy specimens using a compact feature vector (CFV) extracted from a multitude of deep feature vectors. Since the non-optimal design and training of deep networks may result in many irrelevant and redundant features and also cause computational bottlenecks, we proposed a low-cost stochastic method to optimize the output of pre-trained deep networks using evolutionary algorithms to generate a very small set of features to accurately represent each tissue/biopsy. The performance of the proposed method has been assessed using WSIs from the publicly available TCGA image data. In addition to acquiring a very compact representation (i.e., 11,000 times smaller than the initial set of features), the optimized features achieved 93% classification accuracy resulting in 11% improvement compared to the published benchmarks. The experimental results reveal that the proposed method can reliably select salient features of the biopsy sample. Furthermore, the proposed approach holds the potential to immensely facilitate the adoption of digital pathology by enabling a new generation of WSI representation for efficient storage and more user-friendly visualization.
AB - Despite the recent progress in Deep Neural Networks (DNNs) to characterize histopathology images, compactly representing a gigapixel whole-slide image (WSI) via salient features to enable computational pathology is still an urgent need and a significant challenge. In this paper, we propose a novel WSI characterization approach to represent, search and classify biopsy specimens using a compact feature vector (CFV) extracted from a multitude of deep feature vectors. Since the non-optimal design and training of deep networks may result in many irrelevant and redundant features and also cause computational bottlenecks, we proposed a low-cost stochastic method to optimize the output of pre-trained deep networks using evolutionary algorithms to generate a very small set of features to accurately represent each tissue/biopsy. The performance of the proposed method has been assessed using WSIs from the publicly available TCGA image data. In addition to acquiring a very compact representation (i.e., 11,000 times smaller than the initial set of features), the optimized features achieved 93% classification accuracy resulting in 11% improvement compared to the published benchmarks. The experimental results reveal that the proposed method can reliably select salient features of the biopsy sample. Furthermore, the proposed approach holds the potential to immensely facilitate the adoption of digital pathology by enabling a new generation of WSI representation for efficient storage and more user-friendly visualization.
KW - Digital pathology
KW - Evolutionary computation
KW - Image representation
KW - Whole slide images
UR - http://www.scopus.com/inward/record.url?scp=85135327746&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85135327746&partnerID=8YFLogxK
U2 - 10.1016/j.artmed.2022.102368
DO - 10.1016/j.artmed.2022.102368
M3 - Article
C2 - 36207081
AN - SCOPUS:85135327746
SN - 0933-3657
VL - 132
JO - Artificial Intelligence in Medicine
JF - Artificial Intelligence in Medicine
M1 - 102368
ER -