TY - JOUR
T1 - ConvLSTM coordinated longitudinal transformer under spatio-temporal features for tumor growth prediction
AU - Ma, Manfu
AU - Zhang, Xiaoming
AU - Li, Yong
AU - Wang, Xia
AU - Zhang, Ruigen
AU - Wang, Yang
AU - Sun, Penghui
AU - Wang, Xuegang
AU - Sun, Xuan
N1 - Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2023/9
Y1 - 2023/9
N2 - Accurate quantification of tumor growth patterns can indicate the development process of the disease. According to the important features of tumor growth rate and expansion, physicians can intervene and diagnose patients more efficiently to improve the cure rate. However, the existing longitudinal growth model can not well analyze the dependence between tumor growth pixels in the long space-time, and fail to effectively fit the nonlinear growth law of tumors. So, we propose the ConvLSTM coordinated longitudinal Transformer (LCTformer) under spatiotemporal features for tumor growth prediction. We design the Adaptive Edge Enhancement Module (AEEM) to learn static spatial features of different size tumors under time series and make the depth model more focused on tumor edge regions. In addition, we propose the Growth Prediction Module (GPM) to characterize the future growth trend of tumors. It consists of a Longitudinal Transformer and ConvLSTM. Based on the adaptive abstract features of current tumors, Longitudinal Transformer explores the dynamic growth patterns between spatiotemporal CT sequences and learns the future morphological features of tumors under the dual views of residual information and sequence motion relationship in parallel. ConvLSTM can better learn the location information of target tumors, and it complements Longitudinal Transformer to jointly predict future imaging of tumors to reduce the loss of growth information. Finally, Channel Enhancement Fusion Module (CEFM) performs the dense fusion of the generated tumor feature images in the channel and spatial dimensions and realizes accurate quantification of the whole tumor growth process. Our model has been strictly trained and tested on the NLST dataset. The average prediction accuracy can reach 88.52% (Dice score), 89.64% (Recall), and 11.06 (RMSE), which can improve the work efficiency of doctors.
AB - Accurate quantification of tumor growth patterns can indicate the development process of the disease. According to the important features of tumor growth rate and expansion, physicians can intervene and diagnose patients more efficiently to improve the cure rate. However, the existing longitudinal growth model can not well analyze the dependence between tumor growth pixels in the long space-time, and fail to effectively fit the nonlinear growth law of tumors. So, we propose the ConvLSTM coordinated longitudinal Transformer (LCTformer) under spatiotemporal features for tumor growth prediction. We design the Adaptive Edge Enhancement Module (AEEM) to learn static spatial features of different size tumors under time series and make the depth model more focused on tumor edge regions. In addition, we propose the Growth Prediction Module (GPM) to characterize the future growth trend of tumors. It consists of a Longitudinal Transformer and ConvLSTM. Based on the adaptive abstract features of current tumors, Longitudinal Transformer explores the dynamic growth patterns between spatiotemporal CT sequences and learns the future morphological features of tumors under the dual views of residual information and sequence motion relationship in parallel. ConvLSTM can better learn the location information of target tumors, and it complements Longitudinal Transformer to jointly predict future imaging of tumors to reduce the loss of growth information. Finally, Channel Enhancement Fusion Module (CEFM) performs the dense fusion of the generated tumor feature images in the channel and spatial dimensions and realizes accurate quantification of the whole tumor growth process. Our model has been strictly trained and tested on the NLST dataset. The average prediction accuracy can reach 88.52% (Dice score), 89.64% (Recall), and 11.06 (RMSE), which can improve the work efficiency of doctors.
KW - Adaptive feature
KW - Location information
KW - Residual
KW - Transformer
UR - http://www.scopus.com/inward/record.url?scp=85166930045&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85166930045&partnerID=8YFLogxK
U2 - 10.1016/j.compbiomed.2023.107313
DO - 10.1016/j.compbiomed.2023.107313
M3 - Article
C2 - 37562325
AN - SCOPUS:85166930045
SN - 0010-4825
VL - 164
JO - Computers in Biology and Medicine
JF - Computers in Biology and Medicine
M1 - 107313
ER -