Diagnosing Colorectal Polyps in the Wild with Capsule Networks

Rodney Lalonde, Pujan Kandel, Concetto Spampinato, Michael B. Wallace, Ulas Bagci

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations


Colorectal cancer, largely arising from precursor lesions called polyps, remains one of the leading causes of cancer-related death worldwide. Current clinical standards require the resection and histopathological analysis of polyps due to test accuracy and sensitivity of optical biopsy methods falling substantially below recommended levels. In this study, we design a novel capsule network architecture (D-Caps) to improve the viability of optical biopsy of colorectal polyps. Our proposed method introduces several technical novelties including a novel capsule architecture with a capsule-average pooling (CAP) method to improve efficiency in large-scale image classification. We demonstrate improved results over the previous state-of-the-art convolutional neural network (CNN) approach by as much as 43%. This work provides an important benchmark on the new Mayo Polyp dataset, a significantly more challenging and larger dataset than previous polyp studies, with results stratified across all available categories, imaging devices and modalities, and focus modes to promote future direction into AI-driven colorectal cancer screening systems. Code is publicly available at https://github.com/lalonderodney/D-Caps.

Original languageEnglish (US)
Title of host publicationISBI 2020 - 2020 IEEE International Symposium on Biomedical Imaging
PublisherIEEE Computer Society
Number of pages5
ISBN (Electronic)9781538693308
StatePublished - Apr 2020
Event17th IEEE International Symposium on Biomedical Imaging, ISBI 2020 - Iowa City, United States
Duration: Apr 3 2020Apr 7 2020

Publication series

NameProceedings - International Symposium on Biomedical Imaging
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452


Conference17th IEEE International Symposium on Biomedical Imaging, ISBI 2020
Country/TerritoryUnited States
CityIowa City


  • Capsule Network
  • Classification
  • Colorectal
  • Diagnosis
  • Endoscopy
  • Gastrointestinal
  • Polyp

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Diagnosing Colorectal Polyps in the Wild with Capsule Networks'. Together they form a unique fingerprint.

Cite this