Automatic real-time capture and segmentation of endoscopy video

Sean R. Stanek, Wallapak Tavanapong, Johnny S. Wong, Jung Hwan Oh, Piet C. De Groen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations


Endoscopy is a medical technology used to inspect the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for manual interpretation by physicians. In practice, these images are not typically captured, which may be attributed by lack of tools for automatic capturing, automatic analysis of important contents, and quick and easy access to these contents. However, this lack of tools is being addressed by recent research efforts. This paper presents the description and evaluation results of novel software that automates the capture of all images of a single colonoscopy into a single digitized video file. The system uses metrics based on color and motion over time to determine whether the images are derived from inside a single patient. During testing our system extracted 173 videos totaling 70 hours of endoscopic video, out of 230 hours of raw video, with a segment-based sensitivity of 100% and specificity of 99%. No procedures were missed. Two video files contained only a non-patient video signal. The features of our system are robust enough to be suitable for day-to-day use in medical practice.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2008
Subtitle of host publicationPACS and Imaging Informatics
StatePublished - May 7 2008
EventMedical Imaging 2008: PACS and Imaging Informatics - San Diego, CA, United States
Duration: Feb 20 2008Feb 21 2008

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


OtherMedical Imaging 2008: PACS and Imaging Informatics
Country/TerritoryUnited States
CitySan Diego, CA


  • Colonoscopy
  • Endoscopy
  • Image analysis
  • Real-time
  • Video capture
  • Video content analysis

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Automatic real-time capture and segmentation of endoscopy video'. Together they form a unique fingerprint.

Cite this