Automatic real-time detection of endoscopic procedures using temporal features

Sean R. Stanek, Wallapak Tavanapong, Johnny Wong, Jung Hwan Oh, Piet C. de Groen

Research output: Contribution to journalArticlepeer-review

21 Scopus citations


Endoscopy is used for inspection of the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for interpretation in real-time by physicians. In practice, these images are not typically captured, which may be attributed by lack of fully automated tools for capturing, analysis of important contents, and quick and easy retrieval of these contents. This paper presents the description and evaluation results of our novel software that uses new metrics based on image color and motion over time to automatically record all images of an individual endoscopic procedure into a single digitized video file. The software automatically discards out-patient video frames between different endoscopic procedures. We validated our software system on 2464. h of live video (over 265 million frames) from endoscopy units where colonoscopy and upper endoscopy were performed. Our previous classification method achieved a frame-based sensitivity of 100.00%, but only a specificity of 89.22%. Our new method achieved a frame-based sensitivity and specificity of 99.90% and 99.97%, a significant improvement. Our system is robust for day-to-day use in medical practice.

Original languageEnglish (US)
Pages (from-to)524-535
Number of pages12
JournalComputer Methods and Programs in Biomedicine
Issue number2
StatePublished - Nov 2012


  • Colonoscopy
  • Endoscopy
  • Image analysis
  • Real-time
  • Video capture
  • Video content analysis

ASJC Scopus subject areas

  • Software
  • Health Informatics
  • Computer Science Applications


Dive into the research topics of 'Automatic real-time detection of endoscopic procedures using temporal features'. Together they form a unique fingerprint.

Cite this