Crowdsourcing seizure detection: Algorithm development and validation on human implanted device recordings

Steven N. Baldassano, Benjamin H. Brinkmann, Hoameng Ung, Tyler Blevins, Erin C. Conrad, Kent Leyde, Mark J. Cook, Ankit N. Khambhati, Joost B. Wagenaar, Gregory A. Worrell, Brian Litt

Research output: Contribution to journalArticlepeer-review

55 Scopus citations


There exist significant clinical and basic research needs for accurate, automated seizure detection algorithms. These algorithms have translational potential in responsive neurostimulation devices and in automatic parsing of continuous intracranial electroencephalography data. An important barrier to developing accurate, validated algorithms for seizure detection is limited access to high-quality, expertly annotated seizure data from prolonged recordings. To overcome this, we hosted a competition to crowdsource the development of seizure detection algorithms using intracranial electroencephalography from canines and humans with epilepsy. The top three performing algorithms from the contest were then validated on out-of-sample patient data including standard clinical data and continuous ambulatory human data obtained over several years using the implantable NeuroVista seizure advisory system. Two hundred teams of data scientists from all over the world participated in the competition. The top performing teams submitted highly accurate algorithms with consistent performance in the out-of-sample validation study. The performance of these seizure detection algorithms, achieved using freely available code and data, sets a new reproducible benchmark for personalized seizure detection. We have also shared a 'plug and play' pipeline to allow other researchers to easily use these algorithms on their own datasets. The success of this competition demonstrates how sharing code and high quality data results in the creation of powerful translational tools with significant potential to impact patient care.

Original languageEnglish (US)
Pages (from-to)1680-1691
Number of pages12
Issue number6
StatePublished - Jun 1 2017


  • Crowdsourcing
  • Epilepsy
  • Experimental models
  • Intracranial EEG
  • Seizure detection

ASJC Scopus subject areas

  • Clinical Neurology


Dive into the research topics of 'Crowdsourcing seizure detection: Algorithm development and validation on human implanted device recordings'. Together they form a unique fingerprint.

Cite this