From fat droplets to floating forests: cross-domain transfer learning using a PatchGAN-based segmentation model

Kameswara Bharadwaj Mantha, Ramanakumar Sankar, Yuping Zheng, Lucy Fortson, Thomas Pengo, Douglas Mashek, Mark Sanders, Trace Christensen, Jeffrey Salisbury, Laura Trouille, Jarrett E.K. Byrnes, Isaac Rosenthal, Henry Houskeeper, Kyle Cavanaugh

Research output: Contribution to journalConference articlepeer-review


Many scientific domains gather sufficient labels to train machine algorithms through human-in-the-loop techniques provided by the citizen science platform. As the range of projects, task types and data rates increase, acceleration of model training is of paramount concern to focus volunteer effort where most needed. The application of Transfer Learning (TL) between Zooniverse projects holds promise as a solution. However, understanding the effectiveness of TL approaches that pretrain on large-scale generic image sets vs. images with similar characteristics possibly from similar tasks is an open challenge. We apply a generative segmentation model on two Zooniverse project-based data sets: (1) to identify fat droplets in liver cells (FatChecker; FC) and (2) the identification of kelp beds in satellite images (Floating Forests; FF) through transfer learning from the first project. We compare and contrast its performance with a TL model based on the COCO image set, and subsequently with baseline counterparts. We find that both the FC and COCO TL models perform better than the baseline cases when using > 75% of the original training sample size. The COCO-based TL model generally performs better than the FC-based one, likely due to its generalized features. Our investigations provide important insights into usage of TL approaches on multi-domain data hosted across different Zooniverse projects, enabling future projects to accelerate task completion.

Original languageEnglish (US)
JournalCEUR Workshop Proceedings
StatePublished - 2022
Event2022 International Conference on Information and Knowledge Management Workshops, CIKM-WS 2022 - Atlanta, United States
Duration: Oct 17 2022Oct 21 2022


  • datasets
  • focal tversky loss
  • generative adversarial neural networks
  • patch-based discriminator
  • transfer learning
  • UNET generator

ASJC Scopus subject areas

  • Computer Science(all)


Dive into the research topics of 'From fat droplets to floating forests: cross-domain transfer learning using a PatchGAN-based segmentation model'. Together they form a unique fingerprint.

Cite this