On uncertainty estimation in active learning for image segmentation

Bo Li*, Tommy Sonne Alstrøm

*Corresponding author for this work

Research output: Contribution to conferencePaperResearchpeer-review

70 Downloads (Pure)

Abstract

Uncertainty estimation is important for interpreting the trustworthiness of machine learning models in many applications. This is especially critical in the data-driven active learning setting where the goal is to achieve a certain accuracy with minimum labeling effort. In such settings, the model learns to select the most informative unlabeled samples for annotation based on its estimated uncertainty. The highly uncertain predictions are assumed to be more informative for improving model performance. In this paper, we explore uncertainty calibration within an active learning framework for medical image segmentation, an area where labels often are scarce. Various uncertainty estimation methods and acquisition strategies (regions and full images) are investigated. We observe that selecting regions to annotate instead of full images leads to more well-calibrated models. Additionally, we experimentally show that annotating regions can cut 50% of pixels that need to be labeled by humans compared to annotating full images.
Original languageEnglish
Publication date2020
Number of pages9
Publication statusPublished - 2020
Event2020 International Conference on Machine Learning: Workshop on Uncertainty and Robustness in Deep Learning - Virtual event
Duration: 12 Jul 202018 Jul 2020

Workshop

Workshop2020 International Conference on Machine Learning
LocationVirtual event
Period12/07/202018/07/2020

Fingerprint

Dive into the research topics of 'On uncertainty estimation in active learning for image segmentation'. Together they form a unique fingerprint.

Cite this