Is This Hard for You? Personalized Human Difficulty Estimation for Skin Lesion Diagnosis

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

Predicting the probability of human error is an important problem with applications ranging from optimizing learning environments to distributing cases among doctors in a clinic. In both of these instances, predicting the probability of error is equivalent to predicting the difficulty of the assignment, e.g., diagnosing a specific image of a skin lesion. However, the difficulty of a case is subjective since what is difficult for one person is not necessarily difficult for another. We present a novel approach for personalized estimation of human difficulty, using a transformer-based neural network that looks at previous cases and if the user answered these correctly. We demonstrate our method on doctors diagnosing skin lesions and on a language learning data set showing generalizability across domains. Our approach utilizes domain representations by first encoding each case using pre-trained neural networks and subsequently using these as tokens in a sequence modeling task. We significantly outperform all baselines, both for cases that are in the training set and for unseen cases. Additionally, we show that our method is robust towards the quality of the embeddings and how the performance increases as more answers from a user are available. Our findings suggest that this approach could pave the way for truly personalized learning experiences in medical diagnostics, enhancing the quality of patient care.
Original languageEnglish
Title of host publicationProceedings of the 27th International Conference on Medical Image Computing and Computer Assisted Intervention – MICCAI 2024
Volume15012
Publication date2024
Pages175-184
ISBN (Print)978-3-031-72389-6
ISBN (Electronic)978-3-031-72390-2
DOIs
Publication statusPublished - 2024
Event27th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2024 - Marrakesh, Morocco
Duration: 6 Oct 202410 Oct 2024

Conference

Conference27th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2024
Country/TerritoryMorocco
CityMarrakesh
Period06/10/202410/10/2024
SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN0302-9743

Keywords

  • Difficulty estimation
  • Learning
  • Sequence modelling

Fingerprint

Dive into the research topics of 'Is This Hard for You? Personalized Human Difficulty Estimation for Skin Lesion Diagnosis'. Together they form a unique fingerprint.

Cite this