Inproceedings,

Who knows best? A Case Study on Intelligent Crowdworker Selection via Deep Learning

, , , , and .
International Workshop & Tutorial on Interactive Adaptive Learning (IAL), Torino, Italy, (2023)

Abstract

Crowdworking is a popular approach for annotating large amounts of data to train deep neural networks. However, parts of the annotations are often erroneous. In a case study, we demonstrate how an intelligent crowdworker selection via deep learning reduces the number of erroneous annotations and, thus, the annotation costs of obtaining reliable data for training deep neural networks.

Tags

Users

  • @ls_leimeister

Comments and Reviews