Semi-supervised Identification of Rarely Appearing Persons in Video by Correcting Weak Labels
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, page 381--384. New York, NY, USA, ACM, (2016)DOI: 10.1145/2911996.2912073
Abstract
Some recent approaches for character identification in movies and TV broadcasts are realized in a semi-supervised manner by assigning transcripts and/or subtitles to the speakers. However, the labels obtained in this way achieve only an accuracy of $80\% - 90\%$ and the number of training examples for the different actors is unevenly distributed. In this paper, we propose a novel approach for person identification in video by correcting and extending the training data with reliable predictions to reduce the number of annotation errors. Furthermore, the intra-class diversity of rarely speaking characters is enhanced. To address the imbalance of training data per person, we suggest two complementary prediction scores. These scores are also used to recognize whether or not a face track belongs to a (supporting) character whose identity does not appear in the transcript etc. Experimental results demonstrate the feasibility of the proposed approach, outperforming the current state of the art.
Links and resources
Tags
community
@alexandriaproj's tags highlighted