Inproceedings,
Leveraging Multi-Method Evaluation for Multi-Stakeholder Settings
1st Workshop on the Impact of Recommender Systems, co-located with 13th ACM Conference on Recommender Systems (ACM RecSys 2019), volume 2462 of ImpactRS ‘19, (September 2019)
Abstract
In this paper, we focus on recommendation settings with multiple stakeholders with possibly varying goals and interests, and argue that a single evaluation method or measure is not able to evalu- ate all relevant aspects in such a complex setting. We reason that employing a multi-method evaluation, where multiple evaluation methods or measures are combined and integrated, allows for get- ting a richer picture and prevents blind spots in the evaluation outcome.
