Article,

Towards Simulation-Based Evaluation of Recommender Systems with Carousel Interfaces

, , and .
ACM Trans. Recomm. Syst., 2 (1): 1–25 (Mar 7, 2024)
DOI: 10.1145/3643709

Abstract

Offline data-driven evaluation is considered a low-cost and more accessible alternative to the online empirical method of assessing the quality of recommender systems. Despite their popularity and effectiveness, most data-driven approaches are unsuitable for evaluating interactive recommender systems. In this article, we attempt to address this issue by simulating the user interactions with the system as a part of the evaluation process. Particularly, we demonstrate that simulated users find their desired item more efficiently when recommendations are presented as a list of carousels compared to a simple ranked list.

Tags

Users

  • @brusilovsky

Comments and Reviews