A. Zhang, J. Chen, W. Chai, J. Xu, L. Hong, and E. CHI. ACM Trans. Interact. Intell. Syst.8 (2):
14:1--14:28(June 2018)Interesting attempt to engineer a multi-step process for app search cluster evaluation using crowdsourcing. In some cases crowd performed better than experts..
G. Golovchinsky, M. Price, and B. Schilit. SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, page 19--25. New York, NY, USA, ACM Press, (1999)
T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, page 154--161. New York, NY, USA, ACM, (2005)