Learning to Cluster Web Search Results
Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, page 210--217. New York, NY, USA, ACM, (2004)DOI: 10.1145/1008992.1009030
Abstract
Organizing Web search results into clusters facilitates users' quick browsing through search results. Traditional clustering techniques are inadequate since they don't generate clusters with highly readable names. In this paper, we reformalize the clustering problem as a salient phrase ranking problem. Given a query and the ranked list of documents (typically a list of titles and snippets) returned by a certain Web search engine, our method first extracts and ranks salient phrases as candidate cluster names, based on a regression model learned from human labeled training data. The documents are assigned to relevant salient phrases to form candidate clusters, and the final clusters are generated by merging these candidate clusters. Experimental results verify our method's feasibility and effectiveness.
