@braun4

Random walks for text semantic similarity

, , and . Proceedings of the 2009 Workshop on Graph-based Methods for Natural Language Processing, page 23--31. Stroudsburg, PA, USA, Association for Computational Linguistics, (2009)

Abstract

Many tasks in NLP stand to benefit from robust measures of semantic similarity for units above the level of individual words. Rich semantic resources such as WordNet provide local semantic information at the lexical level. However, effectively combining this information to compute scores for phrases or sentences is an open problem. Our algorithm aggregates local relatedness information via a random walk over a graph constructed from an underlying lexical resource. The stationary distribution of the graph walk forms a "semantic signature" that can be compared to another such distribution to get a relat-edness score for texts. On a paraphrase recognition task, the algorithm achieves an 18.5% relative reduction in error rate over a vector-space baseline. We also show that the graph walk similarity between texts has complementary value as a feature for recognizing textual entailment, improving on a competitive baseline system.

Description

Random walks for text semantic similarity

Links and resources

Tags

community