@ngrandy

An evaluation of phrasal and clustered representations on a text categorization task

. SIGIR '92: Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, page 37--50. New York, NY, USA, ACM Press, (1992)
DOI: http://doi.acm.org/10.1145/133160.133172

Abstract

Syntactic phrase indexing and term clustering have been widely explored as text representation techniques for text retrieval. In this paper we study the properties of phrasal and clustered indexing languages on a text categorization task, enabling us to study their properties in isolation from query interpretation issues. We show that optimal effectiveness occurs when using only a small proportion of the indexing terms available, and that effectiveness peaks at a higher feature set size and lower effectiveness level for a syntactic phrase indexing than for word-based indexing. We also present results suggesting that traditional term clustering method are unlikely to provide significantly improved text representations. An improved probabilistic text categorization method is also presented.

Description

An evaluation of phrasal and clustered representations on a text categorization task

Links and resources

Tags

community

  • @jfmaas
  • @grani
  • @mgrani
  • @dblp
  • @jil
  • @ngrandy
@ngrandy's tags highlighted