Social bookmarking systems and their emergent information structures, known as folksonomies, are increasingly important data sources for Semantic Web applications. A key question for harvesting semantics from these systems is how to extend and adapt traditional notions of similarity to folksonomies, and which measures are best suited for applications such as navigation support, semantic search, and ontology learning. Here we build an evaluation framework to compare various general folksonomy-based similarity measures derived from established information-theoretic, statistical, and practical measures. Our framework deals generally and symmetrically with users, tags, and resources. For evaluation purposes we focus on similarity among tags and resources, considering different ways to aggregate annotations across users. After comparing how tag similarity measures predict user-created tag relations, we provide an external grounding by user-validated semantic proxies based on WordNet and the Open Directory. We also investigate the issue of scalability. We find that mutual information with distributional micro-aggregation across users yields the highest accuracy, but is not scalable; per-user projection with collaborative aggregation provides the best scalable approach via incremental computations. The results are consistent across resource and tag similarity.
Social bookmarking systems and their emergent information structures, known as folksonomies, are increasingly important data sources for Semantic Web applications. A key question for harvesting semantics from these systems is how to extend and adapt traditional notions of similarity to folksonomies, and which measures are best suited for applications such as navigation support, semantic search, and ontology learning. Here we build an evaluation framework to compare various general folksonomy-based similarity measures derived from established information-theoretic, statistical, and practical measures. Our framework deals generally and symmetrically with users, tags, and resources. For evaluation purposes we focus on similarity among tags and resources, considering different ways to aggregate annotations across users. After comparing how tag similarity measures predict user-created tag relations, we provide an external grounding by user-validated semantic proxies based on WordNet and the Open Directory. We also investigate the issue of scalability. We find that mutual information with distributional micro-aggregation across users yields the highest accuracy, but is not scalable; per-user projection with collaborative aggregation provides the best scalable approach via incremental computations. The results are consistent across resource and tag similarity.
F. Kleemann, J. Lamla, and V. Günter. Unsichere Zeiten. Herausforderungen gesellschaftlicher Transformationen. Verhandlungen des 34. Kongresses der DGS in Jena 2008. CD-ROM, Wiesbaden, VS-Verlag, (2010)
J. Lamla. Unsichere Zeiten. Herausforderungen gesellschaftlicher Transformationen. Verhandlungen des 34. Kongresses der DGS in Jena 2008., Wiesbaden, VS-Verlag, (2010)
B. Wüst, O. Drögehorn, and K. David. Proceedings of the 2005 International Conference on Internet Computing, page 422-427. Las Vegas, NV, USA, CSREA Press, (June 2005)
B. Wüst, O. Drögehorn, and K. David. Proceedings of the 16th International Symposium on Personal, Indoor and Mobile Radio Communications, page 2262-2267. Berlin, Germany, IEEE, (September 2005)
B. Wüst, O. Drögehorn, and K. David. INFORMATIK 2005 - Informatik Live! Beiträge der 35. Jahrestagung der Gesellschaft für Informatik, volume 2 of Lecture Notes in Informatics, page 548-552. Bonn, Germany, Bonner Köllen Verlag, (September 2005)
S. Sigg, and K. David. Proceedings of the 12th European Wireless Conference: Enabling Technologies for Wireless Multimedia Communications (EW 2006), page 1-7. Athens, Greece, VDE, (April 2006)
B. Wüst, S. Lau, O. Drögehorn, and K. David. Proceedings of the 12th European Wireless Conference: Enabling Technologies for Wireless Multimedia Communications (EW 2006), page 1-6. Athens, Greece, VDE, (April 2006)