We propose a novel attention network for document annotation with user-generated tags. The network is designed according to the human reading and annotation behaviour. Usually, users try to digest the title and obtain a rough idea about the topic first, and then read the content of the document. Present research shows that the title metadata could largely affect the social annotation. To better utilise this information, we design a framework that separates the title from the content of a document and apply a title-guided attention mechanism over each sentence in the content. We also propose two semanticbased loss regularisers that enforce the output of the network to conform to label semantics, i.e. similarity and subsumption. We analyse each part of the proposed system with two real-world open datasets on publication and question annotation. The integrated approach, Joint Multi-label Attention Network (JMAN), significantly outperformed the Bidirectional Gated Recurrent Unit (Bi-GRU) by around 13%-26% and the Hierarchical Attention Network (HAN) by around 4%-12% on both datasets, with around 10%-30% reduction of training time.
J. Illig, A. Hotho, R. Jäschke, и G. Stumme. Knowledge Processing and Data Analysis, том 6581 из Lecture Notes in Computer Science, Springer Berlin / Heidelberg, 10.1007/978-3-642-22140-8_9.(2011)
J. Illig, A. Hotho, R. Jäschke, и G. Stumme. Knowledge Processing and Data Analysis, том 6581 из Lecture Notes in Computer Science, стр. 136--149. Berlin/Heidelberg, Springer, (2011)
J. Illig, A. Hotho, R. Jäschke, и G. Stumme. Knowledge Processing and Data Analysis, том 6581 из Lecture Notes in Computer Science, стр. 136--149. Berlin/Heidelberg, Springer, (2011)
J. Illig, A. Hotho, R. Jäschke, и G. Stumme. Knowledge Processing and Data Analysis, том 6581 из Lecture Notes in Computer Science, стр. 136--149. Berlin/Heidelberg, Springer, (2011)
J. Illig, A. Hotho, R. Jäschke, и G. Stumme. Knowledge Processing and Data Analysis, том 6581 из Lecture Notes in Computer Science, стр. 136--149. Berlin/Heidelberg, Springer, (2011)
H. Kim, S. Scerri, J. Breslin, S. Decker, и H. Kim. Proceedings of the 2008 International Conference on Dublin Core and Metadata Applications, стр. 128--137. Berlin, Deutschland, Dublin Core Metadata Initiative, (2008)
D. Liu, X. Hua, L. Yang, M. Wang, и H. Zhang. Proceedings of the 18th international conference on World wide web, стр. 351--360. New York, NY, USA, ACM, (2009)
C. Cattuto, D. Benz, A. Hotho, и G. Stumme. The Semantic Web - ISWC 2008, том 5318 из Lecture Notes in Computer Science, стр. 615--631. Springer Berlin / Heidelberg, (2008)
M. Magableh, A. Cau, H. Zedan, и M. Ward. Proceedings of the IADIS International Conferences Collaborative Technologies 2010 and Web Based Communities 2010, стр. 178--182. (июля 2010)
R. Wetzker, C. Zimmermann, C. Bauckhage, и S. Albayrak. WSDM '10: Proceedings of the Third ACM International Conference on Web Search and Data Mining, стр. 71--80. New York, NY, USA, ACM, (2010)
C. Körner, R. Kern, H. Grahsl, и M. Strohmaier. HT '10: Proceedings of the 21st ACM conference on Hypertext and hypermedia, стр. 157--166. New York, NY, USA, ACM, (2010)
J. Gemmell, A. Shepitsen, M. Mobasher, и R. Burke. Proceedings of the 6th Workshop on Intelligent Techniques for Web Personalization and Recommender Systems, (июля 2008)