We propose a novel attention network for document annotation with user-generated tags. The network is designed according to the human reading and annotation behaviour. Usually, users try to digest the title and obtain a rough idea about the topic first, and then read the content of the document. Present research shows that the title metadata could largely affect the social annotation. To better utilise this information, we design a framework that separates the title from the content of a document and apply a title-guided attention mechanism over each sentence in the content. We also propose two semanticbased loss regularisers that enforce the output of the network to conform to label semantics, i.e. similarity and subsumption. We analyse each part of the proposed system with two real-world open datasets on publication and question annotation. The integrated approach, Joint Multi-label Attention Network (JMAN), significantly outperformed the Bidirectional Gated Recurrent Unit (Bi-GRU) by around 13%-26% and the Hierarchical Attention Network (HAN) by around 4%-12% on both datasets, with around 10%-30% reduction of training time.
R. Jäschke, A. Hotho, C. Schmitz, B. Ganter, and G. Stumme. Proceedings of the 6th IEEE International Conference on Data Mining (ICDM 06), page 907-911. Hong Kong, IEEE Computer Society, (December 2006)
C. Schmitz, A. Hotho, R. Jäschke, and G. Stumme. Data Science and Classification: Proc. of the 10th IFCS Conf., page 261--270. Berlin, Heidelberg, Springer, (2006)
R. Jäschke, B. Krause, A. Hotho, and G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008), AAAI Press, (2008)
B. Krause, R. Jäschke, A. Hotho, and G. Stumme. Proceedings of the nineteenth ACM conference on Hypertext and hypermedia (HT '08), page 157--166. New York, NY, USA, ACM, (2008)
B. Krause, A. Hotho, and G. Stumme. Advances in Information Retrieval, 30th European Conference on IR Research, ECIR 2008, volume 4956 of LNAI, page 101-113. Heidelberg, Springer, (2008)
S. Braun, A. Schmidt, A. Walter, and V. Zacharias. Good Tags and Bad Tags - Social Tagging in der Wissensorganisation, volume 47 of Medien in der Wissenschaft, Waxmann, (2008)
S. Braun, and A. Schmidt. 8th International Conference on the Design of Cooperative Systems (COOP '08), Carry-le-Rouet, France, May 20-23, 2008, (2008)
R. Jäschke, B. Krause, A. Hotho, and G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008), AAAI Press, (2008)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the 3rd European Semantic Web Conference, page 411-426. Budva, Montenegro, Springer, (June 2006)
A. Hotho, R. J�schke, C. Schmitz, and G. Stumme. Proceedings of the 3rd European Semantic Web Conference, page 411-426. Budva, Montenegro, Springer, (June 2006)
R. Jäschke, B. Krause, A. Hotho, and G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008), AAAI Press, (2008)
A. Hotho, R. J�schke, C. Schmitz, and G. Stumme. The Semantic Web: Research and Applications, volume 4011 of LNAI, page 411-426. Heidelberg, Springer, (June 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), volume 4306 of Lecture Notes in Computer Science, page 56-70. Springer, (2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the 3rd European Semantic Web Conference, volume 4011 of LNCS, page 411-426. Budva, Montenegro, Springer, (June 2006)
C. Schmitz, A. Hotho, R. Jäschke, and G. Stumme. Data Science and Classification (Proc. IFCS 2006 Conference), page 261-270. Ljubljana, Springer, (July 2006)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Knowledge Discovery in Databases: PKDD 2007, 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, Warsaw, Poland, September 17-21, 2007, Proceedings, volume 4702 of Lecture Notes in Computer Science, page 506-514. Springer, (2007)
M. Grahl, A. Hotho, and G. Stumme. 7th International Conference on Knowledge Management (I-KNOW '07), page 356-364. Graz, Austria, Know-Center, (September 2007)
M. Grahl, A. Hotho, and G. Stumme. 7th International Conference on Knowledge Management (I-KNOW '07), page 356-364. Graz, Austria, Know-Center, (September 2007)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Workshop Proceedings of Lernen - Wissensentdeckung - Adaptivität (LWA 2007), page 13-20. Martin-Luther-Universität Halle-Wittenberg, (September 2007)
M. Grahl, A. Hotho, and G. Stumme. Workshop Proceedings of Lernen - Wissensentdeckung - Adaptivität (LWA 2007), page 50-54. Martin-Luther-Universität Halle-Wittenberg, (September 2007)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Knowledge Discovery in Databases: PKDD 2007, 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, Warsaw, Poland, September 17-21, 2007, Proceedings, volume 4702 of Lecture Notes in Computer Science, page 506-514. Springer, (2007)
M. Grahl, A. Hotho, and G. Stumme. 7th International Conference on Knowledge Management (I-KNOW '07), page 356-364. Graz, Austria, Know-Center, (September 2007)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Workshop Proceedings of Lernen - Wissensentdeckung - Adaptivität (LWA 2007), page 13-20. Martin-Luther-Universität Halle-Wittenberg, (September 2007)
R. Jäschke, L. Balby Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Knowledge Discovery in Databases: PKDD 2007, 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, volume 4702 of Lecture Notes in Computer Science, page 506-514. Berlin, Heidelberg, Springer, (2007)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proceedings of the 15th International Conference on Conceptual Structures (ICCS 2007), volume 4604 of Lecture Notes in Artificial Intelligence, page 283--295. Berlin/Heidelberg, Springer-Verlag, (July 2007)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Workshop Proceedings of Lernen - Wissensentdeckung - Adaptivität (LWA 2007), page 13-20. Martin-Luther-Universität Halle-Wittenberg, (September 2007)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the 3rd European Semantic Web Conference, volume 4011 of LNCS, page 411-426. Budva, Montenegro, Springer, (June 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), volume 4306 of Lecture Notes in Computer Science, page 56-70. Springer, (2006)
S. Braun, A. Schmidt, A. Walter, G. Nagypal, and V. Zacharias. Proceedings of the Workshop on Social and Collaborative Construction of Structured Knowledge (CKC 2007) at the 16th International World Wide Web Conference (WWW2007) Banff, Canada, May 8, 2007, volume 273 of CEUR Workshop Proceedings, (2007)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Knowledge Discovery in Databases: PKDD 2007, 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, volume 4702 of Lecture Notes in Computer Science, page 506-514. Berlin, Heidelberg, Springer, (2007)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proceedings of the 15th International Conference on Conceptual Structures (ICCS 2007), volume 4604 of Lecture Notes in Artificial Intelligence, page 283--295. Berlin, Heidelberg, Springer-Verlag, (July 2007)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proceedings of the 15th International Conference on Conceptual Structures, Sheffield, England, (July 2007)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proceedings of the 15th International Conference on Conceptual Structures, Sheffield, England, (July 2007)
V. Zacharias, and S. Braun. Workshop on Social and Collaborative Construction of Structured Knowledge (CKC), 16th International World Wide Web Conference (WWW 2007), (8-12 May 2007)
S. Braun, A. Schmidt, and V. Zacharias. Mensch & Computer - 7. Fachübergreifende Konferenz (M&C 2007), Munich, Germany, Oldenbourg Verlag, (2-5 September 2007)
S. Braun, A. Schmidt, and V. Zacharias. 4th Conference on Professional Knowledge Management - Experiences and Visions, Workshop on Productive Knowledge Work (ProKW 07), 2, page 217-226. Berlin, GITO, (28-30 March 2007)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), volume 4306 of LNCS, page 56-70. Heidelberg, Springer, (December 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the First Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, page 87-102. Aalborg, Aalborg Universitetsforlag, (2006)
C. Schmitz, A. Hotho, R. Jäschke, and G. Stumme. Data Science and Classification. Proceedings of the 10th IFCS Conf., page 261--270. Heidelberg, Springer, (July 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Informatik 2006 - Informatik für Menschen. Band 2, volume P-94 of Lecture Notes in Informatics, Bonn, Gesellschaft für Informatik, (October 2006)Proc. Workshop on Applications of Semantic Technologies, Informatik 2006.
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the First Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, page 87-102. Aalborg, Aalborg Universitetsforlag, (2006)
C. Schmitz, A. Hotho, R. Jäschke, and G. Stumme. Data Science and Classification. Proceedings of the 10th IFCS Conf., page 261--270. Heidelberg, Springer, (July 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), volume 4306 of LNCS, page 56-70. Heidelberg, Springer, (December 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Informatik 2006 - Informatik für Menschen. Band 2, volume P-94 of Lecture Notes in Informatics, Bonn, Gesellschaft für Informatik, (October 2006)Proc. Workshop on Applications of Semantic Technologies, Informatik 2006.
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. The Semantic Web: Research and Applications, volume 4011 of Lecture Notes in Computer Science, page 411--426. Berlin/Heidelberg, Springer, (June 2006)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proc. 18. Workshop Grundlagen von Datenbanken, page 80-84. Halle-Wittenberg, Martin-Luther-Universität, (June 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), volume 4306 of LNCS, page 56-70. Heidelberg, Springer, (December 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, (2006)to appear.
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, Aalborg, Denmark, Aalborg University Press, (July 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Prof. First International Conference on Semantics And Digital Media Technology (SAMT) (to appear), Athens, Greece, (December 2006)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proc. 18. Workshop Grundlagen von Datenbanken, page 80-84. Halle-Wittenberg, Martin-Luther-Universität, (June 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, page 87-102. (2006)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proc. 18. Workshop Grundlagen von Datenbanken, page 80-84. Halle-Wittenberg, Martin-Luther-Universität, (June 2006)
C. Schmitz, A. Hotho, R. Jäschke, and G. Stumme. Data Science and Classification. Proceedings of the 10th IFCS Conf., page 261--270. Heidelberg, Springer, (July 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the First Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, page 87-102. Aalborg, Aalborg Universitetsforlag, (2006)