@thoni

Dynamic Meta-Embeddings for Improved Sentence Representations

, , and . (2018)cite arxiv:1804.07983Comment: EMNLP 2018.

Abstract

While one of the first steps in many NLP systems is selecting what pre-trained word embeddings to use, we argue that such a step is better left for neural networks to figure out by themselves. To that end, we introduce dynamic meta-embeddings, a simple yet effective method for the supervised learning of embedding ensembles, which leads to state-of-the-art performance within the same model class on a variety of tasks. We subsequently show how the technique can be used to shed new light on the usage of word embeddings in NLP systems.

Description

[1804.07983] Dynamic Meta-Embeddings for Improved Sentence Representations

Links and resources

URL:
BibTeX key:
kiela2018dynamic
search on:

Comments and Reviews  
(0)

There is no review or comment yet. You can write one!

Tags


Cite this publication