We observed that generally the embedding representation is very rich and information dense. For example, reducing the dimensionality of the inputs using SVD or PCA, even by 10%, generally results in worse downstream performance on specific tasks.
L. Glozman. (2010)cite arxiv:1004.0452
Comment: 6 pp, Talk presented at workshops "Excited QCD 2010", 31 January - 6
February, 2010, Tatra National Park, Slovakia and "Strongly Interacting
Matter under Extreme Conditions", Hirschegg, Kleinwalsertal, Austria, January
17 - 23, 2010.
Y. Dourisboure, F. Geraci, and M. Pellegrini. WWW '07: Proceedings of the 16th international conference on World Wide Web, page 461--470. New York, NY, USA, ACM, (2007)