bookmarks (hide)59
- In mathematics, the Wasserstein or Kantorovich–Rubinstein metric or distance is a distance function defined between probability distributions on a given metric space M {\displaystyle M} M. Intuitively, if each distribution is viewed as a unit amount of "dirt" piled on M {\displaystyle M} M, the metric is the minimum "cost" of turning one pile into the other, which is assumed to be the amount of dirt that needs to be moved times the mean distance it has to be moved. Because of this analogy, the metric is known in computer science as the earth mover's distance.
- Scientists used machine learning to reveal new scientific knowledge hidden in old research papers.
- We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.
- Can't remember what is precision and recall (sensitivity)? Why accuracy is not enough? Read the explanation with an example with a confusion matrix.
- In this post, Phillip talks through the challenges & pitfalls of LLMs we faced when building our Query Assistant - and that you too may face.
- TLDR — Extractive question answering is an important task for providing a good user experience in many applications. The popular Retriever-Reader framework for QA using BERT can be difficult to scale…
- In natural language understanding (NLU) tasks, there is a hierarchy of lenses through which we can extract meaning — from words to sentences to paragraphs to documents. At the document level, one of the most useful ways to understand text is by analyzing its topics. The process of learning, recognizing, and extracting these topics across a collection of documents is called topic modeling. In this post, we will explore topic modeling through 4 of the most popular techniques today: LSA, pLSA, LDA, and the newer, deep learning-based lda2vec.
- Facebook Research open sourced a great project recently – fastText, a fast (no surprise) and effective method to learn word representations and perform text classification. I was curious about comparing these embeddings to other commonly used embeddings, so word2vec seemed like the obvious choice, especially considering fastText embeddings are an extension of word2vec.
- Basic knowledge of XLNet to understand the difference between XLNet and BERT intuitively
- Uniform Manifold Approximation and Projection (UMAP) is a dimension reduction technique that can be used for visualisation similarly to t-SNE, but also for general non-linear dimension reduction. The algorithm is founded on three assumptions about the data The data is uniformly distributed on Riemannian manifold; The Riemannian metric is locally constant (or can be approximated as such); The manifold is locally connected. From these assumptions it is possible to model the manifold with a fuzzy topological structure. The embedding is found by searching for a low dimensional projection of the data that has the closest possible equivalent fuzzy topological structure.
- Identifying meaningful topics for sparse Steam reviews -- by Steve Shao
- MACE (Multi-Annotator Competence Estimation) is an implementation of an item-response model that let's you evaluate redundant annotations of categorical data. It provides competence estimates of the individual annotators and the most likely answer to each item. If we have 10 annotators answer a question, and five answer with 'yes' and five with 'no' (a surprisingly frequent event), we would normaly have to flip a coin to decide what the right answer is. If we knew, however, that one of the people who answered 'yes' is an expert on the question, while one of the others just alwas selects 'no', we would take this information into account to weight their answers. MACE does exactly that. It tries to find out which annotators are more trustworthy and upweighs their answers. All you need to provide is a CSV file with one item per line. In tests, MACE's trust estimates correlated highly wth the annotators' true competence, and it achieved accuracies of over 0.9 on several test sets. MACE can take annotated items into account, if they are available. This helps to guide the training and improves accuracy.
- Build document-based question-answering systems using LangChain, Pinecone, LLMs like GPT-4, and semantic search for precise, context-aware AI solutions.
- You want to discern how many clusters we have (or, if you prefer, how many gaussians components generated the data), and you don’t have information about the “ground truth”. A real case, where data do not have the nicety of behaving good as the simulated ones.
- Definition of NLP coherence scores, in particular intrinsic UMass measure and PMI. Human judgment not being correlated to perplexity (or likelihood of unseen documents) is the motivation for more work trying to model the human judgment. This is by itself a hard task as human judgment is not clearly defined; for example, two experts can disagree on the usefulness of a topic. One can classify the methods addressing this problem into two categories. \textit{Intrinsic} methods that do not use any external source or task from the dataset, whereas \textit{extrinsic} methods use the discovered topics for external tasks, such as information retrieval [Wei06], or use external statistics to evaluate topics.
- Document embeddings and sentence relatedness using BERT
- The main aim of SenticNet is to make the conceptual and affective information conveyed by natural language (meant for human consumption) more easily-accessible to machines.
- Explore and run machine learning code with Kaggle Notebooks | Using data from multiple data sources
publications
(hide)148
This list of posts may not be accurate to recent changes. If you want accurate posts, but with limited sorting follow this link.
- Nomos Verlag, (2018)
- LREC, European Language Resources Association (ELRA), (2016)
- IEEE Trans. Med. Imaging, 35 (5): 1313-1321 (2016)
- JCDL, page 101-110. ACM, (2015)
- CoRR, (2018)
- (2020)cite arxiv:2008.09470Comment: Implementation available at https://github.com/ddangelov/Top2Vec.
- ICQE, volume 1112 of Communications in Computer and Information Science, page 291-298. Springer, (2019)
- Universitat Pompeu Fabra, (2019)
- Association for Computational Linguistics, (2017)
- Proceedings of the 2004 SIAM International Conference on Data Mining, page 333--344. Lake Buena Vista, FL, Society for Industrial and Applied Mathematics, (April 2004)
- Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), page 390-395. Association for Computational Linguistics, (2017)
- (2020)
- Annals of Applied Statistics, (2007)
- Advances in Neural Information Processing Systems 18, 18, page 147. Cambridge, MA, MIT; 1998, (2006)
- Journal of Machine Learning Research, (January 2003)
- The Association for Computational Linguistics, (2015)
- Natural Language Engineering, 5 (2): 187-205 (1999)
- (2023)cite arxiv:2303.12712.
- Journal of Marketing Management, 31 (9-10): 1141--1157 (2015)
- CoRR, (2018)
- PLOS ONE, 17 (9): 1-34 (September 2022)
- Knowl. Based Syst., (January 2019)
- arXiv preprint arXiv:1810.12836, (2018)
- (December 2020)
- CoRR, (2019)
- CoRR, (2017)
- SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, page 299--306. New York, NY, USA, ACM Press, (2002)
- IEEE Trans. Educ., 62 (4): 305-311 (2019)
- Conference Proceedings of "3rd International Conference on Advanced Research Methods and Analytics", page 211-219. Valencia, Spain, Editorial Universitat Politècnica de València, (July 2020)
- Food Quality and Preference, (2020)
- volume 382 of ACM International Conference Proceeding Series, ACM, (2009)
- (2019)
- NAACL-HLT (1), abs/1904.01596, page 2970-3005. Association for Computational Linguistics, (2019)
- Language Resources and Evaluation Conference (LREC 2008), (2008)
- arXiv preprint arXiv:1810.04805, (2018)
- EMNLP, page 830-836. Association for Computational Linguistics, (2018)
- COLT, page 257-269. Omnipress, (2010)
- volume 1112 of Communications in Computer and Information Science, Springer, (2019)
- CoRR, (2019)
- IEEE Transactions on Visualization and Computer Graphics, 13 (2): 294-304 (March 2007)
- Eighth International Conference on Weblogs and Social Media (ICWSM-14). Available at (20/04/16) http://comp. social. gatech. edu/papers/icwsm14. vader. hutto. pdf, (2014)
- Proceedings of the Conference on Natural Language Processing (KONVENS), page (89-99). Vienna, Austria, (2018)
- Journal of Intelligent and Fuzzy Systems, 36 (5): 4599-4607 (2019)
- Leeds Metropolitan University, (April 2007)
- IEEE Workshop on Automatic Speech Recognition and Understanding, 2005., page 381--385. IEEE, (2005)
- ECML/PKDD (2), volume 11907 of Lecture Notes in Computer Science, page 681-696. Springer, (2019)
- From Text to Political Positions: Text analysis across disciplines, (2014)
- DH, page 121-125. ACM, (2018)
- Koli Calling, page 40:1-40:2. ACM, (2020)
- (2017)
- Word, 10 (2-3): 146--162 (1954)
- ICDM Workshops, abs/1610.00219, page 99-106. IEEE Computer Society, (2016)
- ACL (1), page 388-397. Association for Computational Linguistics, (2017)
- Number 3 Article, 16 (3): 5--6 (2011)
- Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), page 133--142. (2019)
- HLT-NAACL, page 1120-1130. The Association for Computational Linguistics, (2013)
- CoRR, (2015)
- ICLR (Poster), OpenReview.net, (2019)
- (2021)cite arxiv:2106.09685Comment: Draft V2 includes better baselines, experiments on GLUE, and more on adapter latency.
- Advances in Neural Information Processing Systems, page 4862--4870. (2016)
- Comput. Educ., (2020)
- MIPRO, page 557-561. IEEE, (2019)
- CoRR, (2019)
- Knowledge Representation for Health Care Process-Oriented Information Systems in Health Care Extraction & Processing of Rich Semantics from Medical Texts, (2017)
- Omnipress, (2010)
- APSIPA, IEEE, (December 2014)
- CoRR, (2020)
- CoRR, (2019)
- Neurocomputing, (2017)
- CoRR, (2014)
- CoRR, (2014)
- Proceedings of the 32Nd International Conference on International Conference on Machine Learning - Volume 37, page 957--966. JMLR.org, (2015)
- IEEE Trans. Vis. Comput. Graph., 24 (1): 142-151 (2018)
- ICML, 14, page 1188--1196. (2014)
- (2016)cite arxiv:1606.01541.
- WWW, page 1142-1152. ACM, (2019)
- IEEE VAST, page 183-192. IEEE Computer Society, (2014)
- (2017)
- IJCAI, page 5123-5129. ijcai.org, (2019)
- CoRR, (2014)
- (2018)cite arxiv:1802.03426Comment: Reference implementation available at http://github.com/lmcinnes/umap.
- ACM Computing Surveys (CSUR), 54 (6): 1--35 (2021)
- (2013)cite arxiv:1301.3781.
- Advances in neural information processing systems, page 3111--3119. (2013)
- RANLP, page 258-263. RANLP 2009 Organising Committee / ACL, (2009)
- CoRR, (2016)
- Rep4NLP@ACL, page 148-157. Association for Computational Linguistics, (2016)
- ACL, page 299-309. Association for Computational Linguistics, (2017)
- 2015 IEEE Frontiers in Education Conference (FIE), page 1-9. IEEE Computer Society, (2015)
- (2023)
- Proceedings of the Association for Computational Linguistics (ACL), page 271--278. Association for Computational Linguistics, (2004)
- (2005)
- (2018)Online; accessed 29-June-2021.
- Physica A: Statistical Mechanics and its Applications, (2019)
- CoRR, (2020)
- Proceedings of the 10th international workshop on semantic evaluation (SemEval-2016), page 19--30. (2016)
- Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), page 486-495. The Association for Computer Linguistics, (2015)
- (2018)
- (June 2023)
- ICML, volume 382 of ACM International Conference Proceeding Series, page 889-896. ACM, (2009)
