In mathematics, the Wasserstein or Kantorovich–Rubinstein metric or distance is a distance function defined between probability distributions on a given metric space M {\displaystyle M} M.
Intuitively, if each distribution is viewed as a unit amount of "dirt" piled on M {\displaystyle M} M, the metric is the minimum "cost" of turning one pile into the other, which is assumed to be the amount of dirt that needs to be moved times the mean distance it has to be moved. Because of this analogy, the metric is known in computer science as the earth mover's distance.
We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.
S. Basu, A. Banerjee, и R. Mooney. Proceedings of the 2004 SIAM International Conference on Data Mining, стр. 333--344. Lake Buena Vista, FL, Society for Industrial and Applied Mathematics, (апреля 2004)
C. Baziotis, N. Pelekis, и C. Doulkeridis. Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), стр. 390-395. Association for Computational Linguistics, (2017)
S. Cronen-Townsend, Y. Zhou, и B. Croft. SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, стр. 299--306. New York, NY, USA, ACM Press, (2002)
H. Danner, G. Hagerer, F. Kasischke, и G. Groh. Conference Proceedings of "3rd International Conference on Advanced Research Methods and Analytics", стр. 211-219. Valencia, Spain, Editorial Universitat Politècnica de València, (июля 2020)
C. Gilbert. Eighth International Conference on Weblogs and Social Media (ICWSM-14). Available at (20/04/16) http://comp. social. gatech. edu/papers/icwsm14. vader. hutto. pdf, (2014)
N. Hossain, J. Krumm, и M. Gamon. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), стр. 133--142. (2019)
M. Kusner, Y. Sun, N. Kolkin, и K. Weinberger. Proceedings of the 32Nd International Conference on International Conference on Machine Learning - Volume 37, стр. 957--966. JMLR.org, (2015)
B. Pang, и L. Lee. Proceedings of the Association for Computational Linguistics (ACL), стр. 271--278. Association for Computational Linguistics, (2004)