We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.
The ultimate guide to chatbot analytics. Find out what bot metrics and KPIs you should measure and discover easy ways to optimize your chatbot performance.
These measurements are indispensable for tracking the results of your chatbot, identifying any stumbling blocks and continuously improving its performance. But which metrics should you choose?
This is a sequel test after the chemical analysis and microbiological procedures have been conducted. The study determined the level of acceptability of the by-product of Talisay (Terminalia catappa) nuts specifically; Talisay Nuts Polvoron, Glazed Talisay Nuts, and Sugar-coated Talisay Nuts using sensory evaluation as to appearance, taste, aroma, sweetness, and texture. The responses of the food inclined participants are described yielding from the Hedonic Tests conducted and statistically treated. Results concluded that the developed products are remarkably acceptable and marketable.
R. Sebastiani, P. Giorgini, and J. Mylopoulos. 16th International Conference on Advanced Information Systems Engineering, volume 3084 of Lecture Notes in Computer Science, page 20-35. Riga, Latvia, (June 2004)
T. Joachims. Proceedings of the 17th International Conference on Machine Learning (ICML 2000), June 29-July 2, 2000, Stanford, CA, USA, page 431--438. Morgan-Kaufman Publishers, San Francisco, CA, USA, (2000)
D. Lewis. Proceedings of Speech and Natural Language Workshop, Feb 1991, Asilomar, CA, USA, page 312--318. Morgan-Kaufman Publishers, San Francisco, CA, USA, (1991)
R. Mihalcea, T. Chklovski, and A. Kilgarriff. Proceedings of SENSEVAL-3: Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text CD-ROM, page 25--28. (2004)
L. Albert. Proceedings of the Ninth Conference on Foundations of Software Technology and Theoretical Computer Science, page 223--241. London, UK, Springer-Verlag, (1989)