We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.
The ultimate guide to chatbot analytics. Find out what bot metrics and KPIs you should measure and discover easy ways to optimize your chatbot performance.
These measurements are indispensable for tracking the results of your chatbot, identifying any stumbling blocks and continuously improving its performance. But which metrics should you choose?
J. Choi, A. Khlif, und E. Epure. Proceedings of the 1st Workshop on NLP for Music and Audio (NLP4MusA), Seite 23--27. Online, Association for Computational Linguistics, (2020)
J. Choi, A. Khlif, und E. Epure. Proceedings of the 1st Workshop on NLP for Music and Audio (NLP4MusA), Seite 23--27. Online, Association for Computational Linguistics, (2020)
A. Said, E. Zangerle, und C. Bauer. Proceedings of the 17th ACM Conference on Recommender Systems, Seite 1221-1222. New York, NY, USA, ACM, (September 2023)
M. Ferrari Dacrema, P. Cremonesi, und D. Jannach. Proceedings of the 13th ACM Conference on Recommender Systems, Seite 101–109. New York, NY, USA, Association for Computing Machinery, (2019)
S. Wu, und Y. Yang. (2020)cite arxiv:2008.01307Comment: Accepted to the 21st International Society for Music Information Retrieval Conference (ISMIR 2020).
S. Wu, und Y. Yang. (2021)cite arxiv:2105.04090Comment: Accepted for Publication at IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP). Online supplemental materials are attached to the end of this arXiv version.
M. Straesser, S. Eismann, J. von Kistowski, A. Bauer, und S. Kounev. Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering, Seite 31-41. New York, NY, USA, Association for Computing Machinery, (2023)
M. Straesser, S. Eismann, J. von Kistowski, A. Bauer, und S. Kounev. Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering, Seite 31-41. New York, NY, USA, Association for Computing Machinery, (2023)
M. Straesser, S. Eismann, J. von Kistowski, A. Bauer, und S. Kounev. Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering, Seite 31-41. New York, NY, USA, Association for Computing Machinery, (2023)
M. Straesser, S. Eismann, J. von Kistowski, A. Bauer, und S. Kounev. Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering, Seite 31-41. New York, NY, USA, Association for Computing Machinery, (2023)
M. Straesser, S. Eismann, J. von Kistowski, A. Bauer, und S. Kounev. Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering, Seite 31-41. New York, NY, USA, Association for Computing Machinery, (2023)
S. Zhang, und K. Balog. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery &$\mathsemicolon$ Data Mining, Seite 1512-1520. ACM, (August 2020)
F. Hoppe, D. Dessì, und H. Sack. Workshop on Deep Learning for Knowledge Graphs (DL4KG@ ISWC2021), Seite 55--65. CEUR WS, (2021)event-place: Virtual Conference.
N. Hazrati, und F. Ricci. Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization, Seite 95-98. ACM, (Juli 2022)
B. Ericson, M. Guzdial, und B. Morrison. Proceedings of the eleventh annual International Conference on International Computing Education Research, Seite 169-178. ACM, (August 2015)