In this post, I want to show how I use NLTK for preprocessing and tokenization, but then apply machine learning techniques (e.g. building a linear SVM using stochastic gradient descent) using Scikit-Learn.
In this post you will see 5 recipes of supervised classification algorithms applied to small standard datasets that are provided with the scikit-learn library.
LIBLINEAR is a linear classifier for data with millions of instances and features. It supports L2-regularized logistic regression (LR), L2-loss linear SVM, and L1-loss linear SVM.
Main features of LIBLINEAR include
* Same data format as LIBSVM, our general-purpose SVM solver, and also similar usage
* Multi-class classification: 1) one-vs-the rest, 2) Crammer & Singer
* Cross validation for model selection
* Probability estimates (logistic regression only)
* Weights for unbalanced data
* MATLAB/Octave, Java interfaces
A. Dargahi Nobari, N. Reshadatmand, and M. Neshati. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, page 2035–2038. New York, NY, USA, Association for Computing Machinery, (2017)
S. Wang, J. Tang, C. Aggarwal, and H. Liu. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, ACM, (October 2016)
L. Hettinger, A. Zehe, A. Dallmann, and A. Hotho. INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft, page 191-204. Bonn, Gesellschaft für Informatik e.V., (2019)
L. Hettinger, A. Zehe, A. Dallmann, and A. Hotho. INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft, page 191-204. Bonn, Gesellschaft für Informatik e.V., (2019)
L. Wang, Z. Cao, G. de Melo, and Z. Liu. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 1, page 1298--1307. (2016)
R. Girju, P. Nakov, V. Nastase, S. Szpakowicz, P. Turney, and D. Yuret. Proceedings of the 4th International Workshop on Semantic Evaluations, page 13--18. Stroudsburg, PA, USA, Association for Computational Linguistics, (2007)
J. Rotsztejn, N. Hollenstein, and C. Zhang. (2018)cite arxiv:1804.02042Comment: Accepted to SemEval 2018 (12th International Workshop on Semantic Evaluation).
D. Tang, F. Wei, N. Yang, M. Zhou, T. Liu, and B. Qin. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), page 1555--1565. Baltimore, Maryland, Association for Computational Linguistics, (June 2014)