Telling English Tweets Apart: the Case of US, GB, AU
A. Hadgu, N. Lotze, and R. Jäschke. Proceedings of the Workshop on Natural Language Processing and Computational Social Science, Hannover, Germany, (May 2016)
In this paper, we study how to automatically tell different varieties of English apart on Twitter by taking samples from American (US), British (GB) and Australian (AU) English. We track cities and apply filters to generate ground-truth data. We perform expert evaluation to get a sense of the difficulty of the task. We then cast the problem as a classification task: given a tweet (or a set of tweets from a user) in English, the goal is to automatically identify whether the tweet (or set of tweets) is US, GB or AU English. We perform experiments to compare some linguistic features against simple statistical features and show that character Ngrams are quite effective for the task.