This pilot project collects problems and metrics/datasets from the AI research literature, and tracks progress on them. You can use this notebook to see how things are progressing in specific subfields or AI/ML as a whole, as a place to report new results you've obtained, as a place to look for problems that might benefit from having new datasets/metrics designed for them, or as a source to build on for data science projects. At EFF, we're ultimately most interested in how this data can influence our understanding of the likely implications of AI. To begin with, we're focused on gathering it.
M. McLaughlin, and J. Herlocker. SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, page 329--336. New York, NY, USA, ACM Press, (2004)
M. Smucker, J. Allan, and B. Carterette. CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, page 623--632. New York, NY, USA, ACM, (2007)
C. Paris, N. Colineau, and R. Wilkinson. HT '09: Proceedings of the Twentieth ACM Conference on Hypertext and Hypermedia, New York, NY, USA, ACM, (July 2009)