Performing Informetric Analysis on Information Retrieval Test Collections: Preliminary Experiments in the Physics Domain
T. Heck, and P. Schaer. 14th International Society of Scientometrics and Informetrics Conference ISSI, 2, page 1392-1400. (2013)
Abstract
The combination of informetric analysis and information retrieval allows a twofold application. (1) While in-formetrics analysis is primarily used to gain insights into a scientific domain, it can be used to build recommen-dation or alternative ranking services. They are usually based on methods like co-occurrence or citation analyses. (2) Information retrieval and its decades-long tradition of rigorous evaluation using standard document corpora, predefined topics and relevance judgements can be used as a test bed for informetric analyses. We show a preliminary experiment on how both domains can be connected using the iSearch test collection, a standard information retrieval test collection derived from the open access arXiv.org preprint server. In this paper the aim is to draw a conclusion about the appropriateness of iSearch as a test bed for the evaluation of a retrieval or recommendation system that applies informetric methods to improve retrieval results for the user. Based on an interview study with physicists, bibliographic coupling and author-co-citation analysis, important authors for ten different research questions are identified. The results show that the analysed corpus includes these authors and their corresponding documents. This study is a first step towards a combination of retrieval evaluations and the evaluation of informetric analyses methods.
%0 Conference Paper
%1 heck2013performing
%A Heck, Tamara
%A Schaer, Philipp
%B 14th International Society of Scientometrics and Informetrics Conference ISSI
%D 2013
%K myown schaer
%P 1392-1400
%T Performing Informetric Analysis on Information Retrieval Test Collections: Preliminary Experiments in the Physics Domain
%V 2
%X The combination of informetric analysis and information retrieval allows a twofold application. (1) While in-formetrics analysis is primarily used to gain insights into a scientific domain, it can be used to build recommen-dation or alternative ranking services. They are usually based on methods like co-occurrence or citation analyses. (2) Information retrieval and its decades-long tradition of rigorous evaluation using standard document corpora, predefined topics and relevance judgements can be used as a test bed for informetric analyses. We show a preliminary experiment on how both domains can be connected using the iSearch test collection, a standard information retrieval test collection derived from the open access arXiv.org preprint server. In this paper the aim is to draw a conclusion about the appropriateness of iSearch as a test bed for the evaluation of a retrieval or recommendation system that applies informetric methods to improve retrieval results for the user. Based on an interview study with physicists, bibliographic coupling and author-co-citation analysis, important authors for ten different research questions are identified. The results show that the analysed corpus includes these authors and their corresponding documents. This study is a first step towards a combination of retrieval evaluations and the evaluation of informetric analyses methods.
@inproceedings{heck2013performing,
abstract = {The combination of informetric analysis and information retrieval allows a twofold application. (1) While in-formetrics analysis is primarily used to gain insights into a scientific domain, it can be used to build recommen-dation or alternative ranking services. They are usually based on methods like co-occurrence or citation analyses. (2) Information retrieval and its decades-long tradition of rigorous evaluation using standard document corpora, predefined topics and relevance judgements can be used as a test bed for informetric analyses. We show a preliminary experiment on how both domains can be connected using the iSearch test collection, a standard information retrieval test collection derived from the open access arXiv.org preprint server. In this paper the aim is to draw a conclusion about the appropriateness of iSearch as a test bed for the evaluation of a retrieval or recommendation system that applies informetric methods to improve retrieval results for the user. Based on an interview study with physicists, bibliographic coupling and author-co-citation analysis, important authors for ten different research questions are identified. The results show that the analysed corpus includes these authors and their corresponding documents. This study is a first step towards a combination of retrieval evaluations and the evaluation of informetric analyses methods.},
added-at = {2013-06-10T08:01:33.000+0200},
author = {Heck, Tamara and Schaer, Philipp},
biburl = {https://www.bibsonomy.org/bibtex/2191045e486a8696a73e2eb8e8f0f7320/schaer},
booktitle = {14th International Society of Scientometrics and Informetrics Conference ISSI},
interhash = {6f885136b2e21c8594b3edc615431680},
intrahash = {191045e486a8696a73e2eb8e8f0f7320},
keywords = {myown schaer},
pages = {1392-1400},
pdf = {http://arxiv.org/pdf/1306.1743v1},
timestamp = {2018-08-13T16:14:32.000+0200},
title = {Performing Informetric Analysis on Information Retrieval Test Collections: Preliminary Experiments in the Physics Domain},
volume = 2,
year = 2013
}