BibSonomyburst/group/suchkisteBibSonomy RSS feed for /group/suchkiste2012-02-11T05:38:20+01:00http://www.bibsonomy.org/bibtex/2dde0f86c09643578428f3fb7dc603f01/suchkistesuchkiste2010-10-21T14:06:54+02:00Behaviour User <span class="authorEditorList"><a href="/author/Wong">W. Wong</a>, <a href="/author/Stelmaszewska">H. Stelmaszewska</a>, <a href="/author/Barn">B. Barn</a>, <a href="/author/Bhimani">N. Bhimani</a>, and <a href="/author/Barn">S. Barn</a> </span>(<em>November 2009</em>)Thu Oct 21 14:06:54 CEST 2010NovemberJISC User Behaviour Observational Study: User Behaviour in Resource Discovery. Final Report2009Behaviour User http://www.bibsonomy.org/bibtex/2f8b35d432ffa34ee8f2ccb1a5da9c526/tillktillk2009-08-06T13:18:03+02:00suchkiste usability worldcat <span class="authorEditorList"><a href="/author/OCLC"> OCLC</a> (Eds.). </span><em>usability test report, </em>(<em>2009</em>)Thu Aug 06 13:18:03 CEST 2009Some Findings from WorldCat Local Usability Tests Prepared for ALA Annual, July 2009usability test report2009suchkiste usability worldcat http://www.bibsonomy.org/bibtex/2148875a34f84ca74f51bf0bd5f7a21e1/tillktillk2009-06-26T09:54:02+02:00evaluation nutzerverhalten suchkiste <span class="authorEditorList"><a href="/author/Hearst">Marti A. Hearst</a> </span><em>Cambridge University Press, </em>(<em>2009</em>)Fri Jun 26 09:54:02 CEST 2009Search User Interfaces2009evaluation nutzerverhalten suchkiste http://www.bibsonomy.org/bibtex/28b225ae3cef81c85a0e660a6597e6c20/tillktillk2009-06-17T09:36:07+02:00relevance suchkiste <span class="authorEditorList"><a href="/author/Cooper">W. S. Cooper</a> </span><em>Information Storage and Retrieval</em> <em>7(1):19 - 37</em> (<em>1971</em>)Wed Jun 17 09:36:07 CEST 2009Information Storage and Retrieval119 - 37A definition of relevance for information retrieval71971relevance suchkiste The concept of “relevance”, sometimes also called “pertinence” or “aboutness”, is central to the theory of information retrieval. Unfortunately, however, there is at present no consensus as to how this notion should be defined. The purpose of this paper is to propose and defend a definition of what it means to say that a piece of stored information is “relevant” to the information need of a retrieval system user. The suggested definition explicates relevance in terms of logical implication. For any yes-or-no question answering system which operates with one of the standard formalized languages, the definition provides a mathematically precise criterion of relevance. For other types of fact retrieval systems and reference retrieval systems, including all systems whose stored information is expressed in natural language, the definition is not mathematically precise but is nevertheless still helpful on a conceptual level.http://www.bibsonomy.org/bibtex/230e85b5c21f058b488b8f04416dd1474/tillktillk2009-06-11T21:43:32+02:00suchkiste <span class="authorEditorList"><a href="/author/Hildreth">Charles R. Hildreth</a> </span><em>Information Research</em> (<em>January 2001</em>)Thu Jun 11 21:43:32 CEST 2009Information ResearchJanuary2Accounting for users' inflated assessments of on-line catalogue search performance and usefulness: an experimental study62001suchkiste User-oriented approaches to information retrieval (IR) system performance evaluation assign a major role to user satisfaction with search results and overall system performance. Expressed satisfaction with search results is often used as a measure of utility. Many research studies indicate that users of on-line library catalogs (OPACs) and other IR systems often express satisfaction with poor search results. This phenomenon of "false positives," inflated assessments of search results and system performance, has not been adequately explained. Non-performance factors such as interface style and ease of use may have an affect on a searcher's satisfaction with search results. The research described in this report investigates this phenomenon. This paper presents the findings of an experimental study which compared users' search performance and assessments of ease of use, system usefulness, and satisfaction with search results after use of a Web OPAC or its conventional counterpart. The primary questions addressed by this research center on the influence of two experimental factors, OPAC search interface style and search task level of difficulty, on the dependent variables: actual search performance, perceptions of ease of use and system usefulness, and assessments of satisfaction with search results. The study also investigated associations between perceived ease of use, system usefulness, and satisfaction with search results. Lastly, the study looked for associations between the dependent variables and personal characteristics. No association was found between satisfaction with search results and actual search performance. Web OPAC searchers outperformed Text OPAC searchers, but search task level of difficulty is a major determinant of search success. A strong positive correlation was found between perceptions of system ease of use and assessments of search results.http://www.bibsonomy.org/bibtex/2e26af37f551b14e0b2036d7dfc47175e/tillktillk2009-05-04T14:47:36+02:00about suchkiste <span class="authorEditorList"><a href="/author/Breeding">Marshall Breeding</a> </span><em>Smart Libraries Newsletter</em> <em>29(4):1--4</em> (<em>April 2009</em>)<em>mentions Suchkiste . </em>Mon May 04 14:47:36 CEST 2009Smart Libraries NewsletterAprilmentions Suchkiste41--4Open Source Discovery Interfaces Gain Momentum292009about suchkiste http://www.bibsonomy.org/bibtex/26b02b6f361b19dbdc3438c0caf98ae27/tillktillk2009-04-30T15:19:21+02:00metadaten nutzerverhalten suchkiste <span class="authorEditorList"><a href="/author/Calhoun">Karen Calhoun</a>, <a href="/author/Cellentani">Diane Cellentani</a>, and <a href="/author/others"> others</a> </span><em>OCLC, </em><em>Dublin, Ohio, </em>(<em>2009</em>)Thu Apr 30 15:19:21 CEST 2009Dublin, OhioOnline catalogs what users and librarians want : an OCLC report2009metadaten nutzerverhalten suchkiste In 2008, OCLC conducted focus groups, administered a pop-up survey on WorldCat.org—OCLC’s freely available end user interface on the Web—and conducted a Web-based survey of librarians worldwide. [...] The findings indicate, among other things, that although library catalogs are often thought of as discovery tools, the catalog’s delivery-related information is just as important to end users.http://www.bibsonomy.org/bibtex/28f34ca1673e752d8e7d8ad3c3c0a28b2/tillktillk2009-04-05T23:08:01+02:00evaluation lesen suchkiste <span class="authorEditorList"><a href="/author/Lin">Jimmy Lin</a>, and <a href="/author/Smucker">Mark D. Smucker</a> </span><em>SIGIR &#039;08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, </em><em>page 19--26. </em><em>New York, NY, USA, </em><em>ACM, </em>(<em>2008</em>)Sun Apr 05 23:08:01 CEST 2009New York, NY, USASIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval19--26How do users find things with PubMed?: towards automatic utility evaluation with user simulations2008evaluation lesen suchkiste In the context of document retrieval in the biomedical domain, this paper explores the complex relationship between the quality of initial query results and the overall utility of an interactive retrieval system. We demonstrate that a content-similarity browsing tool can compensate for poor retrieval results, and that the relationship between retrieval performance and overall utility is non-linear. Arguments are advanced with user simulations, which characterize the relevance of documents that a user might encounter with different browsing strategies. With broader implications to IR, this work provides a case study of how user simulations can be exploited as a formative tool for automatic utility evaluation. Simulation-based studies provide researchers with an additional evaluation tool to complement interactive and Cranfield-style experiments.How do users find things with PubMed?http://www.bibsonomy.org/bibtex/2844c0abafeedc65b0b1ba67d9b973c40/tillktillk2009-03-11T11:51:22+01:00besorgen evaluation relevance suchkiste <span class="authorEditorList"><a href="/author/Janes">Joseph W. Janes</a> </span><em>Proceedings of the ASIS Annual Meeting, </em><em> 31, </em><em>page 104--114. </em>(<em>1993</em>)Wed Mar 11 11:51:22 CET 2009Proceedings of the ASIS Annual Meeting104--114On the distribution of relevance judgements311993besorgen evaluation relevance suchkiste http://www.bibsonomy.org/bibtex/2590b5f1b6c54ab0fd3fd312f09b4941a/tillktillk2009-03-11T11:30:28+01:00evaluation lesen relevance suchkiste <span class="authorEditorList"><a href="/author/Janes">Joseph W. Janes</a> </span><em>Journal of the American Society for Information Science</em> <em>45(3):160-171</em> (<em>1994</em>)Wed Mar 11 11:30:28 CET 2009School of Information & Library Studies, University of Michigan, 550 E. University, 304 West Engineering, Ann Arbor, MI 48109Journal of the American Society for Information Science3160-171Other people's judgments: A comparison of users' and others' judgments of document relevance, topicality, and utility451994evaluation lesen relevance suchkiste The emerging user-centric model of relevance proposes that the only valid measure of relevance of a document to a user's information need is the one made by that user. If we accept this proposition, it raises an interesting question: how well do other people, especially those involved in information work who make such judgments as part of their training and work, perform as judges of documents for information needs they did not originate? This question was empirically tested, using three groups of subjects: incoming students to a school of information/library science, continuing students in that school, and academic librarians (holders of the MLS degree). These subjects made judgments of either relevance, utility, or topicality of two document sets to the original users' stated information need. These judgments were then compared to those of the users to see what patterns emerged, and to see what can be learned not only about secondary judgments in general, but also the ways in which information and library professionals make such judgments. These results are interesting in their own right (subject's judgments compared reasonably well to those of users, looked more like users' after more training and experience in library work, and fall into interesting patterns), but they also lead to some provocative questions about the nature of judgment and evaluation of information items. © 1994 John Wiley & Sons, Inc.Wiley InterScience :: JOURNALS :: Journal of the American Society for Information Sciencehttp://www.bibsonomy.org/bibtex/2d3e001e4bd4066127242ba58e42d6dd1/tillktillk2009-03-09T13:39:31+01:00evaluation lesen suchkiste <span class="authorEditorList"><a href="/author/Strebe">Rita Strebe</a> </span><em>Information - Wissenschaft &amp; Praxis</em> <em>60(2):75--81</em> (<em>2009</em>)Mon Mar 09 13:39:31 CET 2009Information - Wissenschaft & Praxis275--81Empirische Untersuchung von emotionalen Reaktionen im Prozess der Informationsrecherche im Web602009evaluation lesen suchkiste http://www.bibsonomy.org/bibtex/25e0a0be34b045e21a4abbb7e4a4224e3/tillktillk2009-03-09T13:39:15+01:00evaluation lesen suchkiste <span class="authorEditorList"><a href="/author/Hastik">Canan Hastik</a>, <a href="/author/Schuster">Alexander Schuster</a>, and <a href="/author/Knauerhase">Aleksander Knauerhase</a> </span><em>Information - Wissenschaft &amp; Praxis</em> <em>60(2):61--74</em> (<em>2009</em>)Mon Mar 09 13:39:15 CET 2009Information - Wissenschaft & Praxis261--74Wissenschaftliche Suchmaschinen: Usability Evaluation und Betrachtung des Suchverhaltens potentieller Nutzer602009evaluation lesen suchkiste http://www.bibsonomy.org/bibtex/29b1a9f5de1d59ec66aa06a66d8d751b6/tillktillk2009-02-23T20:06:33+01:00evaluation lesen suchkiste <span class="authorEditorList"><a href="/author/Clarke">Charles L.A. Clarke</a>, <a href="/author/Kolla">Maheedhar Kolla</a>, <a href="/author/Cormack">Gordon V. Cormack</a>, <a href="/author/Vechtomova">Olga Vechtomova</a>, <a href="/author/Ashkan">Azin Ashkan</a>, <a href="/author/Büttcher">Stefan Büttcher</a>, and <a href="/author/MacKinnon">Ian MacKinnon</a> </span><em>SIGIR &#039;08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, </em><em>page 659--666. </em><em>New York, NY, USA, </em><em>ACM, </em>(<em>2008</em>)Mon Feb 23 20:06:33 CET 2009New York, NY, USASIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval659--666Novelty and diversity in information retrieval evaluation2008evaluation lesen suchkiste Evaluation measures act as objective functions to be optimized by information retrieval systems. Such objective functions must accurately reflect user requirements, particularly when tuning IR systems and learning ranking functions. Ambiguity in queries and redundancy in retrieved documents are poorly reflected by current evaluation measures. In this paper, we present a framework for evaluation that systematically rewards novelty and diversity. We develop this framework into a specific evaluation measure, based on cumulative gain. We demonstrate the feasibility of our approach using a test collection based on the TREC question answering track.Novelty and diversity in information retrieval evaluationhttp://www.bibsonomy.org/bibtex/2167658db9b09b071a2b8cfb420f20be0/tillktillk2009-02-23T19:01:20+01:00evaluation suchkiste ungelesen <span class="authorEditorList"><a href="/author/Al-Maskari">Azzah Al-Maskari</a>, <a href="/author/Sanderson">Mark Sanderson</a>, and <a href="/author/Clough">Paul Clough</a> </span><em>SIGIR &#039;07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, </em><em>page 773--774. </em><em>New York, NY, USA, </em><em>ACM, </em>(<em>2007</em>)Mon Feb 23 19:01:20 CET 2009New York, NY, USASIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval773--774The relationship between IR effectiveness measures and user satisfaction2007evaluation suchkiste ungelesen This paper presents an experimental study of users assessing the quality of Google web search results. In particular we look at how users’ satisfaction correlates with the effectiveness of Google as quantified by IR measures such as precision and the suite of Cumulative Gain measures (CG, DCG, NDCG). Results indicate strong correlation between users’ satisfaction, CG and precision, moderate correlation with DCG, with perhaps surprisingly negligible correlation with NDCG. The reasons for the low correlation with NDCG are examined. The relationship between IR effectiveness measures and user satisfactionhttp://www.bibsonomy.org/bibtex/21bd9b4e0c6879e9e35a68289bdac29af/tillktillk2009-02-22T21:49:07+01:00evaluation suchkiste ungelesen <span class="authorEditorList"><a href="/author/Järvelin">Kalervo Järvelin</a>, and <a href="/author/Kekäläinen">Jaana Kekäläinen</a> </span><em>SIGIR &#039;00: Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, </em><em>page 41--48. </em><em>New York, NY, USA, </em><em>ACM, </em>(<em>2000</em>)Sun Feb 22 21:49:07 CET 2009New York, NY, USASIGIR '00: Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval41--48IR evaluation methods for retrieving highly relevant documents2000evaluation suchkiste ungelesen This paper proposes evaluation methods based on the use of non-dichotomous relevance judgements in IR experiments. It is argued that evaluation methods should credit IR methods for their ability to retrieve highly relevant documents. This is desirable from the user point of view in modern large IR environments. The proposed methods are (1) a novel application of P-R curves and average precision computations based on separate recall bases for documents of different degrees of relevance, and (2) two novel measures computing the cumulative gain the user obtains by examining the retrieval result up to a given ranked position. We then demonstrate the use of these evaluation methods in a case study on the effectiveness of query types, based on combinations of query structures and expansion, in retrieving documents of various degrees of relevance. The test was run with a best match retrieval system (In-Query1) in a text database consisting of newspaper articles. The results indicate that the tested strong query structures are most effective in retrieving highly relevant documents. The differences between the query types are practically essential and statistically significant. More generally, the novel evaluation methods and the case demonstrate that non-dichotomous relevance assessments are applicable in IR experiments, may reveal interesting phenomena, and allow harder testing of IR methods.SIGIR: SIGIR '00, IR evaluation methods for ...http://www.bibsonomy.org/bibtex/21a272974f14e56104c7c41eb579f548c/tillktillk2009-02-22T20:53:49+01:00context suchkiste ungelesen <span class="authorEditorList"><a href="/author/Cool">Colleen Cool</a>, and <a href="/author/Spink">Amanda Spink</a> </span><em>Information Processing &amp; Management</em> <em>38(5):605 - 611</em> (<em>2002</em>)Sun Feb 22 20:53:49 CET 2009Information Processing & Management5605 - 611Issues of context in information retrieval (IR): an introduction to the special issue382002context suchkiste ungelesen ScienceDirect - Information Processing & Management : Issues of context in information retrieval (IR): an introduction to the special issuehttp://www.bibsonomy.org/bibtex/25fcb5287c7c5b1bf5025cddfc7da0c70/tillktillk2009-02-22T19:56:18+01:00suchkiste ungelesen <span class="authorEditorList"><a href="/author/Wolfram">Dietmar Wolfram</a>, and <a href="/author/Xie">Hong Xie</a> </span><em>Inf. Process. Manage.</em> <em>38(5):627--648</em> (<em>2002</em>)Sun Feb 22 19:56:18 CET 2009Tarrytown, NY, USAInf. Process. Manage.5627--648Traditional IR for web users: a context for general audience digital libraries382002suchkiste ungelesen The emergence of general audience digital libraries (GADLs) defines a context that represents a hybrid of both "traditional" IR, using primarily bibliographic resources provided by database vendors, and "popular" IR, exemplified by public search systems available on the World Wide Web. Findings of a study investigating end-user searching and response to a GADL are reported. Data collected from a Web-based end-user survey and data logs of resource usage for a Web-based GADL were analyzed for user characteristics, patterns of access and use, and user feedback. Cross-tabulations using respondent demographics revealed several key differences in how the system was used and valued by users of different age groups. Older users valued the service more than younger users and engaged in different searching and viewing behaviors. The GADL more closely resembles traditional retrieval systems in terms of content and purpose of use, but is more similar to popular IR systems in terms of user behavior and accessibility. A model that defines the dual context of the GADL environment is derived from the data analysis and existing IR models in general and other specific contexts. The authors demonstrate the distinguishing characteristics of this IR context, and discuss implications for the development and evaluation of future GADLs to accommodate a variety of user needs and expectations.Traditional IR for web usershttp://www.bibsonomy.org/bibtex/2d7d80b67ce7f7d5d636bbbee564e7f66/tillktillk2009-02-22T18:31:59+01:00context suchkiste ungelesen <span class="authorEditorList"><a href="/author/Cool">Colleen Cool</a> </span><em>Annual Review of Information Science and Technology</em> (<em>2001</em>)Sun Feb 22 18:31:59 CET 2009Annual Review of Information Science and Technology355-42The concept of situation in information science2001context suchkiste ungelesen http://www.bibsonomy.org/bibtex/2fae383a8c5f6902ac102222a5e311d8a/tillktillk2009-02-22T17:26:57+01:00context nutzerverhalten personalisierung suchkiste ungelesen <span class="authorEditorList"><a href="/author/Bai">Jing Bai</a>, <a href="/author/Nie">Jian-Yun Nie</a>, <a href="/author/Cao">Guihong Cao</a>, and <a href="/author/Bouchard">Hugues Bouchard</a> </span><em>SIGIR &#039;07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, </em><em>page 15--22. </em><em>New York, NY, USA, </em><em>ACM, </em>(<em>2007</em>)Sun Feb 22 17:26:57 CET 2009New York, NY, USASIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval15--22Using query contexts in information retrieval2007context nutzerverhalten personalisierung suchkiste ungelesen SIGIR: SIGIR '07, Using query contexts in ...http://www.bibsonomy.org/bibtex/2bd8c47ce6461281d5f7b40d72a7ca371/tillktillk2009-02-22T17:24:18+01:00nutzerverhalten personalisierung suchkiste ungelesen <span class="authorEditorList"><a href="/author/Chirita">Paul Alexandru Chirita</a>, <a href="/author/Firan">Claudiu S. Firan</a>, and <a href="/author/Nejdl">Wolfgang Nejdl</a> </span><em>SIGIR &#039;07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, </em><em>page 7--14. </em><em>New York, NY, USA, </em><em>ACM, </em>(<em>2007</em>)Sun Feb 22 17:24:18 CET 2009New York, NY, USASIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval7--14Personalized query expansion for the web2007nutzerverhalten personalisierung suchkiste ungelesen SIGIR: SIGIR '07, Personalized query expansion for ...