A query-basis approach to parametrizing novelty-biased cumulative gain

Leelanupab, Teerapong, Zuccon, Guido, & Jose, Joemon M. (2011) A query-basis approach to parametrizing novelty-biased cumulative gain. Lecture Notes in Computer Science : Advances in Information Retrieval Theory, 6931, pp. 327-331.

View at publisher

Abstract

Novelty-biased cumulative gain (α-NDCG) has become the de facto measure within the information retrieval (IR) community for evaluating retrieval systems in the context of sub-topic retrieval. Setting the incorrect value of parameter α in α-NDCG prevents the measure from behaving as desired in particular circumstances. In fact, when α is set according to common practice (i.e. α = 0.5), the measure favours systems that promote redundant relevant sub-topics rather than provide novel relevant ones. Recognising this characteristic of the measure is important because it affects the comparison and the ranking of retrieval systems. We propose an approach to overcome this problem by defining a safe threshold for the value of α on a query basis. Moreover, we study its impact on system rankings through a comprehensive simulation.

Impact and interest:

1 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

22 since deposited on 29 May 2014
7 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 72231
Item Type: Journal Article
Refereed: Yes
Additional Information: Book Subtitle:
Third International Conference, ICTIR 2011, Bertinoro, Italy, September 12-14, 2011. Proceedings
Keywords: Diversity, Sub-topic retrieval, Effectiveness measure, Web search
DOI: 10.1007/978-3-642-23318-0_32
ISBN: 978-3-642-23318-0
ISSN: 1611-3349
Divisions: Current > Schools > School of Information Systems
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Deposited On: 29 May 2014 22:31
Last Modified: 03 Aug 2014 08:56

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page