Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/www2010/paper/main/691> ?p ?o. }
Showing items 1 to 11 of
11
with 100 items per page.
- 691 creator ravi-kumar.
- 691 creator sergei-vassilvitskii.
- 691 type InProceedings.
- 691 label "Generalized Distances between Rankings".
- 691 sameAs 691.
- 691 abstract "Spearman's footrule and Kendall's tau are two well established distances between rankings. However, they fail to take into account concepts crucial to evaluating a result set in information retrieval, element relevance and positional information. That is changing the rank of a highly-relevant document should result in a higher penalty than changing the rank of a irrelevant document; similar logic holds for results top positions, versus the bottom of the order. In this work, we extend both of these metrics to those with position and element weights, and show that a variant of the Diaconis-Graham inequality still holds---two measures remain within a constant factor of each other for all permutations. We continue by extending the element weights into a distance metric between elements. For example, in search evaluation, swapping the order of two nearly duplicate results should result in little penalty, even if these two are highly relevant and appear at the top of the list. We extend the rank similarity metrics to this, more general case, and show that they remain within a constant factor of each other. We conclude by conducting simple experiments on web search data with the proposed measures. Our experiments show that the weighted generalizations are more robust and consistent with each other than their unweighted counterparts.".
- 691 hasAuthorList authorList.
- 691 isPartOf proceedings.
- 691 keyword "Search engine evaluation".
- 691 keyword "measurements".
- 691 title "Generalized Distances between Rankings".