A support vector method for optimizing average precision
Yisong Yue, Thomas Finley, Filip Radlinski et al. · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · 2007
Machine learning is commonly used to improve ranked retrieval systems. Due to computational difficulties, few learning techniques have been developed to directly optimize for mean average precision (MAP), despite its widespread use in evaluating such systems. Existing approaches optimizing MAP either do not find a globally optimal solution, or are computationally expensive. In contrast, we present a general SVM learning algorithm that efficiently finds a globally optimal solution to a straightforward relaxation of MAP. We evaluate our approach using the TREC 9 and TREC 10 Web Track corpora (WT10g), comparing against SVMs optimized for accuracy and ROCArea. In most cases we show our method to produce statistically significant improvements in MAP scores.
Cited by 704 works. doi:10.1145/1277741.1277790
Authors
References
- The Nature of Statistical Learning Theory
- Statistical Learning Theory
- The relationship between Precision-Recall and ROC curves
- Learning to rank using gradient descent
- Large Margin Methods for Structured and Interdependent Output Variables
- THE PROBABILITY RANKING PRINCIPLE IN IR
- Large Margin Rank Boundaries for Ordinal Regression
- IR evaluation methods for retrieving highly relevant documents
- IR evaluation methods for retrieving highly relevant documents
- A support vector method for multivariate performance measures