I apologize if I'm not using the correct terminology in this question -- I'm fairly new to this stuff, so please correct me if I'm wrong.

I have a list of results I want to show the user. Each result has about 5 different scores indicating how good it is. Right now I'm just summing those scores to sort the results. However, I'd like to weight some of those scores more heavily. Given that I know which items the user ended up selecting, how can I discover what weights I should be using to put the best results up at the top of the list? Obviously the position I showed the result to the user is a big influence as well.

What is the simplest way to do something like this?

asked Feb 28 '11 at 17:19

twk's gravatar image

twk
1222


4 Answers:

The simplest thing I can think of that should work is learning a linear classifier (such as a linear SVM or a regularized logistic regression classifier) that predicts which item the user eventually clicked using features for each of the scores plus features for the position in the list (to control for the position in the list). Then you can use the weights assigned by the classifier to your five features to rank the elements.

answered Feb 28 '11 at 17:44

Alexandre%20Passos's gravatar image

Alexandre Passos ♦
1896744214334

Try a ranking svm http://www.cs.cornell.edu/people/tj/svm_light/svm_rank.html

answered Mar 05 '11 at 23:23

Yisong%20Yue's gravatar image

Yisong Yue
3161414

There's a rather comprehensive list on machine learning methods for ranking on Wikipedia.

answered Mar 01 '11 at 03:53

Oscar%20T%C3%A4ckstr%C3%B6m's gravatar image

Oscar Täckström
1459102743

Easiest might be to do ridge regression. Here's an example with 3 datapoints assuming the user told you rank of each. $lambda$ is regularization parameter (small means less regularization). If x is your vector of scores, x.coefs is the predicted rank. I got formula from wikipedia

answered Feb 28 '11 at 23:53

Yaroslav%20Bulatov's gravatar image

Yaroslav Bulatov
1963193458

edited Feb 28 '11 at 23:55

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.