Hi,

I'm looking for an SVM (or other kernelizable classifier) implementation that support both multiclass classification and instance weighting. (Actually, instance weighting is much more important, but it would be nice to have out-of-the-box multiclass as well).

Any ideas?

asked Jun 18 '13 at 17:14

yoavg's gravatar image

yoavg
741122331


One Answer:

In scikit-learn you can use the Nystrom kernel approximation + SGDClassifier with hinge loss and l2 penalty to approximate a kernelized SVM while still benefiting from the weighted instance features of the linear model. To workaround the learning rate issue you can replace SGDClassifier with PassiveAggressiveClassifier.

SGDClassifier comes with One vs the Rest multiclass by default.

answered Jun 18 '13 at 17:40

ogrisel's gravatar image

ogrisel
498995591

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.