I'm familiar (and hence not interested) with co-training and (EM, variational, sampling)-based approaches for generative models. I've seen references on SVM based methods and entropy regularization, but I'm not aware of the standard references for these methods.

Is there a general survey on semi-supervised learning, and which are the reference papers on semi-supervised SVMs and entropy regularization?

asked Jul 21 '10 at 20:00

Alexandre%20Passos's gravatar image

Alexandre Passos ♦
2554154278421

edited Dec 03 '10 at 07:13


5 Answers:

Have you checked out the SSL survey by Jerry Zhu? It discusses various approaches to SSL including semi-sup SVMs and entropy regularization. Though it doesn't go much deep into entropy regularization but does have some pointers.

answered Jul 21 '10 at 21:05

spinxl39's gravatar image

spinxl39
3698114869

No, I hadn't. Thanks

(Jul 21 '10 at 21:09) Alexandre Passos ♦

Zhu's survey is very good. The other standard reference is the Semi-Supervised Learning book.

answered Jul 22 '10 at 18:22

Gregory%20Druck's gravatar image

Gregory Druck
4014911

An interesting approach is Mann & McCallum's expectation regularization.

answered Aug 15 '10 at 18:51

Alexandre%20Passos's gravatar image

Alexandre Passos ♦
2554154278421

1

In case you haven't seen before, check out the posterior regularization (PR) paper that actually shows connections of the above approach and several other related approaches. It also shows that PR in fact leads to a faster optimization as compared to the expectation regularization approach.

(Aug 15 '10 at 21:06) spinxl39

Thanks! I wasn't aware of it, it seems interesting.

(Aug 15 '10 at 21:09) Alexandre Passos ♦

You might also be interested in Steven Abney's book.

answered Aug 16 '10 at 11:14

Nadeem%20Mohsin's gravatar image

Nadeem Mohsin
312

Jerry Zhu has also written a book: Introduction to Semi-Supervised Learning. It is available online, per pay.

answered Aug 31 '10 at 02:24

Yuval%20F's gravatar image

Yuval F
452

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.