Title says it all. What are the best resources to learn about conditional random fields? Books, papers, websites, anything goes.

asked May 31 '11 at 20:02

levesque's gravatar image

levesque
3653515


4 Answers:

The video mentioned above by Charles Elkan is a pretty good place to start with. If you prefer books and do not like the slow way he talks or any other issue, then you can see the page by Hanna Wallach. She maintained a page which listed out the papers that used CRF or explained CRF. There was a tutorial as well. Hanna Wallach's MSc thesis is on training CRFs in different ways. So, her introductory chapters on CRF are a good place to look at as well.

answered Jun 03 '11 at 10:18

crazyaboutliv's gravatar image

crazyaboutliv
15061015

I liked this one by McCallum http://arxiv.org/PS_cache/arxiv/pdf/1011/1011.4088v1.pdf Gives a nice overview.

answered May 31 '11 at 20:27

priya%20venkateshan's gravatar image

priya venkateshan
1646812

Check this video tutorial from video lectures by Charles Elkan

Link here

answered Jun 01 '11 at 07:22

Carsten%20Lygteskov%20Hansen's gravatar image

Carsten Lygteskov Hansen
312

Also, from the text version of Charles Elkan's lectures :

The following are four tutorials that are available on the web.

  1. Hanna M. Wallach. Conditional Random Fields: An Introduction. Technical Report MS-CIS-04-21. Department of Computer and Information Science, University of Pennsylvania, 2004.
  2. Charles Sutton and Andrew McCallum. An Introduction to Conditional Random Fields for Relational Learning. In Introduction to Statistical Relational Learning. Edited by Lise Getoor and Ben Taskar. MIT Press, 2006.
  3. Rahul Gupta. Conditional Random Fields. Unpublished report, IIT Bombay, 2006.
  4. Roland Memisevic. An Introduction to Structured Discriminative Learning. Technical Report, University of Toronto, 2006.

All four surveys above are very good. The report by Memisevic places CRFs in the context of other methods for learning to predict complex outputs, especially SVMinspired large-margin methods. Sutton’s survey is a longer discussion, with many helpful comments and explanations. The tutorial by Wallach is easy to follow and provides high-level intuition. One difference between the two tutorials is that Wallach represents CRFs as undirected graphical models, whereas Sutton uses undirected factor graphs. Sutton also does parallel comparisons of naive Bayes (NB) and logistic regression, and of hidden Markov models (HMMs) and linearchain CRFs. This gives readers a useful starting point if they have experience with NB classifiers or HMMs. Gupta’s paper gives a detailed derivation of the important equations for CRFs.

answered Jun 03 '11 at 18:47

levesque's gravatar image

levesque
3653515

edited Jun 06 '11 at 12:48

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.