Does someone know of NER models or data for Japanese? Thanks.

asked Aug 06 '10 at 11:27

Fernando%20Diaz's gravatar image

Fernando Diaz
16112


2 Answers:

Hi

The package here: http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=FLBJNE is a publicly available tool that is one of the best-performing on the English CoNLL 03 shared task.

To use it, you'll have to run Percy Liang's Brown clustering algorithm on a large collection of unlabeled Japanese text, and to build some gazetteers from the Japanese version on Wikipedia. I hope this helps

answered Aug 08 '10 at 11:59

Lev%20Ratinov's gravatar image

Lev Ratinov
105246

A number of approaches exist for this. You can look at any of the SVM based approaches (for example, this paper that uses structure information in various forms), or other supervised approaches such as ones that use decision lists, or decision trees.

answered Aug 06 '10 at 13:53

spinxl39's gravatar image

spinxl39
3698114869

edited Aug 06 '10 at 13:58

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.