NLP Library for Text Preprocessing

1

Hi, I am looking for a JAVA based library for doing the following on a huge dataset of natural language(English). I want to do do Tokenization, lemmentitaion, stemming , stop word removal and build a vocabulary and also if possible build tf-idf score table. Is there a single library available with which I can do all of the above?

text processing

asked Jul 04 '12 at 04:29

Lancelot
250●17●24●26

2 Answers:

oldest newest most voted

1	Any of the following: OpenNLP GATE LingPipe answered Jul 05 '12 at 13:31 Pedro Oliveira 264●4●9

1	also http://lucene.apache.org/ answered Jul 06 '12 at 00:00 mat kelcey 186●1●4●10

Subscription:

Once you sign in you will be able to subscribe for any updates here

Tags:

text ×29
processing ×13

Asked: Jul 04 '12 at 04:29

Seen: 1,903 times

Last updated: Jul 06 '12 at 00:00

Related questions

learn more | privacy | contact

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.