stopword removal

-4	hi can anyone tell how can i remove stopwords(ex:the,a,is,was)from the 100 text documents,which i have placed in particular folder in my pc.please suggest some code in java..its urgent can help immediately... high asked Mar 22 '12 at 05:31 vadivel 0●1●1●1

One Answer:

I don't know about java, but you basically need to:

Create an array of all the words in your documents (You use some kind of split function)
Now, you look for a database with usual stop words, like this one
Using some kind of lookup function (in python is called find) you can in one fell swoop get all the indexes of the stop words in your array.
Delete those indexes
Done

This is a quick dirty way, but is the basic way a stopword removing algorithm would work.

answered Mar 22 '12 at 05:38

Leon Palafox ♦
4085●71●94●128

Once you sign in you will be able to subscribe for any updates here

Tags:

Asked: Mar 22 '12 at 05:31

Seen: 949 times

Last updated: Mar 22 '12 at 05:38