|
Dear Group, I was trying to run a small Naive Bayes Classifier program in Python using Python 2.6.5 [Python 2.6.5 (r265:79096, Mar 19 2010, 21:48:26) [MSC v.1500 32 bit (Intel)] on win32] using Windows XP SP2, with an annotated corpus of only 10,000 words. But, even with a 2GB RAM the system comes crashing. I cross cheked it can handle maximum of 1,000 words nicely. Does any one know of any one in this group know how to fix this issue. Best Regards, Subhabrata Banerjee. |
|
Dear Sir, Thank you for your kind answer. I got it now. Best Regards, Subhabrata. |
|
Are you using a library or rolling your own? If you are rolling your own and don't have some ridiculous number of classes you should be easily able to handle many more than 10,000 distinct features by storing counts in a dictionary. |