can anyone tell about the hyper parameters alpha and beta in the LDA algorithm and how often they change in the algorithm. Where to get a implementation of LDA from the Internet. This algorithm is confusing.Please tell me what all should I have, before implementing LDA, some people said vector to store id's that's y asking.Please reply to this post.

asked Sep 22 '13 at 04:55

ramy%20shanaran's gravatar image

ramy shanaran
16334


2 Answers:

Please tell me what all should I have, before implementing LDA

This is the best tutorial paper about LDA, I've found:

http://www.arbylon.net/publications/text-est.pdf

From what I know, hyper parameters alpha and beta don't change (at least in the most classic variant ...). You should be familiar with such concepts as gibbs sampling, concjugate priors and dirichlet distribution, before starting implementation.

Maybe this LDA implementation would be helpful for you: http://www.mblondel.org/journal/2010/08/21/latent-dirichlet-allocation-in-python/

More links about LDA, you can find on my delicious:

https://delicious.com/grzegorz.gwardys.52/search/lda

answered Sep 24 '13 at 14:49

grzegorz_g's gravatar image

grzegorz_g
1112

edited Sep 24 '13 at 14:49

There are many LDA implementations and you did not specify which programming language you are using. I personally have good experience with Gensim, which implements LDA in Python, but is quite fast. Otherwise you could look at the Stanford Topic Modeling Toolbox, which is a GUI tool.

In my experience you normally get good results, by using the default values for the hyper-parameters of gensim. See this post for an explanation of the parameters: http://stats.stackexchange.com/questions/37405/natural-interpretation-for-lda-hyperparameters

I hope that answers your question. If not please ask a more specific question and one question at a time.

answered Sep 24 '13 at 08:23

Maarten's gravatar image

Maarten
1315613

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.