|
Say for all k I have some data X. I know how to compute I want to sample
where mu is the pseudo sample size (constant). I accept with probability:
For some reason this doesn't work (likelihood rapidly drops even when I initialize with correct state). |
|
Thanks, guys. I indeed had a bug. The above proposal actually works fine, a Jacobian term is apparently not needed. I apologize for posting the question. Joseph: I know about the conjugacy, but it was not the case here. |
Is this rejecting too much? Since you're doing standard MH steps the likelihood shouldn't really drop. Could it be a normalization/numeric error?
if x is drawn from theta and is the standard multinomial distribution, the posterior is easy to solve analytically (due to conjugacy). this could be a lot better than trying to approximate it using MCMC...