|
Is the log partition function only defined for exponential family distributions, or for any probability distribution in general? |
|
It is defined for any possibly unnormalized (but normalizable) energy/density you want to build a probability distribution out of. Most usages of the term are actually, as you mentioned, related to Gibbs distributions (proportional to exp(- temperature * f(x))), which include exponential-family, but in things like mixture models (which are not in the exponential family) people still talk about log partition functions, as the logarithm of the integral of the probability of data given parameters times probability of the parameters over the parameters, so it's effectively the log likelihood of the data given the model. |
|
The
For any distribution that is a product of multiple distinct components, you can attempt to put it into a form resembling the exponential families by taking the log of everything, and you'll end up with a quantity under the exponent that is the |