|
Until now I was working on Binary-Binary RBM and now I want to extend my implementation to support Gaussian-Binary RBM for real-valued data. I have normalized my input data to zero mean and unit variance. Here is my CD1 step:
Before, the values of visible units (pi) were reconstructed using sigmoid(x), x being its total input plus its bias. Is it correct that now I can simply use x for pi ? Moreover, when I sample the hidden values given the visible values, do I directly sample using the real-valued values or is there some processing here ? And last question, do I still have to use Bernoulli of the hidden values when activating the visible units from the hidden units ? I saw some implementation were adding noise here, but I understood that since I have zero-mean and unit variance input data, I could avoid adding noise. Thanks |
|
You cannot reconstruct using sigmoid since the values will be restricted to [0,1]. So you use x. Ok, Thanks. Do you have any idea about the other two questions ?
(Jun 05 '14 at 07:17)
Baptiste Wicht
|