I'm trying to implement a Convolutional RBM. I currently implemented a CRBM without probabilistic max pooling following various works of Dr. Honglak Lee. However, I'm not able to reconstruct input from MNIST images. It seems that whatever image I give to the CRBM it gives me almost the same output.

I'm almost sure it comes from my implementation, but I would like to know if it is possible to reconstruct input in the same way a RBM does with a CRBM without max-pooling ?

asked Jul 07 '14 at 08:05

Baptiste%20Wicht's gravatar image

Baptiste Wicht
31121315


One Answer:

I can finally confirm that it can reconstruct its input :)

However, training seems much less stable than a normal RBM. And even for binary units, the learning rate needs to be put low. I probably still have to find better parameters.

answered Jul 11 '14 at 09:11

Baptiste%20Wicht's gravatar image

Baptiste Wicht
31121315

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.