|
When I train a DBN via layerwiser greedy RBM training, what should the inputs of the higher layers (2nd and above) be? I.e. once I have trained the first layer I use its output as input for training the next higher layer. Should that be the activations of the 1st layer's output or should the activations be sampled? Thanks all. |
