|
I am trying to train a genetic algorithm trained single layer feed forward artificial neural network. I am using the Machine CPU data set from this link from this page. I have scaled both the inputs and outputs of the dataset using I have installed the ANN package available in R, and using the I am using RMSE measure. (Note: My question is that, the RMSE for the train set is good and compares to Steepest Descent Backpropagation and QuickPropagation and another population based algorithm on which I am working, but the model trained by My question is, am I doing it right? And, why I am not getting good test error with this ANN package? I am expecting RMSE around 0.065 ~ 0.07 and what I get is 0.1 ~ 0.11 . Note: ANN has sigmoid threshold, and the other methods I have used also use sigmoid threshold and all data are scaled within 0 and 1. Please let me know if you want to see the code (in R). |
|
Agree with gdahl on this -- genetic algorithms are probably not a good optimization choice for neural nets. It is much better to use the gradient information (e.g. with stochastic gradient descent). That's also quite a small training set. It sounds like an overfitting problem, and for whatever reason genetic algorithm optimization may be more prone to overfitting. You could try increasing the regularization (weight norm penalty) and see if that helps. |
Why would you want to do this?
To compare errors with other population based algorithms.