When performing S fold Cross Validation on k Nearest Neighbour Algorithm, is there any change in optimal k as S increases

asked Apr 07 '14 at 07:23

RogerThat's gravatar image

RogerThat
1111


One Answer:

Not if k is truly optimal.

While cross validation is used as a way to asses model performance, the method itself has a certain amount of bias/error. Increasing the number of folds reduces that error at the expense of computational time.

In other words, it improves your understanding of the performance of the model, but doesn't improve (or hurt) the model itself.

answered Apr 11 '14 at 23:21

Daniel%20E%20Margolis's gravatar image

Daniel E Margolis
1065510

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.