Question

How Can You Choose a Classifier Based on a Training Set Data Size?

Answer 1

When the training set is small, a model that has a right bias and low variance seems to work better because they are less likely to overfit. 

For example, Naives bayes works best when the training set is large. Models with low bias and high variance tend to perform better as they work fine with complex relationships.