Question

.For small training sets variance may contribute more to the overall error than bias. Sometimes this is handled by reducing the complexity of the model, even if the model is too simple. Why do you suppose this is the case

Answer 1

Answer:

Bias is the difference between the average prediction of our model and the correct value which we are trying to predict and variance is the variability of model prediction for a given data p[oint or a value which tells us the spread of our data the variance perform very well on training data but has high error rates on test data on the other hand if our model has small training sets then it's going to have smaller variance & & high bias and its contribute more to the overall error than bias. If our model is too simple and has very few parameters then it may have high bias and low variable. As the model go this is conceptually trivial and is much simpler than what people commonly envision when they think of modelling but it helps us to clearly illustrate the difference bewteen bias & variance.