The bias variance tradeoff

http://scott.fortmann-roe.com/docs/BiasVariance.html

This page is easily one of the best explanations of bias, variance and the tradeoff between them!