If the residuals are not more or less randomly distributed around zero but shows some kind of systematic curvature, it means that the data contains unmodeled information. One should then consider other empirical models or use a soft-modelling technique like PCR or PLSR.