“The Empirical Risk Minimization (ERM) principle leads models to rely on all informative features, including unreliable spurious ones, regardless of task difficulty.”