@GaelVaroquaux points out that iterative imputation with a regularised least-squares model is more-or-less the same as using NMF for imputation. We should instead use RandomForestRegressor as the default regressor in IterativeImputer, at least if sample_posterior=False (or we can implement predict(return_std=True) on RandomForestRegressor!).