6  What to put in the imputation model

Whether multiple imputation works correctly depends on the imputation model (what missing values are predicted from). In this chapter we check, with three examples, which variables should go into the imputation model.

6.1 Principle 1: always include the outcome

When an explanatory variable (BMI) is missing and is being imputed, some people hesitate over whether it is acceptable to use the outcome (blood pressure) for prediction, because it feels like “peeking at the answer”. Let us actually compare using it and not using it. We make 50% of BMI missing at random (MCAR).

When imputed without blood pressure, the BMI coefficient is about halved. The imputed BMI values are generated independently of blood pressure, so the relationship between BMI and blood pressure is diluted in proportion to the number of imputed people.

ImportantAlways include the outcome in the imputation model

It is not cheating. The imputation model exists to fill in missing values while preserving the relationships among variables. If the outcome is left out, the relationship between the missing explanatory variable and the outcome is weakened toward 0. In this sense, mice’s default (using all variables) is the correct setting.

6.3 Principle 3: include the relationships used in the analysis in the imputation model too

If the analysis examines an interaction (e.g. whether the relationship between age and blood pressure differs by sex), the imputation model must also include the interaction. Here we create a blood pressure (BP2) whose age slope is 0.30 larger in men, and make 40% of it missing.

With mice’s default, the interaction is estimated as too small. The imputation model fills in values assuming “the age slope is the same for men and women”, so the sex difference is diluted in proportion to the number of imputed people. Adding the interaction as a variable, or imputing separately by sex, brings the estimate close to the pre-missingness value (missingness in this example is MCAR, so complete-case analysis is also unbiased).

WarningMatch the imputation model to the analysis model
  • If the analysis uses interactions, squared terms, or transformations (log, etc.), include them in the imputation model too
  • If you analyse by group, imputing by group is simple and reliable
  • For variables computed from other variables, like BMI, either impute height and weight and then compute it (passive imputation, written in mice’s method as "~ I(Weight / (Height / 100)^2)"), or impute BMI itself as a single variable
  • The imputation model may be broader than the analysis model (containing more variables and relationships). If it is narrower, results are biased

6.4 Try it

NotePractice
  1. In the Principle 1 example, check whether the coefficient is also weakened when BMI missingness is determined by age (MAR) and blood pressure is not used for imputation
  2. In the Principle 2 example, how does the standard error of the mean differ with and without the auxiliary variable?
  1. Even under MAR, imputing without blood pressure weakens the BMI coefficient. Regardless of the missing-data mechanism, include the outcome in the imputation model
  2. With the auxiliary variable, the standard error is slightly smaller. Home blood pressure predicts the missing blood pressure well, so the uncertainty of imputation (the between-imputation variance B) is smaller
ImportantChapter summary
  • Always include the outcome in the model used to impute explanatory variables. Otherwise relationships are weakened
  • Including auxiliary variables related to missingness reduces bias and improves precision. Measure them at the study-planning stage
  • Include the interactions and non-linear relationships used in the analysis in the imputation model too (add them as variables, or impute by group)
  • The imputation model may be broader than the analysis model