Changes in quality of life from a homelessness intervention: true change, response shift, or random variation

Background and objectiveParticipants experiencing homelessness and mental illness who received housing and support through the At Home/Chez Soi trial showed modest gains in quality of life (QOL) compared to treatment as usual participants. Participants’ QOL ratings over time may have been affected by either response shift triggered by new life circumstances or by random variation in the meaning of QOL ratings. This study seeks to identify both phenomena to estimate the intervention’s effect on true change in QOL.MethodsUsing the residuals from a regression model of the global item of Lehman’s 20-item quality of life interview (QOLI-20), latent trajectory analysis was used to identify response shift, while a measure of overall variability in residuals identified random variation of QOL. The latter was used to adjust group comparisons of QOLI-20 total scores and the global item.ResultsEquivalent distributions of both groups’ participants across latent trajectory classes (χ2 = 2.97, p = .397) suggest that the intervention did not trigger response shift. However, random variation interacted significantly with the treatment effect on global item ratings. For every increase of one standard deviation of residuals, treatment odds ratios decreased by a factor of 0.70 (SE 1.18, p = .036, 95% CI 0.50–0.98).ConclusionsMeasuring random variation in QOL ratings from the standard deviation of residuals offers the ability to approximate, although indirectly, how participants’ QOL is truly affected by a housing intervention. Specifically, we found that QOL improvement is more evident when QOL ratings have a consistent meaning over time.