Evaluating the conduct and application of health utility studies: a review of critical appraisal tools and reporting checklists Academic Article uri icon

  • Overview
  • Research
  • Identity
  • Additional Document Info
  • View All


  • BACKGROUND: Published health utility studies are increasingly cited in cost-utility analyses to inform reimbursement decision-making. However, there is limited guidance for investigators looking to systematically evaluate the methodological quality of health utility studies or their applicability to decision contexts. OBJECTIVE: To describe how health utility concepts are reflected in tools intended for use with the health economic literature, particularly with respect to the evaluation of methodological quality and context applicability. METHODS: We reviewed the critical appraisal and reporting tools described in a 2012 report published by the Agency for Healthcare Research and Quality (AHRQ), supplemented with a keyword search of MEDLINE and EMBASE, to identify existing tools which include health utility constructs. From these tools, a list of relevant items was compiled and grouped into domain categories based on the methodological or applicability aspect they were directed toward. RESULTS: Of the 24 tools we identified, 12 contained items relevant to the evaluation of health utilities. Sixty-five items were considered relevant to the evaluation of quality, while 44 were relevant to the evaluation of applicability. Items were arranged into four domains: health state descriptions; selection and description of respondents; elicitation and measurement methods; and other considerations. CONCLUSION: As key inputs to cost-utility analyses, health utilities have the potential to significantly impact estimates of cost-effectiveness. Existing tools contain only general items related to the conduct or use of health utility studies. There is a need to develop tools that systematically evaluate the methodological quality and applicability of health utility studies.


  • Zoratti, Michael J
  • Pickard, A Simon
  • Stalmeier, Peep FM
  • Ollendorf, Daniel
  • Lloyd, Andrew
  • Chan, Kelvin KW
  • Husereau, Don
  • Brazier, John E
  • Krahn, Murray
  • Levine, Mitchell Arnold
  • Thabane, Lehana
  • Xie, Feng

publication date

  • July 2021