Home
Scholarly Works
Rating certainty when the target threshold is the...
Journal article

Rating certainty when the target threshold is the null and the point estimate is close to the null

Abstract

When one initially targets the null effect and the point estimate falls close to the null, two challenges exist in rating certainty of evidence. First, when the point estimate is near the null and the data, therefore, suggests little or no effect, rating certainty in a benefit or harm is misleading. Second, since in general the narrower the confidence interval (CI) the more precise the estimate, if the CI is narrow, rating down for imprecision due simply to crossing the null is inappropriate. This paper addresses these issues and provides a solution: to revise the target of certainty rating from a non-zero effect to a little or no effect. This solution requires estimating a range in which the minimal important difference (MID) for benefit and an MID for harm might lie, and thus establishing a range that represents little or no effect. If GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) users are confident that the point estimate represents an effect less than the smallest plausible MID, they will revise their target and rate certainty to a little or no effect. If the entire CI falls within the range of little or no effect, they will not rate down for imprecision. Otherwise (if the CI includes an important effect), they will rate down. Using the solution provided in this paper GRADE users can make an optimal choice of the target of certainty rating.

Authors

Zeng L; Hultcrantz M; Tovey D; Santesso N; Dahm P; Brignardello-Petersen R; Mustafa RA; Murad MH; Izcovich A; de Beer H

Journal

BMJ Evidence-Based Medicine, Vol. 30, No. 3, pp. 202–207

Publisher

BMJ

Publication Date

June 1, 2025

DOI

10.1136/bmjebm-2024-113077

ISSN

2515-446X

Contact the Experts team