The GRADE Working Group and CINeMA approaches provided inconsistent certainty of evidence ratings for a network meta-analysis of opioids for chronic noncancer pain

OBJECTIVES: Assessment of the certainty of evidence (CoE) from network meta-analysis is critical to convey the strength of inferences for clinical decision-making. Both the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group (GWG) and the Confidence in Network Meta-Analysis (CINeMA) framework have been designed to assess the CoE of treatment effects informed by network meta-analysis; however, the concordance of results is uncertain. STUDY DESIGN AND SETTING: We assessed the CoE for treatment effects of individual opioids on pain relief and physical functioning from a network meta-analysis for chronic noncancer pain using the GWG approach and the CINeMA framework. Both approaches evaluate the CoE as high, moderate, low or very low. We quantified the number of discrepant CoE ratings between approaches and the magnitude of the difference (ie, one level, two levels, or three levels). RESULTS: Across 105 comparisons among individual opioids for pain relief, the GWG and CINeMA approaches provided different CoE ratings in 34% of cases (36 of 105). Across 66 comparisons for physical functioning, there was discordance in 17% of cases (11 of 66). All discrepancies were separated by one level. The CINeMA framework typically provided lower CoE ratings compared to the GWG approach, predominantly because of differences in the assessment of transitivity and heterogeneity. CONCLUSION: Our findings suggest there are differences between the CoE ratings provided by the GWG and CINeMA approaches when applied to network meta-analyses. Further research is needed to replicate or refute our findings in other network meta-analyses and assess the implications for clinical decision-making.