Assessing concordance of financial conflicts of interest disclosures with payments’ databases: a systematic survey of the health literature

OBJECTIVES: The objective of the study is to review the literature for studies that assessed the concordance of financial conflicts of interest disclosures with payments' databases and evaluate their methods. STUDY DESIGN AND SETTING: We conducted a systematic survey of the health literature to identify eligible studies. We searched both Medline and EMBASE up to February 2017. We conducted study selection, data abstraction, and methodological quality assessment in duplicate and independently using standardized forms. We subcategorized 'nonconcordant disclosures' as either 'partially nonconcordant' or 'completely nonconcordant'. The main outcome was the percentage of authors with 'nonconcordant' disclosures. We summarized results by three levels of analysis: authors, companies, and studies. RESULTS: We identified 27 eligible journal articles. The top two types of documents assessed were published articles (n = 13) and published guidelines (n = 9). The most commonly used payment database was the Open Payments Database (n = 16). The median percentage of authors with 'nonconcordant' disclosures was 81%; the median percentage was 43% for 'completely nonconcordant' disclosures. The percentage of 'nonconcordant' conflict of interest (COI) reporting by companies varied between 23% and 85%. The methods of concordance assessment, as well as the labeling and definitions of assessed outcomes varied widely across the included studies. We judged three of the included studies as high-quality studies. CONCLUSION: Underreporting of health science researchers' financial COIs is pervasive. Studies assessing COI underreporting suffer from a number of limitations that could have overestimated their findings.