Adjudicating ventilator-associated pneumonia in a randomized trial of critically ill patients

PURPOSE: The purpose of this study was to evaluate an adjudication strategy for diagnosing ventilator-associated pneumonia (VAP) in a randomized trial. MATERIALS AND METHODS: In a double-blind trial of sucralfate versus ranitidine, one of four pairs of adjudicators examined each case of clinically suspected VAP. Nurse and physician notes and all relevant laboratory data were allocated to each adjudication pair in groups of five patients. Each reader in the pair decided whether the patient had VAP; differences were resolved by consensus discussion. RESULTS: The overall unadjusted study odds ratio for VAP was 0.82 (P = .21) representing a trend toward less pneumonia with sucralfate compared with ranitidine. The odds ratio adjusted for adjudication pair was 0.85 (P = .27). The proportion of charts adjudicated as VAP positive among pairs ranged from 50% to 92%; crude agreement between readers in each pair varied from 50% to 82%. When adjudicators disagreed, the final consensus was split evenly between the two adjudicators' initial opinions in two pairs; in the other two pairs, the final decision reflected one dominant initial opinion. Personnel time to adjudicate all patients with a suspicion of VAP was 74 days. CONCLUSIONS: Though adjudication of outcomes such as VAP is time-consuming, consistent decision-making requires strict criteria, training, and calibration. Patients should be assigned to adjudication teams through random allocation.