Interobserver Reliability of Radiologists’ Interpretations of Mobile Chest Radiographs for Nursing Home–Acquired Pneumonia

OBJECTIVES: To determine the interobserver reliability of radiologists' interpretations of mobile chest radiographs for nursing home-acquired pneumonia. DESIGN: A cross-sectional reliability study. SETTING: Nursing homes and an acute care hospital. PARTICIPANTS: Four radiologists reviewed 40 mobile chest radiographs obtained from residents of nursing homes who met a clinical definition of lower respiratory tract infections. MEASUREMENTS: Radiologists were asked to interpret radiographs with respect to the film quality; presence, pattern, and extent of an infiltrate; and the presence of a pleural effusion or adenopathy. Interrater reliability was evaluated using the intraclass correlation coefficient derived from a 2-way random effects model. RESULTS: On average the radiologists reported that 6 of the 40 films were of very good or excellent quality and 16 of the 40 were of fair or poor quality. When the finding of an infiltrate was dichotomized (0 = no; 1 = possible, probable, or definite) all 4 radiologists agreed on 21 of the 37 chest radiographs. The intraclass correlation coefficient for the presence or absence of infiltrates was 0.54 (95% confidence intervals [CI] 0.38 to 0.69). For the 14 radiographs where infiltrates were observed by all radiologists, intraclass correlation coefficients for the presence of pleural effusions was 0.08 (95% CI -0.10 to 0.41), hilar adenopathy 0.54 (95% CI 0.29 to 0.79), and mediastinal adenopathy 0.49 (95% CI 0.21 to 0.76). CONCLUSION: In conclusion, the interrater agreement among radiologists for mobile chest radiographs in establishing the presence or absence of an infiltrate can be judged to be "fair." Treatment decisions need to include clinical findings and should not be made based on radiographic findings alone.