Content specificity and oral certification examinations

This study reports on the generalizability of different skills assessed in the oral certification examinations in Internal Medicine of the Royal College of Physicians and Surgeons of Canada. Assessments from the 1992 examination were examined prospectively to determine (i) inter-rater reliability, (ii) correlation from morning to afternoon sessions, and (iii) overall test reliability. While inter-rater reliability was acceptable and in the …