A Shift on the Horizon

BACKGROUND: As plastic surgery programs transition toward competency-based medical education curricula, it is important to critically assess current methods of evaluating trainee competence. The purpose of this systematic review was to identify and evaluate assessment tools for technical and nontechnical competencies in plastic surgery. METHODS: A systematic search using keywords related to competency-based medical education, assessment, and plastic surgery was conducted. Two independent reviewers extracted data pertaining to study characteristics, study design, and psychometric properties. Data pertaining to the establishment of competence and barriers to tool implementation were noted. RESULTS: Twenty-three studies were included in this review. Technical competencies were assessed in 16 studies. Nontechnical competencies were assessed in five studies. Two studies assessed both technical and nontechnical competence. Six tools were implemented in a simulated setting and 17 tools were implemented in a clinical setting. Thirteen studies (57 percent) did not report reliability scores and nine (39 percent) did not report validity scores. Two tools established clear definitions for competence. Common barriers to implementation included high demands on resources and time, uncertainty about simulation transferability, and assessor burnout. CONCLUSIONS: A number of tools exist to assess a range of plastic surgery skills, in both clinical and simulated settings. There is a need to determine the transferability of simulated assessments to clinical practice, as most available tools are simulation-based. Although additional psychometric testing of current assessment tools is required, particularly in the nontechnical domain, this review provides a base on which to build assessment frameworks that will support plastic surgery's transition to competency-based medical education.