A universal global rating scale for the evaluation of technical skills in the operating room

BACKGROUND: The ideal assessment of technical skills should be defensible and practical. The purpose of this study was to evaluate the utility of a Global Rating Scale (GRS) Assessment tool of resident operating room performance. METHODS: Residents were assessed in the operating room on multiple occasions during a 6-month study period using a 9-item GRS. Data were analyzed to assess scale reliability and sensitivity to year of training. Feasibility was evaluated with a post-study questionnaire. RESULTS: Seven residents had a total of 32 procedures assessed. One-way analysis of variance (ANOVA) showed that scores increased with year of training (P = .009). Reliability was excellent. (Cronbach's alpha .91). The post-study survey identified feedback and faculty interaction as strengths of this tool, but time constraint was a barrier. CONCLUSIONS: The GRS tool is a valid and reliable method that has the potential to be a practical, useful assessment tool of resident operating room performance.