The aggregate score technique is a new method to assess problem-solving in an actual encounter with a simulated patient. The technique focuses on diagnosis, investigations and management, and results in the derivation of a score for each area based on the comparison of items listed by a student to those of a criterion group. The paper describes a series of studies which were designed to establish the reliability and concurrent validity of the method.