Sasha M. Ulrich, MD; Joseph C. L’Huillier, MD; Sarah A. Jung, PhD; Laura K. Krecko, MD; Alexandra A. Rosser, BS; Amy K. Schulze, MD; Amy E. Liepert, MD; Ann P. O’Rourke, MD, MPH
Background: Simulation-based medical education, an educational model in which students engage in simulated patient scenarios, improves performance. However, assessment tools including the Oxford Non-Technical Skills (NOTECHS) scale require expert assessors. We modified this tool for novice use.
Methods: Medical students participated in 5 nontechnical simulations. The NOTECHS scale was modified to allow for novice evaluation. Three novices and 2 experts assessed performance, with intraclass correlation used to assess validity.
Results: Twenty-two learners participated in the simulations. Novice reviewers had moderate to excellent correlation among evaluations (0.66 < intraclass correlation coefficients [ICC] < 0.95). Novice and expert reviewers had moderate to good correlation among evaluations (0.51 < ICC < 0.88).
Discussion: The modified NOTECHS scales can be utilized by novices to evaluate simulation performance. Novice assessment correlates with expert review. These tools may encourage the use of simulation-based medical education.