AEM Education and Training 08: Factors Important to Top Clinical Performance in EM Residency

Welcome to the eighth episode of AEM Education and Training, a podcast collaboration between the Academic Emergency Medicine E&T Journal and Brown Emergency Medicine. Each quarter, we'll give you digital open access to AEM E&T Articles or Articles in Press, with an author interview podcast and links to curated supportive educational materials for EM learners and medical educators.

Find this podcast series on iTunes here.

AEM E and T Podcasts logo[1].png

DISCUSSING (click on title to access):

Factors Important to Top Clinical Performance in Emergency Medicine Residency: Results of an Ideation Survey and Delphi Panel. Jesse M. Pines MD, MBA, MSCE Sukayna Alfaraj MD Sonal Batra MD, MST Caitlin Carter MPH Nisha Manikoth EdD Colleen N. Roche MD James Scott MD Ellen F. Goldman Ed


Screen Shot 2018-10-20 at 2.35.05 PM.png

Jesse Pines MD, MBA, MSCE

National Director of Clinical Innovation, US Acute Care Solutions



We explore attributes, traits, background, skills, and behavioral factors important to top clinical performance in emergency medicine (EM) residency.


We used a two‐step process—an ideation survey with the Council of Emergency Medicine Residency Directors and a modified Delphi technique—to identify: 1) factors important to top performance, 2) preresidency factors that predict it, and 3) the best ways to measure it. In the Delphi, six expert educators in emergency care assessed the presence of the factors from the ideation survey results in their top clinical performers. Consensus on important factors that were exemplified in >60% of top performers were retained in three Delphi rounds as well as predictors and measures of top performance.


The ideation survey generated 81 responses with ideas for each factor. These were combined into 89 separate factors in seven categories: attributes, personal traits, emergency department (ED)‐specific skills and behaviors, general skill set, background, preresidency predictors, and ways to measure top performance. After three Delphi rounds, the panel achieved consensus on 20 factors important to top clinical performance. This included two attributes, seven traits, one general skill set, and 10 ED‐specific skills and behaviors. Interview performance was considered the sole important preresidency predictor and clinical competency committee results the sole important measure of top performance.


Our expert panel identified 20 factors important to top clinical performance in EM residency. Future work is needed to further explore how individuals learn and develop these factors.