AEM Education and Training 16: Does the Emergency Medicine In‐training Examination Accurately Reflect Residents’ Clinical Experiences?

Welcome to the sixteenth episode of AEM Education and Training, a podcast collaboration between the Academic Emergency Medicine E&T Journal and Brown Emergency Medicine. Each quarter, we'll give you digital open access to AEM E&T Articles or Articles in Press, with an author interview podcast and links to curated supportive educational materials for EM learners and medical educators.

Find this podcast series on iTunes here.

DISCUSSING (CLICK ON TITLE TO ACCESS):

Does the Emergency Medicine In‐training Examination Accurately Reflect Residents’ Clinical Experiences?Jason J. Bischof MD, Geremiha Emerson MD, Jennifer Mitzman MD, Sorabh Khandelwal MD, David P. Way MEd, Lauren T. Southerland MD

LISTEN NOW: INTERVIEW WITH AUTHOR Geremiha Emerson MD

Geremiha Emerson, MD

Assistant Professor

Assistant Program Director

Ohio State Emergency Medicine Residency

Abstract

Objective

The American Board of Emergency Medicine Model of the Clinical Practice of Emergency Medicine (ABEM Model) serves as a guide for resident education and the basis for the resident In‐training Examination (ITE) and the Emergency Medicine Board Qualification Examinations. The purpose of this study was to determine how closely resident–patient encounters in our emergency departments (EDs) matched the ABEM Model as presented in the specifications of the content outline for the ITE.

Methods

This single‐site study of an academic residency program analyzed all documented resident–patient encounters in the ED during a 2.5‐year period recorded in the electronic medical record. The chief complaints from these encounters were matched to the 20 categories of the ABEM Model. Chi‐square goodness‐of‐fit tests were performed to compare the proportions of categorized encounters and proportions of patient acuity levels to the proportions of categories as outlined in the content blueprint of the ITE.

Results

After the exclusion of encounters with missing data and those not involving EM residents, 125,405 encounters were analyzed. We found a significant difference between the clinical experience of EM residents and the ABEM Model as reflected in the ITE for both case categories (p < 0.01) and patient acuity (p < 0.01). The following categories were the most overrepresented in clinical care: signs, symptoms, and presentations; psychobehavioral disorders; and abdominal and gastrointestinal disorders. The most underrepresented were procedures and skills, systemic infectious disorders, and thoracic–respiratory disorders.

Conclusion

The clinical experience of EM residents differs significantly from the ITE Content Blueprint, which reflects the ABEM Model. This type of inquiry may help to provide custom education reports to residents about their clinical encounters to help identify clinical knowledge gaps that may require supplemental nonclinical training.