SHM Converge Scientific Abstract ePoster Gallery-A Comparison of Epa to Milestone Evaluations on Medicine Wards

Pdf Summary

The document compares two types of end-of-rotation resident evaluations on medicine wards: traditional milestone-based assessments versus single-question EPA (Entrustable Professional Activity) evaluations.<br /><br />The motivation was that end-of-rotation assessments often have poor response rates and weak qualitative feedback. The goal was to compare EPA and milestone summative assessments by completion rates, word counts, and overall rating scores.<br /><br />Methods: The study examined assessments from a university hospital, VA hospital, and San Francisco county hospital one year after implementation, over a two-year period. The university site used an 11-question milestone-based evaluation, while the VA and county sites used a single-question EPA-based evaluation.<br /><br />Key results:<br />- EPA evaluations had a higher completion rate: 1,079 of 1,250 assigned assessments completed (86.3%) versus 985 of 1,395 milestone evaluations (70.6%), which was statistically significant.<br />- EPA evaluations also produced longer written feedback, averaging 111.5 words compared with 90.7 words for milestone evaluations, also statistically significant.<br />- The average numeric entrustment score did not differ significantly between the two tools (p = 0.69).<br /><br />Conclusion: Single-question EPA evaluations appear to improve completion rates and may encourage more written feedback than milestone-based assessments for this cohort of medical residents, without changing numeric rating outcomes.

Asset Subtitle

Megan Humphrey

Meta Tag

Author List Jeffery Kohlwes, Megan Humphrey

Category Research

Concept Entrustable Professional Activity

Concept Milestone

Concept Entrustment score

Concept End-of-rotation assessment

Concept Completion Rate

Distinguished Non-Finalist

Presenter Organization Ucsf

Presenting Author Megan Humphrey

Track Education

Keywords

resident evaluations

end-of-rotation assessment

milestone-based assessment

EPA evaluation

entrustable professional activity

completion rate

written feedback

medical residents

assessment comparison

numeric rating scores

Entrustable Professional Activity

Milestone

Entrustment score

End-of-rotation assessment

Completion Rate