SHM Converge Scientific Abstract ePoster Gallery-Making Narrative Feedback Meaningful

Pdf Summary

This project from the University of Kentucky College of Medicine examined whether faculty development could improve the quality of narrative feedback given to third-year medical students (M3s).<br /><br />The team created a narrative feedback rubric to score evaluations across three domains: positive feedback, constructive feedback, and an improvement plan. Each domain was rated from 0 to 2, based on whether feedback was absent, present but nonspecific, or specific to a skill/behavior. The rubric was tested for reliability using 146 evaluations scored by three raters, achieving excellent agreement (intraclass correlation coefficient = 0.959).<br /><br />They then measured feedback quality before and after an intervention. Pre-intervention scoring included 323 evaluations from 35 faculty members in 2019–2020. The intervention had two parts: general faculty development during hospitalist group meetings in 2020–2021, followed by targeted individual feedback through one-on-one meetings and score reports with each faculty member in January–March 2021. Post-intervention scoring included 202 evaluations from 24 faculty members in 2021–2022.<br /><br />Results showed that targeted faculty development improved narrative feedback quality, with a statistically significant change in mean ratings (p = 0.05). The project suggests that both broad faculty education and individualized feedback can help teachers provide more meaningful, specific, and actionable comments to students.<br /><br />Planned next steps include expanding the rubric and intervention to other groups, settings, and institutions, as well as external validation of the tool.

Asset Subtitle

Alan M. Hall

Meta Tag

Author List Adam Gray, Alan M. Hall, John W. Ragsdale

Category Research

Concept Narrative Feedback Rubric

Concept Faculty Development Intervention

Concept Clinical Evaluation Comment

Concept Feedback Quality

Concept Specificity

Distinguished Non-Finalist

Presenter Organization University of Kentucky College of Medicine

Presenting Author Alan M. Hall

Track Education

Keywords

faculty development

narrative feedback

medical education

third-year medical students

feedback rubric

evaluation quality

constructive feedback

improvement plan

hospitalist group meetings

intraclass correlation coefficient

Narrative Feedback Rubric

Faculty Development Intervention

Clinical Evaluation Comment

Feedback Quality

Specificity