TY - GEN
T1 - Establishing inter-rater reliability for an assessment tool in simulation-based handover training
AU - Sadighi, Mozhdeh
AU - Chen, Rodney
AU - Liang, Tyler
AU - Phelps, Mary Eleanor
AU - Greilich, Philip
N1 - Publisher Copyright:
Copyright, American Society for Engineering Management, 2020.
PY - 2020
Y1 - 2020
N2 - A patient handover involves the transfer of information, responsibility, and authority in a healthcare setting. Structured handovers are critical for effective communication between care providers. Poor patient handovers can contribute to serious medical errors. Therefore, training health profession students on how to effectively perform a structured handover is a core component of their education and will prepare them for clinical practice. This research describes the study conducted to establish inter-rater reliability for a new assessment tool for evaluating learners performing handovers in a simulated setting. This assessment tool focuses on critical items related to handover content, process, and language present in high-quality, structured handovers. The handover simulation which is part of a course called Transitions to Clerkship was recorded for 64 groups of learners. Out of these 64 recorded handovers, 30 videos were selected, through a randomized block design, for grading by four raters who were trained on how to use the tool. A two-way random model was used to calculate the Intraclass Correlation Coefficient (ICC) for inter-rater reliability. ICC for absolute agreement and consistency were 0.507 and 0.617, respectively, suggesting a fair to good level of reliability in the context of this study. The paper concludes with a list of potential factors leading to these reliability scores.
AB - A patient handover involves the transfer of information, responsibility, and authority in a healthcare setting. Structured handovers are critical for effective communication between care providers. Poor patient handovers can contribute to serious medical errors. Therefore, training health profession students on how to effectively perform a structured handover is a core component of their education and will prepare them for clinical practice. This research describes the study conducted to establish inter-rater reliability for a new assessment tool for evaluating learners performing handovers in a simulated setting. This assessment tool focuses on critical items related to handover content, process, and language present in high-quality, structured handovers. The handover simulation which is part of a course called Transitions to Clerkship was recorded for 64 groups of learners. Out of these 64 recorded handovers, 30 videos were selected, through a randomized block design, for grading by four raters who were trained on how to use the tool. A two-way random model was used to calculate the Intraclass Correlation Coefficient (ICC) for inter-rater reliability. ICC for absolute agreement and consistency were 0.507 and 0.617, respectively, suggesting a fair to good level of reliability in the context of this study. The paper concludes with a list of potential factors leading to these reliability scores.
KW - Inter-rater reliability
KW - Patient handover
KW - Simulation training
UR - http://www.scopus.com/inward/record.url?scp=85101601451&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85101601451&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85101601451
T3 - ASEM 41st International Annual Conference Proceedings "Leading Organizations through Uncertain Times"
BT - ASEM 41st International Annual Conference Proceedings "Leading Organizations through Uncertain Times"
A2 - Keathley, H.
A2 - Enos, J.
A2 - Parrish, M.
PB - American Society for Engineering Management
T2 - 41st International Annual Conference of the American Society for Engineering Management: Leading Organizations through Uncertain Times
Y2 - 28 October 2020 through 30 October 2020
ER -