Active reprioritization of the reading worklist using artificial intelligence has a beneficial effect on the turnaround time for interpretation of head ct with intracranial hemorrhage

Thomas J. O’neill, Yin Xi, Edward Stehel, Travis Browning, Yee Seng Ng, Chris Baker, Ronald M. Peshock

Research output: Contribution to journalArticlepeer-review

35 Scopus citations

Abstract

Purpose: To determine how to optimize the delivery of machine learning techniques in a clinical setting to detect intracranial hemorrhage (ICH) on non–contrast-enhanced CT images to radiologists to improve workflow. Materials and Methods: In this study, a commercially available machine learning algorithm that flags abnormal noncontrast CT examinations for ICH was implemented in a busy academic neuroradiology practice between September 2017 and March 2019. The algorithm was introduced in three phases: (a) as a “pop-up” widget on ancillary monitors, (b) as a marked examination in reading worklists, and (c) as a marked examination for reprioritization based on the presence of the flag. A statistical approach, which was based on a queuing theory, was implemented to assess the impact of each intervention on queue-adjusted wait and turnaround time compared with historical controls. Results: Notification with a widget or flagging the examination had no effect on queue-adjusted image wait (P > .99) or turnaround time (P = .6). However, a reduction in queue-adjusted wait time was observed between negative (15.45 minutes; 95% CI: 15.07, 15.38) and positive (12.02 minutes; 95% CI: 11.06, 12.97; P < .0001) artificial intelligence–detected ICH examinations with reprioritization. Reduced wait time was present for all order classes but was greatest for examinations ordered as routine for both inpatients and outpatients because of their low priority. Conclusion: The approach used to present flags from artificial intelligence and machine learning algorithms to the radiologist can reduce image wait time and turnaround times.

Original languageEnglish (US)
Article numbere200024
JournalRadiology: Artificial Intelligence
Volume3
Issue number2
DOIs
StatePublished - Jan 2021

ASJC Scopus subject areas

  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Active reprioritization of the reading worklist using artificial intelligence has a beneficial effect on the turnaround time for interpretation of head ct with intracranial hemorrhage'. Together they form a unique fingerprint.

Cite this