TY - JOUR
T1 - Quantitative imaging assessment for clinical trials in oncology
AU - Hersberger, Katherine E.
AU - Mendiratta-Lala, Mishal
AU - Fischer, Rocky
AU - Kaza, Ravi K.
AU - Francis, Isaac R.
AU - Olszewski, Mirabella S.
AU - Harju, John F.
AU - Shi, Wei
AU - Manion, Frank J.
AU - Al-Hawary, Mahmoud M.
AU - Sahai, Vaibhav
N1 - Funding Information:
TRAC is a collaborative effort between the departments of internal medicine and radiology at University of Michigan Rogel Cancer Center, and its development was supported by an internal grant from the cancer center from September 2015 through August 2017. The grant provided partial salary support for the informatics team, image analysts (IAs), and codirectors. The core was established in 2016 and draws on the clinical trial and radiologic expertise of its codirectors and several other board-certified radiologists and nuclear medicine physicians. The central mission of the imaging core is to provide independent, unbiased, and verifiable measurements of treatment response for patients enrolled in clinical trials and to serve as a centralized, web-based data resource to enable efficient internal and external auditing. The sustainability of TRAC is based on a fee-for-service model and largely depends on the revenue generated from sponsored trials. The Rogel Cancer Center substantially subsidizes the costs for providing tumor response assessments for National Clinical Trials Network (NCTN) and investigator-initiated trials. The fee per scan was determined by modeling the current and expected number of patient accruals, type of funding of trials, and core budget. The fee is also determined by the type of response criteria and scan modality. A nominal remuneration per scan is transferred to the reading radiologist for reviewing tumor measurements for the imaging core. TRAC also provides consultative services for optimal use of quantitative imaging biomarkers for investigator-initiated trials at the University of Michigan. Since its inception in 2016, TRAC has provided service for .175 clinical trials with review of .1,500 scan time points. The Oncology Clinical Trials Support Unit (O-CTSU) lean workflow assessment showed that, on average, the turnaround time for tumor measurements was reduced from 33 to 3 days.34
Funding Information:
Funding: Research reported in this publication was supported by the NCI of the NIH under award number P30CA046592. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Publisher Copyright:
© 2019 JNCCN - Journal of the National Comprehensive Cancer Network.
PY - 2019
Y1 - 2019
N2 - Background: Objective radiographic assessment is crucial for accurately evaluating therapeutic efficacy and patient outcomes in oncology clinical trials. Imaging assessment workflow can be complex; can vary with institution; may burden medical oncologists, who are often inadequately trained in radiology and response criteria; and can lead to high interobserver variability and investigator bias. This article reviews the development of a tumor response assessment core (TRAC) at a comprehensive cancer center with the goal of providing standardized, objective, unbiased tumor imaging assessments, and highlights the web-based platform and overall workflow. In addition, quantitative response assessments by the medical oncologists, radiologist, and TRAC are compared in a retrospective cohort of patients to determine concordance. Patients and Methods: The TRAC workflow includes an image analyst who pre-reviews scans before review with a board-certified radiologist and then manually uploads annotated data on the proprietary TRAC web portal. Patients previously enrolled in 10 lung cancer clinical trials between January 2005 and December 2015 were identified, and the prospectively collected quantitative response assessments by the medical oncologists were compared with retrospective analysis of the same dataset by a radiologist and TRAC. Results: This study enlisted 49 consecutive patients (53% female) with a median age of 60 years (range, 29-78 years); 2 patients did not meet study criteria and were excluded. A linearly weighted kappa test for concordance for TRAC versus radiologist was substantial at 0.65 (95% CI, 0.46-0.85; standard error [SE], 0.10). The kappa value was moderate at 0.42 (95% CI, 0.20-0.64; SE, 0.11) for TRAC versus oncologists and only fair at 0.34 (95% CI, 0.12-0.55; SE, 0.11) for oncologists versus radiologist. Conclusions: Medical oncologists burdened with the task of tumor measurements in patients on clinical trials may introduce significant variability and investigator bias, with the potential to affect therapeutic response and clinical trial outcomes. Institutional imaging cores may help bridge the gap by providing unbiased and reproducible measurements and enable a leaner workflow.
AB - Background: Objective radiographic assessment is crucial for accurately evaluating therapeutic efficacy and patient outcomes in oncology clinical trials. Imaging assessment workflow can be complex; can vary with institution; may burden medical oncologists, who are often inadequately trained in radiology and response criteria; and can lead to high interobserver variability and investigator bias. This article reviews the development of a tumor response assessment core (TRAC) at a comprehensive cancer center with the goal of providing standardized, objective, unbiased tumor imaging assessments, and highlights the web-based platform and overall workflow. In addition, quantitative response assessments by the medical oncologists, radiologist, and TRAC are compared in a retrospective cohort of patients to determine concordance. Patients and Methods: The TRAC workflow includes an image analyst who pre-reviews scans before review with a board-certified radiologist and then manually uploads annotated data on the proprietary TRAC web portal. Patients previously enrolled in 10 lung cancer clinical trials between January 2005 and December 2015 were identified, and the prospectively collected quantitative response assessments by the medical oncologists were compared with retrospective analysis of the same dataset by a radiologist and TRAC. Results: This study enlisted 49 consecutive patients (53% female) with a median age of 60 years (range, 29-78 years); 2 patients did not meet study criteria and were excluded. A linearly weighted kappa test for concordance for TRAC versus radiologist was substantial at 0.65 (95% CI, 0.46-0.85; standard error [SE], 0.10). The kappa value was moderate at 0.42 (95% CI, 0.20-0.64; SE, 0.11) for TRAC versus oncologists and only fair at 0.34 (95% CI, 0.12-0.55; SE, 0.11) for oncologists versus radiologist. Conclusions: Medical oncologists burdened with the task of tumor measurements in patients on clinical trials may introduce significant variability and investigator bias, with the potential to affect therapeutic response and clinical trial outcomes. Institutional imaging cores may help bridge the gap by providing unbiased and reproducible measurements and enable a leaner workflow.
UR - http://www.scopus.com/inward/record.url?scp=85076298006&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076298006&partnerID=8YFLogxK
U2 - 10.6004/jnccn.2019.7331
DO - 10.6004/jnccn.2019.7331
M3 - Article
C2 - 31805530
AN - SCOPUS:85076298006
SN - 1540-1405
VL - 17
SP - 1505
EP - 1511
JO - JNCCN Journal of the National Comprehensive Cancer Network
JF - JNCCN Journal of the National Comprehensive Cancer Network
IS - 12
ER -