Incorporating biomechanical modeling and deep learning into a deformation-driven liver CBCT reconstruction technique

You Zhang, Liyuan Chen, Bin Li, Michael R Folkert, Xun Jia, Xuejun Gu, Jing Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


Deformation-driven CBCT reconstruction techniques can generate accurate and high-quality CBCTs from deforming prior CTs using sparse-view cone-beam projections. The solved deformation-vector-fields (DVFs) also propagate tumor contours from prior CTs, which allows automatic localization of low-contrast liver tumors on CBCTs. To solve the DVFs, the deformation-driven techniques generate digitally-reconstructed-radiographs (DRRs) from the deformed image to compare with acquired cone-beam projections, and use their intensity mismatch as a metric to evaluate and optimize the DVFs. To boost the deformation accuracy at low-contrast liver tumor regions where limited intensity information exists, we incorporated biomechanical modeling into the deformation-driven CBCT reconstruction process. Biomechanical modeling solves the deformation on the basis of material geometric and elastic properties, enabling accurate deformation in a low-contrast context. Moreover, real clinical cone-beam projections contain amplified scatter and noise than DRRs. These degrading signals are complex, non-linear in nature and can reduce the accuracy of deformation-driven CBCT reconstruction. Conventional correction methods towards these signals like linear fitting lead to over-simplification and sub-optimal results. To address this issue, this study applied deep learning to derive an intensity mapping scheme between cone-beam projections and DRRs for cone-beam projection intensity correction prior to CBCT reconstructions. Evaluated by 10 liver imaging sets, the proposed technique achieved accurate liver CBCT reconstruction and localized the tumors to an accuracy of ∼1 mm, with average DICE coefficient over 0.8. Incorporating biomechanical modeling and deep learning, the deformation-driven technique allows accurate liver CBCT reconstruction from sparse-view projections, and accurate deformation of low-contrast areas for automatic tumor localization.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2019
Subtitle of host publicationPhysics of Medical Imaging
EditorsTaly Gilat Schmidt, Guang-Hong Chen, Hilde Bosmans
ISBN (Electronic)9781510625433
StatePublished - 2019
EventMedical Imaging 2019: Physics of Medical Imaging - San Diego, United States
Duration: Feb 17 2019Feb 20 2019

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceMedical Imaging 2019: Physics of Medical Imaging
Country/TerritoryUnited States
CitySan Diego


  • Biomechanical modeling
  • Cone-beam computed tomography
  • Contour propagation
  • DICE coefficient
  • Deep learning
  • Deformation vector field
  • Liver

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Incorporating biomechanical modeling and deep learning into a deformation-driven liver CBCT reconstruction technique'. Together they form a unique fingerprint.

Cite this