An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform

Patric Bettati; Jeff Young; Armand Rathgeb; Nati Nawawithan; Jeffrey Gahan; Brett Johnson; Ryan Aspenleiter; Fintan Browne; Aditi Chaudhari; Aditya Guin; Varin Sikand; Grant Webb; Jeremy Sherey; Alsadiq Shammet; Baowei Fei

doi:10.1117/12.3008573

An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform

Patric Bettati, Jeff Young, Armand Rathgeb, Nati Nawawithan, Jeffrey Gahan, Brett Johnson, Ryan Aspenleiter, Fintan Browne, Aditi Chaudhari, Aditya Guin, Varin Sikand, Grant Webb, Jeremy Sherey, Alsadiq Shammet, Baowei Fei

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Biopsies play a crucial role in diagnosis of various diseases including cancers. In this study, we developed an augmented reality (AR) system to improve biopsy procedures and increase targeting accuracy. Our AR-guided biopsy system uses a high-speed motion tracking technology and an AR headset to display a holographic representation of the organ, lesions, and other structures of interest superimposed on real physical objects. The first application of our AR system is prostate biopsy. By incorporating preoperative scans, such as computed tomography (CT) or magnetic resonance imaging (MRI), into real-Time ultrasound-guided procedures, this innovative AR-guided system enables clinicians to see the lesion as well as the organs in real time. With the enhanced visualization of the prostate, lesion, and surrounding organs, surgeons can perform prostate biopsies with an increased accuracy. Our AR-guided biopsy system yielded an average targeting accuracy of 2.94 ± 1.04 mm and can be applied for real-Time guidance of prostate biopsy as well as other biopsy procedures.

Original language	English (US)
Title of host publication	Medical Imaging 2024
Subtitle of host publication	Image-Guided Procedures, Robotic Interventions, and Modeling
Editors	Jeffrey H. Siewerdsen, Maryam E. Rettmann
Publisher	SPIE
ISBN (Electronic)	9781510671607
DOIs	https://doi.org/10.1117/12.3008573
State	Published - 2024
Event	Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling - San Diego, United States Duration: Feb 19 2024 → Feb 22 2024

Publication series

Name	Progress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume	12928
ISSN (Print)	1605-7422

Conference

Conference	Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling
Country/Territory	United States
City	San Diego
Period	2/19/24 → 2/22/24

Keywords

Augmented reality
biopsy
image-guided procedure
prostate cancer
ultrasound imaging

ASJC Scopus subject areas

Electronic, Optical and Magnetic Materials
Atomic and Molecular Physics, and Optics
Biomaterials
Radiology Nuclear Medicine and imaging

Access to Document

10.1117/12.3008573

Cite this

Bettati, P., Young, J., Rathgeb, A., Nawawithan, N., Gahan, J., Johnson, B., Aspenleiter, R., Browne, F., Chaudhari, A., Guin, A., Sikand, V., Webb, G., Sherey, J., Shammet, A., & Fei, B. (2024). An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform. In J. H. Siewerdsen, & M. E. Rettmann (Eds.), Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling Article 129281G (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 12928). SPIE. https://doi.org/10.1117/12.3008573

An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform. / Bettati, Patric; Young, Jeff; Rathgeb, Armand et al.
Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling. ed. / Jeffrey H. Siewerdsen; Maryam E. Rettmann. SPIE, 2024. 129281G (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 12928).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Bettati, P, Young, J, Rathgeb, A, Nawawithan, N, Gahan, J, Johnson, B, Aspenleiter, R, Browne, F, Chaudhari, A, Guin, A, Sikand, V, Webb, G, Sherey, J, Shammet, A & Fei, B 2024, An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform. in JH Siewerdsen & ME Rettmann (eds), Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling., 129281G, Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 12928, SPIE, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling, San Diego, United States, 2/19/24. https://doi.org/10.1117/12.3008573

Bettati P, Young J, Rathgeb A, Nawawithan N, Gahan J, Johnson B et al. An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform. In Siewerdsen JH, Rettmann ME, editors, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling. SPIE. 2024. 129281G. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE). doi: 10.1117/12.3008573

Bettati, Patric ; Young, Jeff ; Rathgeb, Armand et al. / An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform. Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling. editor / Jeffrey H. Siewerdsen ; Maryam E. Rettmann. SPIE, 2024. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE).

@inproceedings{2661742c674f45dabd02b12ae7989ff7,

title = "An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform",

abstract = "Biopsies play a crucial role in diagnosis of various diseases including cancers. In this study, we developed an augmented reality (AR) system to improve biopsy procedures and increase targeting accuracy. Our AR-guided biopsy system uses a high-speed motion tracking technology and an AR headset to display a holographic representation of the organ, lesions, and other structures of interest superimposed on real physical objects. The first application of our AR system is prostate biopsy. By incorporating preoperative scans, such as computed tomography (CT) or magnetic resonance imaging (MRI), into real-Time ultrasound-guided procedures, this innovative AR-guided system enables clinicians to see the lesion as well as the organs in real time. With the enhanced visualization of the prostate, lesion, and surrounding organs, surgeons can perform prostate biopsies with an increased accuracy. Our AR-guided biopsy system yielded an average targeting accuracy of 2.94 ± 1.04 mm and can be applied for real-Time guidance of prostate biopsy as well as other biopsy procedures.",

keywords = "Augmented reality, biopsy, image-guided procedure, prostate cancer, ultrasound imaging",

author = "Patric Bettati and Jeff Young and Armand Rathgeb and Nati Nawawithan and Jeffrey Gahan and Brett Johnson and Ryan Aspenleiter and Fintan Browne and Aditi Chaudhari and Aditya Guin and Varin Sikand and Grant Webb and Jeremy Sherey and Alsadiq Shammet and Baowei Fei",

note = "Publisher Copyright: {\textcopyright} COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.; Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling ; Conference date: 19-02-2024 Through 22-02-2024",

year = "2024",

doi = "10.1117/12.3008573",

language = "English (US)",

series = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",

publisher = "SPIE",

editor = "Siewerdsen, {Jeffrey H.} and Rettmann, {Maryam E.}",

booktitle = "Medical Imaging 2024",

}

TY - GEN

T1 - An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform

AU - Bettati, Patric

AU - Young, Jeff

AU - Rathgeb, Armand

AU - Nawawithan, Nati

AU - Gahan, Jeffrey

AU - Johnson, Brett

AU - Aspenleiter, Ryan

AU - Browne, Fintan

AU - Chaudhari, Aditi

AU - Guin, Aditya

AU - Sikand, Varin

AU - Webb, Grant

AU - Sherey, Jeremy

AU - Shammet, Alsadiq

AU - Fei, Baowei

PY - 2024

Y1 - 2024

N2 - Biopsies play a crucial role in diagnosis of various diseases including cancers. In this study, we developed an augmented reality (AR) system to improve biopsy procedures and increase targeting accuracy. Our AR-guided biopsy system uses a high-speed motion tracking technology and an AR headset to display a holographic representation of the organ, lesions, and other structures of interest superimposed on real physical objects. The first application of our AR system is prostate biopsy. By incorporating preoperative scans, such as computed tomography (CT) or magnetic resonance imaging (MRI), into real-Time ultrasound-guided procedures, this innovative AR-guided system enables clinicians to see the lesion as well as the organs in real time. With the enhanced visualization of the prostate, lesion, and surrounding organs, surgeons can perform prostate biopsies with an increased accuracy. Our AR-guided biopsy system yielded an average targeting accuracy of 2.94 ± 1.04 mm and can be applied for real-Time guidance of prostate biopsy as well as other biopsy procedures.

AB - Biopsies play a crucial role in diagnosis of various diseases including cancers. In this study, we developed an augmented reality (AR) system to improve biopsy procedures and increase targeting accuracy. Our AR-guided biopsy system uses a high-speed motion tracking technology and an AR headset to display a holographic representation of the organ, lesions, and other structures of interest superimposed on real physical objects. The first application of our AR system is prostate biopsy. By incorporating preoperative scans, such as computed tomography (CT) or magnetic resonance imaging (MRI), into real-Time ultrasound-guided procedures, this innovative AR-guided system enables clinicians to see the lesion as well as the organs in real time. With the enhanced visualization of the prostate, lesion, and surrounding organs, surgeons can perform prostate biopsies with an increased accuracy. Our AR-guided biopsy system yielded an average targeting accuracy of 2.94 ± 1.04 mm and can be applied for real-Time guidance of prostate biopsy as well as other biopsy procedures.

KW - Augmented reality

KW - biopsy

KW - image-guided procedure

KW - prostate cancer

KW - ultrasound imaging

UR - http://www.scopus.com/inward/record.url?scp=85192239685&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85192239685&partnerID=8YFLogxK

U2 - 10.1117/12.3008573

DO - 10.1117/12.3008573

M3 - Conference contribution

C2 - 38708142

AN - SCOPUS:85192239685

T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

BT - Medical Imaging 2024

A2 - Siewerdsen, Jeffrey H.

A2 - Rettmann, Maryam E.

PB - SPIE

T2 - Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling

Y2 - 19 February 2024 through 22 February 2024

ER -

An augmented reality-guided biopsy system using a high-speed motion tracking and real-Time registration platform

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this