Towards a clinical stereoscopic augmented reality system for laparoscopic surgery

Xin Kang; Jihun Oh; Emmanuel Wilson; Ziv Yaniv; Timothy D. Kane; Craig A Peters; Raj Shekhar

doi:10.1007/978-3-319-05666-1_14

Towards a clinical stereoscopic augmented reality system for laparoscopic surgery

Xin Kang, Jihun Oh, Emmanuel Wilson, Ziv Yaniv, Timothy D. Kane, Craig A Peters, Raj Shekhar

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

8 Scopus citations

Abstract

We describe our development of a complete real-time stereoscopic augmented reality system that overlays laparoscopic ultrasound (LUS) images on stereoscopic laparoscopic video for conventional laparoscopic surgery. The system was designed and developed to achieve near-term clinical evaluation as a primary goal. Special consideration was paid to system interactivity, accuracy and easy integration within the existing clinical workflow. Custom-designed fixtures for the two imaging devices were created to avoid their recalibration in the operating room and thus to minimize setup time. The system was assembled on a rolling cart to make it portable for the use in the operating room. Utilizing our optimized design and hardware-accelerated implementation, the system achieved a low system latency of approximately 150 ms. The LUS image-to-video registration accuracy, measured in terms of target registration accuracy and recorded separately for the left and right eye channels of the stereoscopic camera, was 3.34±0.59 mm and 2.76±0.68 mm.

Original language	English (US)
Title of host publication	Clinical Image-Based Procedures
Subtitle of host publication	Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers
Publisher	Springer Verlag
Pages	108-116
Number of pages	9
ISBN (Print)	9783319056654
DOIs	https://doi.org/10.1007/978-3-319-05666-1_14
State	Published - Jan 1 2014
Event	2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013 - Nagoya, Japan Duration: Sep 22 2013 → Sep 22 2013

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	8361 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013
Country/Territory	Japan
City	Nagoya
Period	9/22/13 → 9/22/13

Keywords

Clinical prototype
Laparoscopic surgery
Real-time AR
Stereoscopic augmented reality (AR)

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-319-05666-1_14

Cite this

Kang, X., Oh, J., Wilson, E., Yaniv, Z., Kane, T. D., Peters, C. A., & Shekhar, R. (2014). Towards a clinical stereoscopic augmented reality system for laparoscopic surgery. In Clinical Image-Based Procedures: Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers (pp. 108-116). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8361 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-05666-1_14

Towards a clinical stereoscopic augmented reality system for laparoscopic surgery. / Kang, Xin; Oh, Jihun; Wilson, Emmanuel et al.

Clinical Image-Based Procedures: Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers. Springer Verlag, 2014. p. 108-116 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8361 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kang, X, Oh, J, Wilson, E, Yaniv, Z, Kane, TD, Peters, CA & Shekhar, R 2014, Towards a clinical stereoscopic augmented reality system for laparoscopic surgery. in Clinical Image-Based Procedures: Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8361 LNCS, Springer Verlag, pp. 108-116, 2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013, Nagoya, Japan, 9/22/13. https://doi.org/10.1007/978-3-319-05666-1_14

Kang X, Oh J, Wilson E, Yaniv Z, Kane TD, Peters CA et al. Towards a clinical stereoscopic augmented reality system for laparoscopic surgery. In Clinical Image-Based Procedures: Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers. Springer Verlag. 2014. p. 108-116. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-05666-1_14

Kang, Xin ; Oh, Jihun ; Wilson, Emmanuel et al. / Towards a clinical stereoscopic augmented reality system for laparoscopic surgery. Clinical Image-Based Procedures: Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers. Springer Verlag, 2014. pp. 108-116 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{1513e9cdedbb4dc9bf1fb0272b1fbfc3,

title = "Towards a clinical stereoscopic augmented reality system for laparoscopic surgery",

abstract = "We describe our development of a complete real-time stereoscopic augmented reality system that overlays laparoscopic ultrasound (LUS) images on stereoscopic laparoscopic video for conventional laparoscopic surgery. The system was designed and developed to achieve near-term clinical evaluation as a primary goal. Special consideration was paid to system interactivity, accuracy and easy integration within the existing clinical workflow. Custom-designed fixtures for the two imaging devices were created to avoid their recalibration in the operating room and thus to minimize setup time. The system was assembled on a rolling cart to make it portable for the use in the operating room. Utilizing our optimized design and hardware-accelerated implementation, the system achieved a low system latency of approximately 150 ms. The LUS image-to-video registration accuracy, measured in terms of target registration accuracy and recorded separately for the left and right eye channels of the stereoscopic camera, was 3.34±0.59 mm and 2.76±0.68 mm.",

keywords = "Clinical prototype, Laparoscopic surgery, Real-time AR, Stereoscopic augmented reality (AR)",

author = "Xin Kang and Jihun Oh and Emmanuel Wilson and Ziv Yaniv and Kane, {Timothy D.} and Peters, {Craig A} and Raj Shekhar",

year = "2014",

month = jan,

day = "1",

doi = "10.1007/978-3-319-05666-1_14",

language = "English (US)",

isbn = "9783319056654",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "108--116",

booktitle = "Clinical Image-Based Procedures",

note = "2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013 ; Conference date: 22-09-2013 Through 22-09-2013",

}

TY - GEN

T1 - Towards a clinical stereoscopic augmented reality system for laparoscopic surgery

AU - Kang, Xin

AU - Oh, Jihun

AU - Wilson, Emmanuel

AU - Yaniv, Ziv

AU - Kane, Timothy D.

AU - Peters, Craig A

AU - Shekhar, Raj

PY - 2014/1/1

Y1 - 2014/1/1

N2 - We describe our development of a complete real-time stereoscopic augmented reality system that overlays laparoscopic ultrasound (LUS) images on stereoscopic laparoscopic video for conventional laparoscopic surgery. The system was designed and developed to achieve near-term clinical evaluation as a primary goal. Special consideration was paid to system interactivity, accuracy and easy integration within the existing clinical workflow. Custom-designed fixtures for the two imaging devices were created to avoid their recalibration in the operating room and thus to minimize setup time. The system was assembled on a rolling cart to make it portable for the use in the operating room. Utilizing our optimized design and hardware-accelerated implementation, the system achieved a low system latency of approximately 150 ms. The LUS image-to-video registration accuracy, measured in terms of target registration accuracy and recorded separately for the left and right eye channels of the stereoscopic camera, was 3.34±0.59 mm and 2.76±0.68 mm.

AB - We describe our development of a complete real-time stereoscopic augmented reality system that overlays laparoscopic ultrasound (LUS) images on stereoscopic laparoscopic video for conventional laparoscopic surgery. The system was designed and developed to achieve near-term clinical evaluation as a primary goal. Special consideration was paid to system interactivity, accuracy and easy integration within the existing clinical workflow. Custom-designed fixtures for the two imaging devices were created to avoid their recalibration in the operating room and thus to minimize setup time. The system was assembled on a rolling cart to make it portable for the use in the operating room. Utilizing our optimized design and hardware-accelerated implementation, the system achieved a low system latency of approximately 150 ms. The LUS image-to-video registration accuracy, measured in terms of target registration accuracy and recorded separately for the left and right eye channels of the stereoscopic camera, was 3.34±0.59 mm and 2.76±0.68 mm.

KW - Clinical prototype

KW - Laparoscopic surgery

KW - Real-time AR

KW - Stereoscopic augmented reality (AR)

UR - http://www.scopus.com/inward/record.url?scp=84901649902&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901649902&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-05666-1_14

DO - 10.1007/978-3-319-05666-1_14

M3 - Conference contribution

AN - SCOPUS:84901649902

SN - 9783319056654

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 108

EP - 116

BT - Clinical Image-Based Procedures

PB - Springer Verlag

T2 - 2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013

Y2 - 22 September 2013 through 22 September 2013

ER -

Towards a clinical stereoscopic augmented reality system for laparoscopic surgery

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this