A Video Transformer Network for Thyroid Cancer Detection on Hyperspectral Histologic Images

Minh Ha Tran, Ofelia Gomez, Baowei Fei

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Hyperspectral imaging is a label-free and non-invasive imaging modality that seeks to capture images in different wavelengths. In this study, we used a vision transformer that was pre-trained from video data to detect thyroid cancer on hyperspectral images. We built a dataset of 49 whole slide hyperspectral images (WS-HSI) of thyroid cancer. To improve training, we introduced 5 new data augmentation methods that transform spectra. We achieved an F-1 score of 88.1% and an accuracy of 89.64% on our test dataset. The transformer network and the whole slide hyperspectral imaging technique can have many applications in digital pathology.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2023
Subtitle of host publicationDigital and Computational Pathology
EditorsJohn E. Tomaszewski, Aaron D. Ward
PublisherSPIE
ISBN (Electronic)9781510660472
DOIs
StatePublished - 2023
EventMedical Imaging 2023: Digital and Computational Pathology - San Diego, United States
Duration: Feb 19 2023Feb 23 2023

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume12471
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2023: Digital and Computational Pathology
Country/TerritoryUnited States
CitySan Diego
Period2/19/232/23/23

Keywords

  • Hyperspectral imaging
  • deep learning
  • image classification
  • thyroid cancer
  • transformer attention-based neural networks
  • whole-slide imaging

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'A Video Transformer Network for Thyroid Cancer Detection on Hyperspectral Histologic Images'. Together they form a unique fingerprint.

Cite this