Automated Staging of Breast Cancer Histopathology Images Using Deep Learning
Document Type
Presentation
Publication Date
11-28-2022
Keywords
oregon; chiles
Abstract
Cancer is the second deadliest disease in the US. Each year, breast cancer alone causes the deaths of over 47,000 people[1]. A key tool in the diagnosis and classification of cancer lies in the realm of Histopathology images in which a trained specialist, known as a pathologist, examines chemically stained biopsy samples under high magnification to diagnose cancerous tissue. We have developed a model to automatically diagnose breast cancer images found on The Cancer Genome Atlas (TCGA) based solely on their digital pathology image. In addition to identifying high risk patients, this model may help those with low grade cancer from undergoing costly treatments and surgeries. The problem is formulated as a multiclass classification ranging from in situ to metastatic breast cancer stages (I, II, III, and IV) using H&E (Hematoxylin and Eosin) stained images. The model was developed using the pipeline detailed in Figure 1. Each digital Whole Slide Image (WSI) is assigned to a training, validation or testing set. The image is then converted into the Hue, Saturation, and Value (HSV) colorspace as the colorspace of tissue regions correspond primarily in the purple-blue region of the Hue spectrum. From these regions, 256x256 pixel images are sampled and passed through a VGG-16 model to determine whether they are from benign or malignant tissue[2]. If a tile is classified as being cancerous, it was then passed through a ResNet-18 model for stage classification. Finally, the WSI is classified using the maximum probability of all the individual tiles extracted. Figure 1: Pipeline of Staging Using this workflow, we have generated over 15,000 tiles for each WSI from the TCGA BRCA dataset. Currently, the individual tumor detector and staging prediction models have been built, but have not been integrated. The accuracy of our VGG-16 model for predicting tumor tiles was found to be greater than 95% using a subset of the CAMELYON17 WSI dataset[2]. Meanwhile, a ResNet-18 model trained using all available TCGA tiles had an overall accuracy of 65%-70%. Accuracy is currently limited due to the small number of available data used for training, as only 5-7 WSIs per stage have been processed. In addition, once the tumor filtering stage is integrated,the final model should be less prone to overfitting and better able to find clinically relevant features.
Clinical Institute
Cancer
Clinical Institute
Women & Children
Specialty/Research Institute
Oncology
Comments
Presented at the Women in Machine Learning Annual Workshop, NeurIPS; November 28; New Orleans, LA. 2022.