Deep learning enabled scoring of pancreatic neuroendocrine tumors based on cancer infiltration patterns

Abstract

Pancreatic neuroendocrine tumors (PanNETs) are a heterogeneous group of neoplasms that include tumors with different histomorphologic characteristics that can be correlated to sub-categories with different prognoses. In addition to the WHO grading scheme based on tumor proliferative activity, a new parameter based on the scoring of infiltration patterns at the interface of tumor and non-neoplastic parenchyma (tumor-NNP interface) has recently been proposed for PanNET categorization. Despite the known correlations, these categorizations can still be problematic due to the need for human judgment, which may involve intra- and inter-observer variability. Although there is a great need for automated systems working on quantitative metrics to reduce observer variability, there are no such systems for PanNET categorization. Addressing this gap, this study presents a computational pipeline that uses deep learning models to automatically categorize PanNETs for the first time. This pipeline proposes to quantitatively characterize PanNETs by constructing entity-graphs on the cells, and to learn the PanNET categorization using a graph neural network (GNN) trained on these graphs. Different than the previous studies, the proposed model integrates pathology domain knowledge into the GNN construction and training for the purpose of a deeper utilization of the tumor microenvironment and its architectural changes for PanNET categorization. We tested our model on 105 HE stained whole slide images of PanNET tissues. The experiments revealed that this domain knowledge integrated pipeline led to a 76.70% test set F1-score, resulting in significant improvements over its counterparts.