Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis

About

Whole slide image (WSI) analysis is central to computational pathology, with multiple instance learning (MIL) emerging as the standard pipeline for slide-level diagnosis. However, conventional approaches formulate WSI diagnosis as a flat classification task over discrete labels, contradicting the inherently hierarchical, coarse-to-fine nature of clinical reasoning. Although recent hierarchical classifiers and vision-language models (VLMs) have sought to address this structural gap, they either fail to capture semantic continuity between related diagnoses or suffer from unconstrained text generation that produces taxonomic hallucinations and parent-child label violations. To address these limitations, we propose TaxoMIL, a taxonomy-constrained framework that reformulates WSI diagnosis as a multi-granularity text generation task. TaxoMIL utilizes a dual-head Transformer decoder to generate coarse- and fine-level diagnostic text, and introduces taxonomy-guided objectives that explicitly structure the label embedding space and strictly ground slide-level visual representations within the clinical taxonomy. Extensive experiments across three diverse WSI datasets demonstrate that TaxoMIL consistently outperforms state-of-the-art MIL classifiers and VLM-based generative methods, yielding accurate and hierarchy-aware diagnostic predictions. The code is released at https://github.com/QuIIL/TaxoMIL

Chaeyeon Lee, Khang Nguyen Quoc, Jinsol Song, Yosep Chong, Kwangil Yim, Jin Tae Kwak• 2026

Related benchmarks

TaskDatasetResultRank
Multiple Instance Learning ClassificationGastWSI
Accuracy (%)64.55
13
Multiple Instance Learning ClassificationBRACS
Accuracy75.78
13
Multiple Instance Learning ClassificationPanda
Accuracy54.6
13
WSI ClassificationGastWSI Coarse-level
Accuracy88.56
13
WSI ClassificationBRACS Coarse-level
Accuracy90.74
13
WSI ClassificationPANDA Coarse-level
Accuracy71.29
13
WSI ClassificationGastWSI Fine-level
Accuracy65.86
13
WSI ClassificationBRACS Fine-level
Accuracy77.78
13
WSI ClassificationPANDA Fine-level
Accuracy (ACC)55.07
13
Computational Efficiency AnalysisComputational Efficiency
Trainable Parameters (M)218.8
13
Showing 10 of 13 rows

Other info

Follow for update