Skip to content

Commit

Permalink
Update announcement_miccai2024
Browse files Browse the repository at this point in the history
  • Loading branch information
caodoanh2001 authored Jun 18, 2024
1 parent 19881c0 commit 798fa7c
Showing 1 changed file with 8 additions and 4 deletions.
12 changes: 8 additions & 4 deletions _news/announcement_miccai2024
Original file line number Diff line number Diff line change
Expand Up @@ -8,13 +8,17 @@ categories: sample-posts
inline: false
---

## FALFormer: Feature-aware Landmarks self-attention for Whole-slide Image Classification
FALFormer: Feature-aware Landmarks self-attention for Whole-slide Image Classification


Authors: Doanh C. Bui, Trinh T. L. Vuong, Jin Tae Kwak


Abstract: Slide-level classification for whole-slide images (WSIs) has been widely recognized as a crucial problem in digital and computational pathology. Current approaches commonly consider WSIs as a bag of cropped patches and process them via multiple instance learning due to the large number of patches, which cannot fully explore the relationship among patches; in other words, the global information cannot be fully incorporated into decision making. Herein, we propose an efficient and effective slide-level classification model, named as FALFormer, that can process a WSI as a whole so as to fully exploit the relationship among the entire patches and to improve the classification performance. FALFormer is built based upon Transformers and self-attention mechanism. To lessen the computational burden of the original self-attention mechanism and to process the entire patches together in a WSI, FALFormer employs Nystrom self-attention which approximates the computation by using a smaller number of tokens or landmarks. For effective learning, FALFormer introduces feature-aware landmarks to enhance the representation power of the landmarks and the quality of the approximation. We systematically evaluate the performance of FALFormer using two public datasets, including CAMELYON16 and TCGA-BRCA. The experimental results demonstrate that FALFormer achieves superior performance on both datasets, outperforming the state-of-the-art methods for the slide-level classification. This suggests that FALFormer can facilitate an accurate and precise analysis of WSIs, potentially leading to improved diagnosis and prognosis on WSIs.

*Doanh C. Bui, Trinh T. L. Vuong, Jin Tae Kwak*

**Abstract:** Slide-level classification for whole-slide images (WSIs) has been widely recognized as a crucial problem in digital and computational pathology. Current approaches commonly consider WSIs as a bag of cropped patches and process them via multiple instance learning due to the large number of patches, which cannot fully explore the relationship among patches; in other words, the global information cannot be fully incorporated into decision making. Herein, we propose an efficient and effective slide-level classification model, named as FALFormer, that can process a WSI as a whole so as to fully exploit the relationship among the entire patches and to improve the classification performance. FALFormer is built based upon Transformers and self-attention mechanism. To lessen the computational burden of the original self-attention mechanism and to process the entire patches together in a WSI, FALFormer employs Nystr\"om self-attention which approximates the computation by using a smaller number of tokens or landmarks. For effective learning, FALFormer introduces feature-aware landmarks to enhance the representation power of the landmarks and the quality of the approximation. We systematically evaluate the performance of FALFormer using two public datasets, including CAMELYON16 and TCGA-BRCA. The experimental results demonstrate that FALFormer achieves superior performance on both datasets, outperforming the state-of-the-art methods for the slide-level classification. This suggests that FALFormer can facilitate an accurate and precise analysis of WSIs, potentially leading to improved diagnosis and prognosis on WSIs.

<img src="https://caodoanh2001.github.io/assets/img/miccai2024.png" data-canonical-src="https://caodoanh2001.github.io/assets/img/miccai2024.png" width="750" height="500" />


This work was conducted under the supervision of Prof. Jin Tae Kwak during my master's degree.
Paper and code will be released soon!

0 comments on commit 798fa7c

Please sign in to comment.