Skip to main navigation Skip to search Skip to main content

Med-Former: A Transformer Based Architecture for Medical Image Classification

  • Stony Brook University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

26 Scopus citations

Abstract

In recent years, transformer-based image classification methods have demonstrated remarkable effectiveness across various image classification tasks. However, their application to medical images presents challenges, especially in the feature extraction capability of the network. Additionally, these models often struggle with the efficient propagation of essential information throughout the network, hindering their performance in medical imaging tasks. To overcome these challenges, we introduce a novel framework comprising Local-Global Transformer module and Spatial Attention Fusion module, collectively referred to as MedFormer. These modules are specifically designed to enhance the feature extraction capability at both local and global levels and improve the propagation of vital information within the network. To evaluate the efficacy of our proposed Med-Former framework, we conducted experiments on three publicly available medical image datasets: NIH Chest X-ray14, DermaMNIST, and BloodMNIST. Our results demonstrate that MedFormer outperforms state-of-the-art approaches underscoring its superior generalization capability and effectiveness in medical image classification.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention - MICCAI 2024 - 27th International Conference, Proceedings
EditorsMarius George Linguraru, Aasa Feragen, Ben Glocker, Stamatia Giannarou, Julia A. Schnabel, Qi Dou, Karim Lekadir
PublisherSpringer Science and Business Media Deutschland GmbH
Pages448-457
Number of pages10
ISBN (Print)9783031721199
DOIs
StatePublished - 2024
Event27th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2024 - Marrakesh, Morocco
Duration: Oct 6 2024Oct 10 2024

Publication series

NameLecture Notes in Computer Science
Volume15011 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference27th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2024
Country/TerritoryMorocco
CityMarrakesh
Period10/6/2410/10/24

Keywords

  • Computer Aided Diagnosis
  • Local-global Feature Extraction
  • Medical Image Classification
  • Spatial Attention Fusion
  • Transformers

Fingerprint

Dive into the research topics of 'Med-Former: A Transformer Based Architecture for Medical Image Classification'. Together they form a unique fingerprint.

Cite this