Skip to main navigation Skip to search Skip to main content

Flow-Based Visual Quality Enhancer for Super-Resolution Magnetic Resonance Spectroscopic Imaging

  • Siyuan Dong
  • , Gilbert Hangel
  • , Eric Z. Chen
  • , Shanhui Sun
  • , Wolfgang Bogner
  • , Georg Widhalm
  • , Chenyu You
  • , John A. Onofrey
  • , Robin de Graaf
  • , James S. Duncan
  • Yale University
  • Medical University of Vienna
  • United Imaging Intelligence

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

Magnetic Resonance Spectroscopic Imaging (MRSI) is an essential tool for quantifying metabolites in the body, but the low spatial resolution limits its clinical applications. Deep learning-based super-resolution methods provided promising results for improving the spatial resolution of MRSI, but the super-resolved images are often blurry compared to the experimentally-acquired high-resolution images. Attempts have been made with the generative adversarial networks to improve the image visual quality. In this work, we consider another type of generative model, the flow-based model, of which the training is more stable and interpretable compared to the adversarial networks. Specifically, we propose a flow-based enhancer network to improve the visual quality of super-resolution MRSI. Different from previous flow-based models, our enhancer network incorporates anatomical information from additional image modalities (MRI) and uses a learnable base distribution. In addition, we impose a guide loss and a data-consistency loss to encourage the network to generate images with high visual quality while maintaining high fidelity. Experiments on a 1H-MRSI dataset acquired from 25 high-grade glioma patients indicate that our enhancer network outperforms the adversarial networks and the baseline flow-based methods. Our method also allows visual quality adjustment and uncertainty estimation. Our code is available at https://github.com/dsy199610/Flow-Enhancer-SR-MRSI.

Original languageEnglish
Title of host publicationDeep Generative Models - 2nd MICCAI Workshop, DGM4MICCAI 2022, Held in Conjunction with MICCAI 2022, Proceedings
EditorsAnirban Mukhopadhyay, Ilkay Oksuz, Sandy Engelhardt, Dajiang Zhu, Yixuan Yuan
PublisherSpringer Science and Business Media Deutschland GmbH
Pages3-13
Number of pages11
ISBN (Print)9783031185755
DOIs
StatePublished - 2022
Event2nd Workshop on Deep Generative Models for Medical Image Computing and Computer Assisted Intervention, DGM4MICCAI 2022, held in Conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2022 - Singapore, Singapore
Duration: Sep 22 2022Sep 22 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13609 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference2nd Workshop on Deep Generative Models for Medical Image Computing and Computer Assisted Intervention, DGM4MICCAI 2022, held in Conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2022
Country/TerritorySingapore
CitySingapore
Period09/22/2209/22/22

Keywords

  • Brain MRSI
  • Normalizing flow
  • Super-resolution

Fingerprint

Dive into the research topics of 'Flow-Based Visual Quality Enhancer for Super-Resolution Magnetic Resonance Spectroscopic Imaging'. Together they form a unique fingerprint.

Cite this